2022-07-30 02:59:36 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.method: does not have a value in the enumeration [Standard], $.method: must be a constant value Standard 2022-07-30 02:59:36 INFO i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/54/1/logs.log 2022-07-30 02:59:36 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.39.39-alpha 2022-07-30 02:59:36 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-postgres:0.4.37 exists... 2022-07-30 02:59:36 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-postgres:0.4.37 was found locally. 2022-07-30 02:59:36 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 54 2022-07-30 02:59:36 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/54/1 --log-driver none --name source-postgres-check-54-1-wxbpw --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_CONNECTOR_IMAGE=airbyte/source-postgres:0.4.37 -e WORKER_JOB_ATTEMPT=1 -e AIRBYTE_VERSION=0.39.39-alpha -e WORKER_JOB_ID=54 airbyte/source-postgres:0.4.37 check --config source_config.json 2022-07-30 02:59:38 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:38 INFO i.a.i.b.a.AdaptiveSourceRunner$Runner(getSource):73 - Running source under deployment mode: OSS 2022-07-30 02:59:38 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:38 INFO i.a.i.b.a.AdaptiveSourceRunner$Runner(run):85 - Starting source: io.airbyte.integrations.base.ssh.SshWrappedSource 2022-07-30 02:59:38 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:38 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2022-07-30 02:59:38 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:38 INFO i.a.i.b.IntegrationRunner(runInternal):102 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2022-07-30 02:59:38 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:38 INFO i.a.i.b.IntegrationRunner(runInternal):103 - Command: CHECK 2022-07-30 02:59:38 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:38 INFO i.a.i.b.IntegrationRunner(runInternal):104 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-07-30 02:59:39 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:39 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:59:39 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:39 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:59:39 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:39 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:59:39 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:39 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:59:39 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:39 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword min - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:59:39 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:39 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword max - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:59:39 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:39 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL 2022-07-30 02:59:39 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:39 INFO c.z.h.HikariDataSource():80 - HikariPool-1 - Starting... 2022-07-30 02:59:39 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:39 INFO c.z.h.HikariDataSource():82 - HikariPool-1 - Start completed. 2022-07-30 02:59:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:40 INFO i.a.i.s.p.PostgresUtils(isCdc):29 - using CDC: true 2022-07-30 02:59:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:40 INFO i.a.i.s.j.AbstractJdbcSource(lambda$getCheckOperations$1):95 - Attempting to get metadata from the database to see if we can connect. 2022-07-30 02:59:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:40 INFO i.a.i.s.p.PostgresSource(lambda$getCheckOperations$3):236 - Attempting to find the named replication slot using the query: HikariProxyPreparedStatement@687501326 wrapping SELECT * FROM pg_replication_slots WHERE slot_name = 'airbyte_slot' AND plugin = 'pgoutput' AND database = 'd6g4nour99s742' 2022-07-30 02:59:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:40 INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):38 - Set initial fetch size: 10 rows 2022-07-30 02:59:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:40 INFO i.a.i.s.p.PostgresSource(lambda$getCheckOperations$5):253 - Attempting to find the publication using the query: HikariProxyPreparedStatement@292958927 wrapping SELECT * FROM pg_publication WHERE pubname = 'airbyte_publication' 2022-07-30 02:59:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:40 INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):38 - Set initial fetch size: 10 rows 2022-07-30 02:59:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:40 INFO c.z.h.HikariDataSource(close):350 - HikariPool-1 - Shutdown initiated... 2022-07-30 02:59:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:40 INFO c.z.h.HikariDataSource(close):352 - HikariPool-1 - Shutdown completed. 2022-07-30 02:59:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:40 INFO i.a.i.b.IntegrationRunner(runInternal):150 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2022-07-30 02:59:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:40 INFO i.a.i.b.a.AdaptiveSourceRunner$Runner(run):87 - Completed source: io.airbyte.integrations.base.ssh.SshWrappedSource 2022-07-30 02:59:40 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-07-30 02:59:40 INFO i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/54/1/logs.log 2022-07-30 02:59:40 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.39.39-alpha 2022-07-30 02:59:40 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:1.1.11 exists... 2022-07-30 02:59:40 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:1.1.11 was found locally. 2022-07-30 02:59:40 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 54 2022-07-30 02:59:40 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/54/1 --log-driver none --name destination-bigquery-check-54-1-mwzss --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.1.11 -e WORKER_JOB_ATTEMPT=1 -e AIRBYTE_VERSION=0.39.39-alpha -e WORKER_JOB_ID=54 airbyte/destination-bigquery:1.1.11 check --config source_config.json 2022-07-30 02:59:41 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Class path contains multiple SLF4J bindings. 2022-07-30 02:59:41 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-07-30 02:59:41 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-07-30 02:59:41 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-07-30 02:59:41 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-07-30 02:59:41 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-07-30 02:59:42 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:42 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2022-07-30 02:59:42 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:42 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-07-30 02:59:42 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:42 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK 2022-07-30 02:59:42 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:42 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-07-30 02:59:42 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:42 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:59:42 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:42 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:59:42 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:42 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:59:43 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:43 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:59:44 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:59:44 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-07-30 02:59:44 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-07-30 02:59:44 INFO i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/54/1/logs.log 2022-07-30 02:59:44 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.39.39-alpha 2022-07-30 02:59:44 INFO i.a.w.g.DefaultReplicationWorker(run):116 - start sync worker. job id: 54 attempt id: 1 2022-07-30 02:59:44 INFO i.a.w.g.DefaultReplicationWorker(run):128 - configured sync modes: {public.payer_buyer_locations=incremental - append_dedup, public.active_storage_attachments=incremental - append_dedup, public.product_canonical_categories=incremental - append_dedup, public.reports=incremental - append_dedup, public.oico_radars=incremental - append_dedup, public.schema_migrations=incremental - append_dedup, public.order_categories=incremental - append_dedup, public.spatial_ref_sys=incremental - append_dedup, public.store_orders=incremental - append_dedup, public.requested_products=incremental - append_dedup, public.categories=incremental - append_dedup, public.freight_routes=incremental - append_dedup, public.product_orders=incremental - append_dedup, public.oico_radar_products=incremental - append_dedup, public.term_acceptances=incremental - append_dedup, public.heya_campaign_receipts=incremental - append_dedup, public.sidekiq_sequence_records=incremental - append_dedup, public.order_issues=incremental - append_dedup, public.freight_product_orders=incremental - append_dedup, public.buyer_contact_rules=incremental - append_dedup, public.buyer_public_informations=incremental - append_dedup, public.active_storage_variant_records=incremental - append_dedup, public.buyers=incremental - append_dedup, public.ar_internal_metadata=incremental - append_dedup, public.freight_vehicle_types=incremental - append_dedup, public.location_store_products=incremental - append_dedup, public.omie_accounts=incremental - append_dedup, public.shortened_urls=incremental - append_dedup, public.stores=incremental - append_dedup, public.store_categories=incremental - append_dedup, public.faq_categories=incremental - append_dedup, public.payment_installments=incremental - append_dedup, public.buyer_store_recommendations=incremental - append_dedup, public.order_feedbacks=incremental - append_dedup, public.active_storage_blobs=incremental - append_dedup, public.freight_partner_vehicles=incremental - append_dedup, public.product_reports=incremental - append_dedup, public.store_order_quotes=incremental - append_dedup, public.payments=incremental - append_dedup, public.heya_campaign_memberships=incremental - append_dedup, public.buyer_locations=incremental - append_dedup, public.changebase_metadata=incremental - append_dedup, public.transfeera_batches=incremental - append_dedup, public.roi_products=incremental - append_dedup, public.flipper_features=incremental - append_dedup, public.flipper_gates=incremental - append_dedup, public.oico_users=incremental - append_dedup, public.payers=incremental - append_dedup, public.store_users=incremental - append_dedup, public.popular_searches=incremental - append_dedup, public.product_canonicals=incremental - append_dedup, public.faq=incremental - append_dedup, public.orders=incremental - append_dedup, public.products=incremental - append_dedup, public.buyer_uploads=incremental - append_dedup, public.freight_route_groupings=incremental - append_dedup, public.store_locations=incremental - append_dedup, public.terms=incremental - append_dedup, public.buyer_contacts=incremental - append_dedup, public.responsible_deliveries=incremental - append_dedup, public.freights=incremental - append_dedup, public.memento_sessions=incremental - append_dedup, public.memento_states=incremental - append_dedup, public.buyer_users=incremental - append_dedup, public.freight_route_partner_costs=incremental - append_dedup, public.freight_partners=incremental - append_dedup, public.stockout_events=incremental - append_dedup} 2022-07-30 02:59:44 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination... 2022-07-30 02:59:44 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:1.1.11 exists... 2022-07-30 02:59:45 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:1.1.11 was found locally. 2022-07-30 02:59:45 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 54 2022-07-30 02:59:45 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/54/1 --log-driver none --name destination-bigquery-write-54-1-fxfox --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.1.11 -e WORKER_JOB_ATTEMPT=1 -e AIRBYTE_VERSION=0.39.39-alpha -e WORKER_JOB_ID=54 airbyte/destination-bigquery:1.1.11 write --config destination_config.json --catalog destination_catalog.json 2022-07-30 02:59:45 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-postgres:0.4.37 exists... 2022-07-30 02:59:45 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-postgres:0.4.37 was found locally. 2022-07-30 02:59:45 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 54 2022-07-30 02:59:45 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/54/1 --log-driver none --name source-postgres-read-54-1-wrcqw --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_CONNECTOR_IMAGE=airbyte/source-postgres:0.4.37 -e WORKER_JOB_ATTEMPT=1 -e AIRBYTE_VERSION=0.39.39-alpha -e WORKER_JOB_ID=54 airbyte/source-postgres:0.4.37 read --config source_config.json --catalog source_catalog.json 2022-07-30 02:59:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):406 - Destination output thread started. 2022-07-30 02:59:45 INFO i.a.w.g.DefaultReplicationWorker(run):170 - Waiting for source and destination threads to complete. 2022-07-30 02:59:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):299 - Replication thread started. 2022-07-30 02:59:46 destination > SLF4J: Class path contains multiple SLF4J bindings. 2022-07-30 02:59:46 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-07-30 02:59:46 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-07-30 02:59:46 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-07-30 02:59:46 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-07-30 02:59:46 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-07-30 02:59:48 source > 2022-07-30 02:59:48 INFO i.a.i.b.a.AdaptiveSourceRunner$Runner(getSource):73 - Running source under deployment mode: OSS 2022-07-30 02:59:48 destination > 2022-07-30 02:59:48 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-07-30 02:59:48 destination > 2022-07-30 02:59:48 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-07-30 02:59:48 source > 2022-07-30 02:59:48 INFO i.a.i.b.a.AdaptiveSourceRunner$Runner(run):85 - Starting source: io.airbyte.integrations.base.ssh.SshWrappedSource 2022-07-30 02:59:48 destination > 2022-07-30 02:59:48 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: WRITE 2022-07-30 02:59:48 destination > 2022-07-30 02:59:48 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-07-30 02:59:48 source > 2022-07-30 02:59:48 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {read=null, catalog=source_catalog.json, config=source_config.json} 2022-07-30 02:59:48 source > 2022-07-30 02:59:48 INFO i.a.i.b.IntegrationRunner(runInternal):102 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2022-07-30 02:59:48 source > 2022-07-30 02:59:48 INFO i.a.i.b.IntegrationRunner(runInternal):103 - Command: READ 2022-07-30 02:59:48 source > 2022-07-30 02:59:48 INFO i.a.i.b.IntegrationRunner(runInternal):104 - Integration config: IntegrationConfig{command=READ, configPath='source_config.json', catalogPath='source_catalog.json', statePath='null'} 2022-07-30 02:59:48 destination > 2022-07-30 02:59:48 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:59:48 destination > 2022-07-30 02:59:48 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:59:48 destination > 2022-07-30 02:59:48 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:59:49 source > 2022-07-30 02:59:49 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:59:49 source > 2022-07-30 02:59:49 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:59:49 source > 2022-07-30 02:59:49 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:59:49 source > 2022-07-30 02:59:49 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:59:49 source > 2022-07-30 02:59:49 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword min - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:59:49 source > 2022-07-30 02:59:49 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword max - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:59:49 destination > 2022-07-30 02:59:49 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:59:49 destination > 2022-07-30 02:59:49 WARN i.a.i.d.b.BigQueryDestination(getConsumer):197 - The "standard" upload mode is not performant, and is not recommended for production. Please use the GCS upload mode if you are syncing a large amount of data. 2022-07-30 02:59:49 destination > 2022-07-30 02:59:49 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:59:49 source > 2022-07-30 02:59:49 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL 2022-07-30 02:59:49 source > 2022-07-30 02:59:49 INFO c.z.h.HikariDataSource():80 - HikariPool-1 - Starting... 2022-07-30 02:59:50 source > 2022-07-30 02:59:50 INFO c.z.h.HikariDataSource():82 - HikariPool-1 - Start completed. 2022-07-30 02:59:50 source > 2022-07-30 02:59:50 INFO i.a.i.s.p.PostgresUtils(isCdc):29 - using CDC: true 2022-07-30 02:59:50 source > 2022-07-30 02:59:50 INFO i.a.i.s.j.AbstractJdbcSource(lambda$getCheckOperations$1):95 - Attempting to get metadata from the database to see if we can connect. 2022-07-30 02:59:50 source > 2022-07-30 02:59:50 INFO i.a.i.s.p.PostgresSource(lambda$getCheckOperations$3):236 - Attempting to find the named replication slot using the query: HikariProxyPreparedStatement@2050275256 wrapping SELECT * FROM pg_replication_slots WHERE slot_name = 'airbyte_slot' AND plugin = 'pgoutput' AND database = 'd6g4nour99s742' 2022-07-30 02:59:50 source > 2022-07-30 02:59:50 INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):38 - Set initial fetch size: 10 rows 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(lambda$getCheckOperations$5):253 - Attempting to find the publication using the query: HikariProxyPreparedStatement@823758059 wrapping SELECT * FROM pg_publication WHERE pubname = 'airbyte_publication' 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):38 - Set initial fetch size: 10 rows 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO c.z.h.HikariDataSource(close):350 - HikariPool-1 - Shutdown initiated... 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO c.z.h.HikariDataSource(close):352 - HikariPool-1 - Shutdown completed. 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.StateManagerFactory(createStateManager):48 - Legacy state manager selected to manage state object with type LEGACY. 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='oico_users', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='reports', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='schema_migrations', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='order_issues', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='payments', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='active_storage_variant_records', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='shortened_urls', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='store_orders', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='heya_campaign_memberships', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='freight_vehicle_types', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='buyer_contacts', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='buyer_public_informations', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='sidekiq_sequence_records', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='freight_route_groupings', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='payment_installments', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='order_feedbacks', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='store_locations', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='product_orders', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='freight_partner_vehicles', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='freight_product_orders', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='location_store_products', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='orders', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='spatial_ref_sys', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='store_users', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='payer_buyer_locations', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='faq', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='freights', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='active_storage_attachments', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='ar_internal_metadata', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='flipper_gates', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='freight_partners', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='products', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='oico_radars', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='heya_campaign_receipts', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='categories', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='stores', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='buyer_locations', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='freight_routes', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='memento_sessions', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='memento_states', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='omie_accounts', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='product_canonical_categories', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='term_acceptances', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='requested_products', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='buyer_store_recommendations', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='buyers', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='roi_products', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='active_storage_blobs', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='order_categories', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='product_reports', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='stockout_events', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='buyer_uploads', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='buyer_users', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='faq_categories', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='flipper_features', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='transfeera_batches', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='oico_radar_products', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='terms', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='popular_searches', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='product_canonicals', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='changebase_metadata', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='payers', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='responsible_deliveries', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='store_categories', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='buyer_contact_rules', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='freight_route_partner_costs', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='store_order_quotes', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.r.CdcStateManager():29 - Initialized CDC state with: null 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO c.z.h.HikariDataSource():80 - HikariPool-2 - Starting... 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO c.z.h.HikariDataSource():82 - HikariPool-2 - Start completed. 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):207 - Checking schema: public 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(discoverInternal):123 - Internal schemas to exclude: [catalog_history, information_schema, pg_catalog, pg_internal] 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):38 - Set initial fetch size: 10 rows 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.d.j.s.TwoStageSizeEstimator(getTargetBufferByteSize):72 - Max memory limit: 6174015488, JDBC buffer size: 1073741824 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_reports column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_reports column product_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_reports column buyer_user_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_reports column type (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_reports column price_when_reported (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_reports column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_reports column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_reports column product_order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table memento_sessions column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table memento_sessions column user_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table memento_sessions column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table memento_sessions column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payer_buyer_locations column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payer_buyer_locations column buyer_location_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payer_buyer_locations column payer_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payer_buyer_locations column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payer_buyer_locations column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payer_buyer_locations column buyer_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column trading_name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column business_name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column cnpj (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column cpf (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column website (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column point_of_contact (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column email (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column whatsapp (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column payment_type (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column is_dedicated (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column daily_fee (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column active (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_blobs column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_blobs column key (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_blobs column filename (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_blobs column content_type (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_blobs column metadata (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_blobs column byte_size (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_blobs column checksum (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_blobs column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_blobs column service_name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table location_store_products column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table location_store_products column product_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table location_store_products column store_location_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table location_store_products column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table location_store_products column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table location_store_products column pipefy_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table location_store_products column pipefy_store_location_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table location_store_products column pipefy_product_store_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_users column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_users column email (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_users column encrypted_password (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_users column reset_password_token (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_users column reset_password_sent_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_users column remember_created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_users column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_users column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_users column active (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radar_products column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radar_products column oico_radar_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radar_products column product_canonical_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radar_products column price (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radar_products column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radar_products column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table categories column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table categories column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table categories column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table categories column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table categories column category_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table categories column level (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table categories column visible_on_store_sign_up (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column state_registration (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column municipal_registration (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column business_name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column trading_name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column cnpj (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column type_company (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column average_monthly_spend (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column truora_unfiltered_data (type jsonb[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column truora_current_irs_status (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column truora_legal_type (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column truora_started_on (type date[13]) -> JsonSchemaType({type=string, format=date}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column truora_address (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column truora_size (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column truora_business_name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column truora_trading_name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column truora_main_activities (type jsonb[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column truora_check_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column conta_azul (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column location_city (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column location_state (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column default_payer_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column financing_fee (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column spend_limit (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column wholesale (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column new_orders_blocked (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column max_term_days (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_vehicle_types column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_vehicle_types column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_vehicle_types column description (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_vehicle_types column capacity_in_kg (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_vehicle_types column max_height (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_vehicle_types column max_lenght (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_vehicle_types column max_width (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_vehicle_types column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_vehicle_types column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_product_orders column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_product_orders column product_order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_product_orders column freight_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_product_orders column quantity_in_freight (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_product_orders column internal_product_freight_note (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_product_orders column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_product_orders column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column id (type uuid[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column payer_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column store_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column freight_partner_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column type (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column status (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column tax_document_number (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column tax_document_link (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column purchase_order_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column purchase_order_link (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column payment_value (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column paid_value (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column tax_note_issued_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column xml_link (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column discount (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column extra_fees (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column omie_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column canceled_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column created_by (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column postmark_message_id (type uuid[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column postmark_read_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 destination > 2022-07-30 02:59:51 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_wlx_active_storage_attachments}} 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column omie_account_id (type uuid[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table flipper_gates column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table flipper_gates column feature_key (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table flipper_gates column key (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table flipper_gates column value (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table flipper_gates column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table flipper_gates column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geography_columns column f_table_catalog (type name[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geography_columns column f_table_schema (type name[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geography_columns column f_table_name (type name[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geography_columns column f_geography_column (type name[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geography_columns column coord_dimension (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geography_columns column srid (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geography_columns column type (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column external_identify (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column description (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column details (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column product_canonical_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column price (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column oico_markup_wholesale (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column store_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column pipefy_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column pipefy_store_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column type_quantity (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column conta_azul (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column problem_reported (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column height_per_unit (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column lenght_per_unit (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column width_per_unit (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column weight_per_unit (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column canonical_associated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column trusted (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column minimum_quantity (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column ncm (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column omie_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column available_to_stores (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column oico_markup_retail (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column available (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column on_offer (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column inserted_by (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column changed_by (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column location (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column buyer_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column street (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column address_details (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column zipcode (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column city (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column state (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column lat (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column lng (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column google_place_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table sidekiq_sequence_records column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table sidekiq_sequence_records column data (type jsonb[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table sidekiq_sequence_records column current_step (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table sidekiq_sequence_records column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table sidekiq_sequence_records column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_order_quotes column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_order_quotes column store_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_order_quotes column order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_order_quotes column product_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_order_quotes column quote_link (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_order_quotes column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_order_quotes column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_order_quotes column sent_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table popular_searches column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table popular_searches column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table popular_searches column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table popular_searches column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table faq_categories column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table faq_categories column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table faq_categories column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table faq_categories column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_uploads column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_uploads column buyer_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_uploads column buyer_user_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_uploads column file_type (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_uploads column file_url (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_uploads column done (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_uploads column filename (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_attachments column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_attachments column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_attachments column record_type (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_attachments column record_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_attachments column blob_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_attachments column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_variant_records column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_variant_records column blob_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_variant_records column variation_digest (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column state_registration (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column municipal_registration (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column business_name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column trading_name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column cnpj (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column bank_code (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column bank_branch (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column bank_account (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column payment_type (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column priority (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column website (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column sales_point_of_contact (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column sales_email (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column sales_whatsapp (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column block (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column pix_key (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column minimum_response_time (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column bank_account_check_digit (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column manufacturer (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column omie_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column cnae (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column bank_account_holder_name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column bank_account_holder_document (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column activity (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column national_simple (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column payment_recommendations (type jsonb[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column oico_partner (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column store_type (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_orders column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_orders column order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_orders column store_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_orders column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_orders column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_orders column campaign_last_sent_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_public_informations column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_public_informations column type (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_public_informations column response (type jsonb[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_public_informations column buyer_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_public_informations column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_public_informations column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_public_informations column score (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_public_informations column recommended_term_limit (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_public_informations column recommended_spend_limit (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contact_rules column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contact_rules column buyer_contact_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contact_rules column buyer_location_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contact_rules column order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contact_rules column categories (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contact_rules column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contact_rules column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_partner_costs column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_partner_costs column is_dedicated (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_partner_costs column delivery_work_start_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_partner_costs column delivery_work_end_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_partner_costs column cost (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_partner_costs column extra_cost (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_partner_costs column total_cost (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_partner_costs column extra_cost_details (type jsonb[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_partner_costs column freight_partner_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_partner_costs column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_partner_costs column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table transfeera_batches column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table transfeera_batches column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table transfeera_batches column transfeera_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table transfeera_batches column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table transfeera_batches column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column original_description (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column description (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column comment (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column quantity (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column product_order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column product_canonical_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column deleted_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column done_by_client (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column unavailable (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column user_preference (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column buyer_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column whatsapp (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column spend_limit (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column active (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column email (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column encrypted_password (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column reset_password_token (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column reset_password_sent_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column remember_created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column referral_code (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column profile (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column own_referral_code (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column confirmation_token (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column confirmed_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column confirmation_sent_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column unconfirmed_email (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column stytch_user_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column sign_in_count (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column current_sign_in_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column last_sign_in_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column current_sign_in_ip (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column last_sign_in_ip (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column userid (type oid[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column dbid (type oid[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column queryid (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column query (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column plans (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column total_plan_time (type float8[17]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column min_plan_time (type float8[17]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column max_plan_time (type float8[17]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column mean_plan_time (type float8[17]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column stddev_plan_time (type float8[17]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column calls (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column total_exec_time (type float8[17]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column min_exec_time (type float8[17]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column max_exec_time (type float8[17]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column mean_exec_time (type float8[17]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column stddev_exec_time (type float8[17]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column rows (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column shared_blks_hit (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column shared_blks_read (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column shared_blks_dirtied (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column shared_blks_written (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column local_blks_hit (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column local_blks_read (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column local_blks_dirtied (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column local_blks_written (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column temp_blks_read (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column temp_blks_written (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column blk_read_time (type float8[17]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column blk_write_time (type float8[17]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column wal_records (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column wal_fpi (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column wal_bytes (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_memberships column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_memberships column user_type (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_memberships column user_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_memberships column campaign_gid (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_memberships column step_gid (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_memberships column concurrent (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_memberships column last_sent_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_memberships column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_memberships column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table terms column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table terms column link (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table terms column type (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table terms column version (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table terms column mandatory (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table terms column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table terms column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column id (type uuid[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column payment_id (type uuid[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column status (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column installment_value (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column installment_number (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column due_date (type date[13]) -> JsonSchemaType({type=string, format=date}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column paid_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column canceled_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column advance_payment (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column type (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column external_identify (type varchar[512]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column link (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column metadata (type jsonb[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column transfeera_batch_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column receipt_url (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column bank_receipt_url (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column paid_value (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column original_due_date (type date[13]) -> JsonSchemaType({type=string, format=date}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table changebase_metadata column version (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table changebase_metadata column data (type jsonb[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table faq column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table faq column faq_category_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table faq column title (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table faq column description (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table faq column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table faq column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column cnpj (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column cpf (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column billing_address (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column phone_number (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column email (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column payment_terms_days (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column credit_limit (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column payer_confirmed (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column payer_confirmed_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column conta_azul (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column internal_notes (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column omie_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column cnae (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column activity (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column national_simple (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column bank_code (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column bank_branch (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column bank_account (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column bank_account_check_digit (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column bank_account_holder_name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column bank_account_holder_document (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column billing_address_state (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column billing_address_city (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column billing_address_street (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column billing_address_district (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column billing_address_zipcode (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column state_registration (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column tax_mode_simples (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column final_consumer (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table spatial_ref_sys column srid (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table spatial_ref_sys column auth_name (type varchar[256]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table spatial_ref_sys column auth_srid (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table spatial_ref_sys column srtext (type varchar[2048]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table spatial_ref_sys column proj4text (type varchar[2048]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table shortened_urls column id (type serial[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table shortened_urls column owner_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table shortened_urls column owner_type (type varchar[20]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table shortened_urls column url (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table shortened_urls column unique_key (type varchar[10]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table shortened_urls column category (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table shortened_urls column use_count (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table shortened_urls column expires_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table shortened_urls column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table shortened_urls column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_store_recommendations column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_store_recommendations column buyer_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_store_recommendations column buyer_user_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_store_recommendations column store_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_store_recommendations column store_name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_store_recommendations column contact_name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_store_recommendations column store_email (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_store_recommendations column store_phone (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_store_recommendations column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_store_recommendations column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table term_acceptances column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table term_acceptances column term_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table term_acceptances column buyer_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table term_acceptances column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table term_acceptances column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table term_acceptances column store_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table term_acceptances column ip_address (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_receipts column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_receipts column user_type (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_receipts column user_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_receipts column step_gid (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_receipts column sent_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_receipts column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_receipts column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table ar_internal_metadata column key (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table ar_internal_metadata column value (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table ar_internal_metadata column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table ar_internal_metadata column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contacts column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contacts column buyer_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contacts column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contacts column email (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contacts column phone_number (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contacts column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contacts column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column store_location_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column buyer_location_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column freight_scheduled_pickup_time (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column freight_actual_pickup_time (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column client_delivery_notes (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column internal_delivery_notes (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column freight_weight (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column reverse_freight (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column target_delivery_datetime (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column actual_delivery_datetime (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column estimated_arrival_delivery_datetime (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column delivered (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column received_by (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column store_quote_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column notified_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column arrived_at_pick_up_location_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column picked_up_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column arrived_at_drop_off_location_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column distance (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonical_categories column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonical_categories column product_canonical_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonical_categories column category_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonical_categories column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonical_categories column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column store_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column location (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column street (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column address_details (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column zipcode (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column city (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column state (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column pipefy_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column lat (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column lng (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column google_place_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table reports column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table reports column buyer_user_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table reports column sended (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table reports column message (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table reports column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table reports column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table roi_products column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table roi_products column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table roi_products column price (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column pipefy_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column freight_price (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column freight_partner_external_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column freight_scheduled_delivery_datetime (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column freight_actual_delivery_datetime (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column freight_tracking_link (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column freight_delivery_point_of_contact (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column freight_delivery_poc_phone (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column client_delivery_notes (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column product_problems (type jsonb[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column delivery_problems (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column shareable_link_hash (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column freight_partner_vehicle_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column sequence (type jsonb[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column freight_partner_dedicated_when_associated (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column total_distance (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column freight_route_partner_cost_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stockout_events column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stockout_events column order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stockout_events column product_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stockout_events column price_when_deleted (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stockout_events column created_by (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stockout_events column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stockout_events column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_groupings column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_groupings column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_groupings column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_groupings column freight_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_groupings column freight_route_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_groupings column delivery_note_link (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_categories column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_categories column store_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_categories column category_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_categories column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_categories column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geometry_columns column f_table_catalog (type varchar[256]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geometry_columns column f_table_schema (type name[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geometry_columns column f_table_name (type name[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geometry_columns column f_geometry_column (type name[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geometry_columns column coord_dimension (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geometry_columns column srid (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geometry_columns column type (type varchar[30]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_feedbacks column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_feedbacks column order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_feedbacks column type (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_feedbacks column liked (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_feedbacks column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_feedbacks column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table omie_accounts column id (type uuid[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table omie_accounts column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table omie_accounts column document (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table omie_accounts column credential (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table omie_accounts column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table omie_accounts column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_issues column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_issues column order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_issues column buyer_user_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_issues column type (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_issues column delivery_problems (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_issues column product_problems (type jsonb[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_issues column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_issues column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_issues column description (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_issues column status (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_issues column confirmed_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_issues column canceled_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table responsible_deliveries column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table responsible_deliveries column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table responsible_deliveries column phone_number (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table responsible_deliveries column email (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table responsible_deliveries column buyer_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table responsible_deliveries column buyer_location_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table responsible_deliveries column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table responsible_deliveries column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table flipper_features column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table flipper_features column key (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table flipper_features column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table flipper_features column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column buyer_user_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column buyer_location_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column expected_date (type date[13]) -> JsonSchemaType({type=string, format=date}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column oico_invoice (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column shopping_list_url (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column status (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column identify (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column freight_code (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column freight_link (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column buyer_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column value (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column freight_value (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column final_value (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column client_order_form (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column pipefy_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column expected_time (type time[15]) -> JsonSchemaType({type=string, format=time, airbyte_type=time_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column fast_delivery (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column approved_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column conta_azul (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column order_form (type jsonb[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column expected_period (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column flexible_delivery (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column payer_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column last_quote (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column cancelation_reason (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column cancelation_comment (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column shareable_link_hash (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column internal_notes (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column discount (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column first_quote_sent_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column client_internal_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column client_notes (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column canceled_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column comment (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column po_file_url (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column money_saving (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column quote (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column quote_estimate (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column automatic_quote (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column parent_order_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column internal_delivery_notes (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column type (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column origin (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column events (type jsonb[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column expected_billing_due_date (type date[13]) -> JsonSchemaType({type=string, format=date}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column financing_value (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column po_value (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column more_payment_terms (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column quote_expires_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column user_preference (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column payment_method (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column last_rdo_scheduling_message_sent_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radars column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radars column buyer_user_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radars column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radars column document (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radars column phone_number (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radars column email (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radars column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radars column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radars column notify_terms (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radars column shareable_link_hash (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column email (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column encrypted_password (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column reset_password_token (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column reset_password_sent_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column remember_created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column store_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column name (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column phone_number (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column active (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column sign_in_count (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column current_sign_in_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column last_sign_in_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column current_sign_in_ip (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column last_sign_in_ip (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_categories column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_categories column order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_categories column category_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_categories column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_categories column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table memento_states column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table memento_states column action_type (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table memento_states column record_data (type bytea[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table memento_states column record_type (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table memento_states column record_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table memento_states column session_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table memento_states column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table memento_states column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table schema_migrations column version (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partner_vehicles column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partner_vehicles column freight_vehicle_type_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partner_vehicles column freight_partner_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partner_vehicles column plate (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partner_vehicles column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partner_vehicles column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partner_vehicles column start_location (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partner_vehicles column start_lat (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partner_vehicles column start_lng (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column code (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column image (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column ean (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column gtin (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column height_per_unit (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column lenght_per_unit (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column width_per_unit (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column weight_per_unit (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column brand (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column reference_price (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column created_by (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column product_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column quantity (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column product_price_when_associated (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column location_store_product_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column pipefy_product_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column pipefy_order_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column pipefy_location_store_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column type_quantity (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column custom_product (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column product_cost_when_associated (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column trusted_when_associated (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column returned_to (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column under_review (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column oversized (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column dispatched (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column store_location_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column store_quote_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column fits_in_motorcycle (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column quote_link (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column low_stock (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column canceled_by_store (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column confirmed_by (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column store_cancelation_reason (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.product_reports 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.memento_sessions 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.payer_buyer_locations 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.freight_partners 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.active_storage_blobs 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.location_store_products 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.oico_users 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.oico_radar_products 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.categories 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.buyers 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.freight_vehicle_types 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.freight_product_orders 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.payments 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.flipper_gates 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.geography_columns 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.products 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.buyer_locations 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.sidekiq_sequence_records 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.store_order_quotes 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.popular_searches 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.faq_categories 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.buyer_uploads 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.active_storage_attachments 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.active_storage_variant_records 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.stores 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.store_orders 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.buyer_public_informations 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.buyer_contact_rules 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.freight_route_partner_costs 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.transfeera_batches 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.requested_products 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.buyer_users 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.pg_stat_statements 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.heya_campaign_memberships 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.terms 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.payment_installments 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.changebase_metadata 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.faq 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.payers 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.spatial_ref_sys 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.shortened_urls 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.buyer_store_recommendations 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.term_acceptances 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.heya_campaign_receipts 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.ar_internal_metadata 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.buyer_contacts 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.freights 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.product_canonical_categories 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.store_locations 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.reports 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.roi_products 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.freight_routes 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.stockout_events 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.freight_route_groupings 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.store_categories 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.geometry_columns 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.order_feedbacks 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.omie_accounts 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.order_issues 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.responsible_deliveries 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.flipper_features 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.orders 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.oico_radars 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.store_users 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.order_categories 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.memento_states 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.schema_migrations 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.freight_partner_vehicles 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.product_canonicals 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.product_orders 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.i.s.p.PostgresUtils(isCdc):29 - using CDC: true 2022-07-30 02:59:51 source > 2022-07-30 02:59:51 INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):38 - Set initial fetch size: 10 rows 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.a.d.j.s.TwoStageSizeEstimator(getTargetBufferByteSize):72 - Max memory limit: 6174015488, JDBC buffer size: 1073741824 2022-07-30 02:59:52 destination > 2022-07-30 02:59:52 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.a.i.s.p.PostgresCdcCatalogHelper(getPublicizedTables):92 - For CDC, only tables in publication airbyte_publication will be included in the sync: [public.oico_users, public.reports, public.schema_migrations, public.order_issues, public.payments, public.active_storage_variant_records, public.shortened_urls, public.store_orders, public.heya_campaign_memberships, public.freight_vehicle_types, public.buyer_contacts, public.buyer_public_informations, public.sidekiq_sequence_records, public.payment_installments, public.freight_route_groupings, public.order_feedbacks, public.store_locations, public.product_orders, public.freight_product_orders, public.freight_partner_vehicles, public.location_store_products, public.orders, public.spatial_ref_sys, public.store_users, public.payer_buyer_locations, public.faq, public.freights, public.active_storage_attachments, public.ar_internal_metadata, public.flipper_gates, public.freight_partners, public.products, public.oico_radars, public.heya_campaign_receipts, public.categories, public.stores, public.buyer_locations, public.freight_routes, public.memento_states, public.omie_accounts, public.memento_sessions, public.product_canonical_categories, public.term_acceptances, public.requested_products, public.buyer_store_recommendations, public.roi_products, public.buyers, public.order_categories, public.active_storage_blobs, public.product_reports, public.stockout_events, public.buyer_uploads, public.faq_categories, public.buyer_users, public.flipper_features, public.transfeera_batches, public.oico_radar_products, public.terms, public.popular_searches, public.product_canonicals, public.changebase_metadata, public.payers, public.store_categories, public.responsible_deliveries, public.buyer_contact_rules, public.freight_route_partner_costs, public.store_order_quotes] 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.a.i.s.p.PostgresUtils(isCdc):29 - using CDC: true 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.a.i.s.p.PostgresSource(getIncrementalIterators):294 - First record waiting time: 300 seconds 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.a.i.s.p.PostgresCdcTargetPosition(targetPosition):45 - identified target lsn: PgLsn{lsn=175691006168} 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.a.i.d.AirbyteDebeziumHandler(getIncrementalIterators):103 - Using CDC: true 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO o.a.k.c.c.AbstractConfig(logAll):376 - EmbeddedConfig values: 2022-07-30 02:59:52 source > access.control.allow.methods = 2022-07-30 02:59:52 source > access.control.allow.origin = 2022-07-30 02:59:52 source > admin.listeners = null 2022-07-30 02:59:52 source > bootstrap.servers = [localhost:9092] 2022-07-30 02:59:52 source > client.dns.lookup = use_all_dns_ips 2022-07-30 02:59:52 source > config.providers = [] 2022-07-30 02:59:52 source > connector.client.config.override.policy = All 2022-07-30 02:59:52 source > header.converter = class org.apache.kafka.connect.storage.SimpleHeaderConverter 2022-07-30 02:59:52 source > key.converter = class org.apache.kafka.connect.json.JsonConverter 2022-07-30 02:59:52 source > listeners = [http://:8083] 2022-07-30 02:59:52 source > metric.reporters = [] 2022-07-30 02:59:52 source > metrics.num.samples = 2 2022-07-30 02:59:52 source > metrics.recording.level = INFO 2022-07-30 02:59:52 source > metrics.sample.window.ms = 30000 2022-07-30 02:59:52 source > offset.flush.interval.ms = 1000 2022-07-30 02:59:52 source > offset.flush.timeout.ms = 5000 2022-07-30 02:59:52 source > offset.storage.file.filename = /tmp/cdc-state-offset16493177829836333350/offset.dat 2022-07-30 02:59:52 source > offset.storage.partitions = null 2022-07-30 02:59:52 source > offset.storage.replication.factor = null 2022-07-30 02:59:52 source > offset.storage.topic = 2022-07-30 02:59:52 source > plugin.path = null 2022-07-30 02:59:52 source > response.http.headers.config = 2022-07-30 02:59:52 source > rest.advertised.host.name = null 2022-07-30 02:59:52 source > rest.advertised.listener = null 2022-07-30 02:59:52 source > rest.advertised.port = null 2022-07-30 02:59:52 source > rest.extension.classes = [] 2022-07-30 02:59:52 source > ssl.cipher.suites = null 2022-07-30 02:59:52 source > ssl.client.auth = none 2022-07-30 02:59:52 source > ssl.enabled.protocols = [TLSv1.2, TLSv1.3] 2022-07-30 02:59:52 source > ssl.endpoint.identification.algorithm = https 2022-07-30 02:59:52 source > ssl.engine.factory.class = null 2022-07-30 02:59:52 source > ssl.key.password = null 2022-07-30 02:59:52 source > ssl.keymanager.algorithm = SunX509 2022-07-30 02:59:52 source > ssl.keystore.certificate.chain = null 2022-07-30 02:59:52 source > ssl.keystore.key = null 2022-07-30 02:59:52 source > ssl.keystore.location = null 2022-07-30 02:59:52 source > ssl.keystore.password = null 2022-07-30 02:59:52 source > ssl.keystore.type = JKS 2022-07-30 02:59:52 source > ssl.protocol = TLSv1.3 2022-07-30 02:59:52 source > ssl.provider = null 2022-07-30 02:59:52 source > ssl.secure.random.implementation = null 2022-07-30 02:59:52 source > ssl.trustmanager.algorithm = PKIX 2022-07-30 02:59:52 source > ssl.truststore.certificates = null 2022-07-30 02:59:52 source > ssl.truststore.location = null 2022-07-30 02:59:52 source > ssl.truststore.password = null 2022-07-30 02:59:52 source > ssl.truststore.type = JKS 2022-07-30 02:59:52 source > task.shutdown.graceful.timeout.ms = 5000 2022-07-30 02:59:52 source > topic.creation.enable = true 2022-07-30 02:59:52 source > topic.tracking.allow.reset = true 2022-07-30 02:59:52 source > topic.tracking.enable = true 2022-07-30 02:59:52 source > value.converter = class org.apache.kafka.connect.json.JsonConverter 2022-07-30 02:59:52 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $: unknown found, object expected 2022-07-30 02:59:52 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 WARN o.a.k.c.r.WorkerConfig(logInternalConverterRemovalWarnings):316 - The worker has been configured with one or more internal converter properties ([internal.key.converter, internal.value.converter]). Support for these properties was deprecated in version 2.0 and removed in version 3.0, and specifying them will have no effect. Instead, an instance of the JsonConverter with schemas.enable set to false will be used. For more information, please visit http://kafka.apache.org/documentation/#upgrade and consult the upgrade notesfor the 3.0 release. 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 WARN o.a.k.c.r.WorkerConfig(logPluginPathConfigProviderWarning):334 - Variables cannot be used in the 'plugin.path' property, since the property is used by plugin scanning before the config providers that replace the variables are initialized. The raw value 'null' was used for plugin scanning, as opposed to the transformed value 'null', and this may cause unexpected results. 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 WARN i.d.c.p.PostgresConnectorConfig(validateSkippedOperations):1371 - Configuration property 'truncate.handling.mode' is deprecated and will be removed soon. If you wish to retain skipped truncate functionality, please configure 'skipped.operations' with "t". 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 WARN i.d.c.p.PostgresConnectorConfig(validateTruncateHandlingMode):1333 - Configuration property 'truncate.handling.mode' is deprecated and will be removed in future versions. Please use 'skipped.operations' instead. 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 WARN i.d.c.p.PostgresConnectorConfig(validateToastedValuePlaceholder):1384 - Configuration property 'toasted.value.placeholder' is deprecated and will be removed in future versions. Please use 'unavailable.value.placeholder' instead. 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(start):124 - Starting PostgresConnectorTask with configuration: 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - connector.class = io.debezium.connector.postgresql.PostgresConnector 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - max.queue.size = 8192 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - slot.name = airbyte_slot 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - publication.name = airbyte_publication 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - offset.storage.file.filename = /tmp/cdc-state-offset16493177829836333350/offset.dat 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - decimal.handling.mode = string 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - converters = datetime 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - datetime.type = io.airbyte.integrations.debezium.internals.PostgresConverter 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - value.converter = org.apache.kafka.connect.json.JsonConverter 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - key.converter = org.apache.kafka.connect.json.JsonConverter 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - publication.autocreate.mode = disabled 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - database.user = airbyte 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - database.dbname = d6g4nour99s742 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - offset.storage = org.apache.kafka.connect.storage.FileOffsetBackingStore 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - database.server.name = d6g4nour99s742 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - offset.flush.timeout.ms = 5000 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - plugin.name = pgoutput 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - database.port = 5432 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - offset.flush.interval.ms = 1000 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - key.converter.schemas.enable = false 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - internal.key.converter = org.apache.kafka.connect.json.JsonConverter 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - database.hostname = db-oico-production.c2sxgpzdvndu.us-east-1.rds.amazonaws.com 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - database.password = ******** 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - name = d6g4nour99s742 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - value.converter.schemas.enable = false 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - internal.value.converter = org.apache.kafka.connect.json.JsonConverter 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - max.batch.size = 2048 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - table.include.list = public.active_storage_attachments,public.active_storage_blobs,public.active_storage_variant_records,public.ar_internal_metadata,public.buyer_contact_rules,public.buyer_contacts,public.buyer_locations,public.buyer_public_informations,public.buyer_store_recommendations,public.buyer_uploads,public.buyer_users,public.buyers,public.categories,public.changebase_metadata,public.faq,public.faq_categories,public.flipper_features,public.flipper_gates,public.freight_partner_vehicles,public.freight_partners,public.freight_product_orders,public.freight_route_groupings,public.freight_route_partner_costs,public.freight_routes,public.freight_vehicle_types,public.freights,public.heya_campaign_memberships,public.heya_campaign_receipts,public.location_store_products,public.memento_sessions,public.memento_states,public.oico_radar_products,public.oico_radars,public.oico_users,public.omie_accounts,public.order_categories,public.order_feedbacks,public.order_issues,public.orders,public.payer_buyer_locations,public.payers,public.payment_installments,public.payments,public.popular_searches,public.product_canonical_categories,public.product_canonicals,public.product_orders,public.product_reports,public.products,public.reports,public.requested_products,public.responsible_deliveries,public.roi_products,public.schema_migrations,public.shortened_urls,public.sidekiq_sequence_records,public.spatial_ref_sys,public.stockout_events,public.store_categories,public.store_locations,public.store_order_quotes,public.store_orders,public.store_users,public.stores,public.term_acceptances,public.terms,public.transfeera_batches 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - snapshot.mode = initial 2022-07-30 02:59:52 destination > 2022-07-30 02:59:52 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_obm_active_storage_blobs}} 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.c.BaseSourceTask(getPreviousOffsets):318 - No previous offsets found 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.p.PostgresConnectorTask(start):108 - user 'airbyte' connected to database 'd6g4nour99s742' on PostgreSQL 13.4 on x86_64-pc-linux-gnu, compiled by gcc (GCC) 7.3.1 20180712 (Red Hat 7.3.1-12), 64-bit with roles: 2022-07-30 02:59:52 source > role 'rds_replication' [superuser: false, replication: false, inherit: true, create role: false, create db: false, can log in: false] 2022-07-30 02:59:52 source > role 'airbyte' [superuser: false, replication: false, inherit: true, create role: false, create db: false, can log in: true] 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.p.c.PostgresConnection(readReplicationSlotInfo):251 - Obtained valid replication slot ReplicationSlot [active=false, latestFlushedLsn=LSN{28/D00CC220}, catalogXmin=70647] 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.p.PostgresConnectorTask(start):117 - No previous offset found 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.p.s.InitialSnapshotter(shouldSnapshot):34 - Taking initial snapshot for new datasource 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.u.Threads(threadFactory):270 - Requested thread factory for connector PostgresConnector, id = d6g4nour99s742 named = change-event-source-coordinator 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.u.Threads$3(newThread):287 - Creating thread debezium-postgresconnector-d6g4nour99s742-change-event-source-coordinator 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.p.ChangeEventSourceCoordinator(lambda$start$0):103 - Metrics registered 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.p.ChangeEventSourceCoordinator(lambda$start$0):106 - Context created 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.p.s.InitialSnapshotter(shouldSnapshot):34 - Taking initial snapshot for new datasource 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.c.p.PostgresSnapshotChangeEventSource(getSnapshottingTask):64 - According to the connector configuration data will be snapshotted 2022-07-30 02:59:52 source > 2022-07-30 02:59:52 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):87 - Snapshot step 1 - Preparing 2022-07-30 02:59:52 destination > 2022-07-30 02:59:52 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'CURRENT_TIMESTAMP' to type 'timestamp'. Expression evaluation is not supported. 2022-07-30 02:59:53 destination > 2022-07-30 02:59:53 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_zjl_active_storage_variant_records}} 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):96 - Snapshot step 2 - Determining captured tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.payer_buyer_locations to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.active_storage_attachments to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.product_canonical_categories to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.reports to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.oico_radars to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.schema_migrations to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.order_categories to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.store_orders to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.requested_products to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.categories to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.freight_routes to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.product_orders to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.oico_radar_products to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.term_acceptances to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.heya_campaign_receipts to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.sidekiq_sequence_records to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.order_issues to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.freight_product_orders to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.buyer_contact_rules to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.buyer_public_informations to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.active_storage_variant_records to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.buyers to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.ar_internal_metadata to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.freight_vehicle_types to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.location_store_products to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.omie_accounts to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.shortened_urls to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.stores to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.store_categories to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.faq_categories to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.payment_installments to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.buyer_store_recommendations to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.order_feedbacks to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.active_storage_blobs to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.freight_partner_vehicles to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.product_reports to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.store_order_quotes to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.payments to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.heya_campaign_memberships to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.buyer_locations to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.changebase_metadata to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.transfeera_batches to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.roi_products to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.flipper_features to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.flipper_gates to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.oico_users to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.payers to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.store_users to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.popular_searches to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.product_canonicals to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.faq to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.orders to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.products to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.buyer_uploads to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.freight_route_groupings to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.store_locations to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.terms to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.buyer_contacts to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.responsible_deliveries to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.freights to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.memento_sessions to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.memento_states to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.buyer_users to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.freight_route_partner_costs to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.freight_partners to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.stockout_events to the list of capture schema tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):103 - Snapshot step 3 - Locking captured tables [public.active_storage_attachments, public.active_storage_blobs, public.active_storage_variant_records, public.ar_internal_metadata, public.buyer_contact_rules, public.buyer_contacts, public.buyer_locations, public.buyer_public_informations, public.buyer_store_recommendations, public.buyer_uploads, public.buyer_users, public.buyers, public.categories, public.changebase_metadata, public.faq, public.faq_categories, public.flipper_features, public.flipper_gates, public.freight_partner_vehicles, public.freight_partners, public.freight_product_orders, public.freight_route_groupings, public.freight_route_partner_costs, public.freight_routes, public.freight_vehicle_types, public.freights, public.heya_campaign_memberships, public.heya_campaign_receipts, public.location_store_products, public.memento_sessions, public.memento_states, public.oico_radar_products, public.oico_radars, public.oico_users, public.omie_accounts, public.order_categories, public.order_feedbacks, public.order_issues, public.orders, public.payer_buyer_locations, public.payers, public.payment_installments, public.payments, public.popular_searches, public.product_canonical_categories, public.product_canonicals, public.product_orders, public.product_reports, public.products, public.reports, public.requested_products, public.responsible_deliveries, public.roi_products, public.schema_migrations, public.shortened_urls, public.sidekiq_sequence_records, public.stockout_events, public.store_categories, public.store_locations, public.store_order_quotes, public.store_orders, public.store_users, public.stores, public.term_acceptances, public.terms, public.transfeera_batches] 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):109 - Snapshot step 4 - Determining snapshot offset 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.c.p.PostgresOffsetContext(initialContext):231 - Creating initial offset context 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.c.p.PostgresOffsetContext(initialContext):234 - Read xlogStart at 'LSN{28/E8000110}' from transaction '70673' 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.c.p.PostgresSnapshotChangeEventSource(updateOffsetForSnapshot):146 - Read xlogStart at 'LSN{28/E8000110}' from transaction '70673' 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):112 - Snapshot step 5 - Reading structure of captured tables 2022-07-30 02:59:53 source > 2022-07-30 02:59:53 INFO i.d.c.p.PostgresSnapshotChangeEventSource(readTableStructure):192 - Reading structure of schema 'public' of catalog 'd6g4nour99s742' 2022-07-30 02:59:53 destination > 2022-07-30 02:59:53 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:59:54 source > 2022-07-30 02:59:54 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:59:54 source > 2022-07-30 02:59:54 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:59:54 destination > 2022-07-30 02:59:54 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_uwf_ar_internal_metadata}} 2022-07-30 02:59:54 source > 2022-07-30 02:59:54 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:59:54 source > 2022-07-30 02:59:54 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:59:54 source > 2022-07-30 02:59:54 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:59:54 source > 2022-07-30 02:59:54 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:59:54 source > 2022-07-30 02:59:54 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'CURRENT_TIMESTAMP' to type 'timestamp'. Expression evaluation is not supported. 2022-07-30 02:59:54 source > 2022-07-30 02:59:54 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):116 - Snapshot step 6 - Persisting schema history 2022-07-30 02:59:54 source > 2022-07-30 02:59:54 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):128 - Snapshot step 7 - Snapshotting data 2022-07-30 02:59:54 source > 2022-07-30 02:59:54 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEvents):302 - Snapshotting contents of 66 tables while still in transaction 2022-07-30 02:59:54 source > 2022-07-30 02:59:54 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.active_storage_attachments' (1 of 66 tables) 2022-07-30 02:59:54 source > 2022-07-30 02:59:54 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.active_storage_attachments' using select statement: 'SELECT "id", "name", "record_type", "record_id", "blob_id", "created_at" FROM "public"."active_storage_attachments"' 2022-07-30 02:59:54 destination > 2022-07-30 02:59:54 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:59:54 destination > 2022-07-30 02:59:54 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_tcf_buyer_contact_rules}} 2022-07-30 02:59:55 destination > 2022-07-30 02:59:55 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:59:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 1000 (232 KB) 2022-07-30 02:59:55 destination > 2022-07-30 02:59:55 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_nup_buyer_contacts}} 2022-07-30 02:59:55 destination > 2022-07-30 02:59:55 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:59:56 destination > 2022-07-30 02:59:56 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_nzu_buyer_locations}} 2022-07-30 02:59:56 destination > 2022-07-30 02:59:56 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:59:57 destination > 2022-07-30 02:59:57 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_lvg_buyer_public_informations}} 2022-07-30 02:59:57 destination > 2022-07-30 02:59:57 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:59:57 destination > 2022-07-30 02:59:57 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_gjs_buyer_store_recommendations}} 2022-07-30 02:59:58 destination > 2022-07-30 02:59:58 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:59:58 destination > 2022-07-30 02:59:58 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_joo_buyer_uploads}} 2022-07-30 02:59:59 destination > 2022-07-30 02:59:59 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:59:59 destination > 2022-07-30 02:59:59 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_jnq_buyer_users}} 2022-07-30 02:59:59 destination > 2022-07-30 02:59:59 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:00 destination > 2022-07-30 03:00:00 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_fyh_buyers}} 2022-07-30 03:00:00 destination > 2022-07-30 03:00:00 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:01 destination > 2022-07-30 03:00:01 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_jbn_categories}} 2022-07-30 03:00:01 destination > 2022-07-30 03:00:01 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:02 destination > 2022-07-30 03:00:02 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_gea_changebase_metadata}} 2022-07-30 03:00:02 destination > 2022-07-30 03:00:02 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:02 destination > 2022-07-30 03:00:02 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_wbk_faq}} 2022-07-30 03:00:03 destination > 2022-07-30 03:00:03 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:03 destination > 2022-07-30 03:00:03 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_wpp_faq_categories}} 2022-07-30 03:00:04 destination > 2022-07-30 03:00:04 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:04 destination > 2022-07-30 03:00:04 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_jhd_flipper_features}} 2022-07-30 03:00:04 destination > 2022-07-30 03:00:04 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:05 destination > 2022-07-30 03:00:05 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_six_flipper_gates}} 2022-07-30 03:00:05 destination > 2022-07-30 03:00:05 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:06 destination > 2022-07-30 03:00:06 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_qbt_freight_partner_vehicles}} 2022-07-30 03:00:06 destination > 2022-07-30 03:00:06 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:07 destination > 2022-07-30 03:00:07 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_ufk_freight_partners}} 2022-07-30 03:00:07 destination > 2022-07-30 03:00:07 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:07 destination > 2022-07-30 03:00:07 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_zvx_freight_product_orders}} 2022-07-30 03:00:08 destination > 2022-07-30 03:00:08 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:08 destination > 2022-07-30 03:00:08 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_oyi_freight_route_groupings}} 2022-07-30 03:00:08 destination > 2022-07-30 03:00:08 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:09 destination > 2022-07-30 03:00:09 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_cpo_freight_route_partner_costs}} 2022-07-30 03:00:09 destination > 2022-07-30 03:00:09 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:10 destination > 2022-07-30 03:00:10 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_orz_freight_routes}} 2022-07-30 03:00:10 destination > 2022-07-30 03:00:10 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:10 destination > 2022-07-30 03:00:10 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_hhr_freight_vehicle_types}} 2022-07-30 03:00:11 destination > 2022-07-30 03:00:11 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:11 destination > 2022-07-30 03:00:11 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_onx_freights}} 2022-07-30 03:00:12 destination > 2022-07-30 03:00:12 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:12 destination > 2022-07-30 03:00:12 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_rog_heya_campaign_memberships}} 2022-07-30 03:00:12 destination > 2022-07-30 03:00:12 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:13 destination > 2022-07-30 03:00:13 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_poz_heya_campaign_receipts}} 2022-07-30 03:00:13 destination > 2022-07-30 03:00:13 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:13 destination > 2022-07-30 03:00:13 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_gwf_location_store_products}} 2022-07-30 03:00:13 destination > 2022-07-30 03:00:13 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:14 destination > 2022-07-30 03:00:14 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_szu_memento_sessions}} 2022-07-30 03:00:14 destination > 2022-07-30 03:00:14 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:15 destination > 2022-07-30 03:00:15 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_ers_memento_states}} 2022-07-30 03:00:15 destination > 2022-07-30 03:00:15 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:15 destination > 2022-07-30 03:00:15 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_gjv_oico_radar_products}} 2022-07-30 03:00:16 destination > 2022-07-30 03:00:16 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:16 destination > 2022-07-30 03:00:16 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_mwv_oico_radars}} 2022-07-30 03:00:16 destination > 2022-07-30 03:00:16 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:17 destination > 2022-07-30 03:00:17 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_fkn_oico_users}} 2022-07-30 03:00:17 destination > 2022-07-30 03:00:17 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:18 destination > 2022-07-30 03:00:18 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_puv_omie_accounts}} 2022-07-30 03:00:18 destination > 2022-07-30 03:00:18 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:18 destination > 2022-07-30 03:00:18 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_ysf_order_categories}} 2022-07-30 03:00:19 destination > 2022-07-30 03:00:19 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:19 destination > 2022-07-30 03:00:19 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_kvb_order_feedbacks}} 2022-07-30 03:00:19 destination > 2022-07-30 03:00:19 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:20 destination > 2022-07-30 03:00:20 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_ied_order_issues}} 2022-07-30 03:00:20 destination > 2022-07-30 03:00:20 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:21 destination > 2022-07-30 03:00:21 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_gkg_orders}} 2022-07-30 03:00:21 destination > 2022-07-30 03:00:21 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:21 destination > 2022-07-30 03:00:21 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_mvy_payer_buyer_locations}} 2022-07-30 03:00:22 destination > 2022-07-30 03:00:22 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:22 destination > 2022-07-30 03:00:22 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_ceo_payers}} 2022-07-30 03:00:22 destination > 2022-07-30 03:00:22 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:23 destination > 2022-07-30 03:00:23 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_poy_payment_installments}} 2022-07-30 03:00:23 destination > 2022-07-30 03:00:23 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:24 destination > 2022-07-30 03:00:24 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_xey_payments}} 2022-07-30 03:00:24 destination > 2022-07-30 03:00:24 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:25 destination > 2022-07-30 03:00:25 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_epz_popular_searches}} 2022-07-30 03:00:25 destination > 2022-07-30 03:00:25 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:25 destination > 2022-07-30 03:00:25 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_cbq_product_canonical_categories}} 2022-07-30 03:00:26 destination > 2022-07-30 03:00:26 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:26 destination > 2022-07-30 03:00:26 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_vhc_product_canonicals}} 2022-07-30 03:00:27 destination > 2022-07-30 03:00:27 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:27 destination > 2022-07-30 03:00:27 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_twf_product_orders}} 2022-07-30 03:00:27 destination > 2022-07-30 03:00:27 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:28 destination > 2022-07-30 03:00:28 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_jsf_product_reports}} 2022-07-30 03:00:28 destination > 2022-07-30 03:00:28 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:28 destination > 2022-07-30 03:00:28 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_gpf_products}} 2022-07-30 03:00:29 destination > 2022-07-30 03:00:29 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:29 destination > 2022-07-30 03:00:29 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_tgn_reports}} 2022-07-30 03:00:30 destination > 2022-07-30 03:00:30 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:30 destination > 2022-07-30 03:00:30 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_aoi_requested_products}} 2022-07-30 03:00:30 destination > 2022-07-30 03:00:30 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:31 destination > 2022-07-30 03:00:31 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_azw_responsible_deliveries}} 2022-07-30 03:00:31 destination > 2022-07-30 03:00:31 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:32 destination > 2022-07-30 03:00:32 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_soc_roi_products}} 2022-07-30 03:00:32 destination > 2022-07-30 03:00:32 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:32 destination > 2022-07-30 03:00:32 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_vgu_schema_migrations}} 2022-07-30 03:00:33 destination > 2022-07-30 03:00:33 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:33 destination > 2022-07-30 03:00:33 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_iev_shortened_urls}} 2022-07-30 03:00:33 destination > 2022-07-30 03:00:33 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:34 destination > 2022-07-30 03:00:34 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_itr_sidekiq_sequence_records}} 2022-07-30 03:00:34 destination > 2022-07-30 03:00:34 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:34 destination > 2022-07-30 03:00:34 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_thf_spatial_ref_sys}} 2022-07-30 03:00:35 destination > 2022-07-30 03:00:35 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:35 destination > 2022-07-30 03:00:35 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_uqd_stockout_events}} 2022-07-30 03:00:35 destination > 2022-07-30 03:00:35 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:36 destination > 2022-07-30 03:00:36 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_qzf_store_categories}} 2022-07-30 03:00:36 destination > 2022-07-30 03:00:36 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:36 destination > 2022-07-30 03:00:36 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_qrm_store_locations}} 2022-07-30 03:00:37 destination > 2022-07-30 03:00:37 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:37 destination > 2022-07-30 03:00:37 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_ubq_store_order_quotes}} 2022-07-30 03:00:37 destination > 2022-07-30 03:00:37 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:38 destination > 2022-07-30 03:00:38 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_vij_store_orders}} 2022-07-30 03:00:38 destination > 2022-07-30 03:00:38 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:39 destination > 2022-07-30 03:00:39 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_uqg_store_users}} 2022-07-30 03:00:39 destination > 2022-07-30 03:00:39 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:40 destination > 2022-07-30 03:00:40 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_tpb_stores}} 2022-07-30 03:00:40 destination > 2022-07-30 03:00:40 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:40 destination > 2022-07-30 03:00:40 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_exl_term_acceptances}} 2022-07-30 03:00:41 destination > 2022-07-30 03:00:41 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 03:00:41 destination > 2022-07-30 03:00:41 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_akf_terms}} 2022-07-30 02:41:27 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.method: does not have a value in the enumeration [Standard], $.method: must be a constant value Standard 2022-07-30 02:41:27 INFO i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/54/0/logs.log 2022-07-30 02:41:27 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.39.39-alpha 2022-07-30 02:41:27 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-postgres:0.4.37 exists... 2022-07-30 02:41:27 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-postgres:0.4.37 was found locally. 2022-07-30 02:41:27 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 54 2022-07-30 02:41:27 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/54/0 --log-driver none --name source-postgres-check-54-0-qpila --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_CONNECTOR_IMAGE=airbyte/source-postgres:0.4.37 -e WORKER_JOB_ATTEMPT=0 -e AIRBYTE_VERSION=0.39.39-alpha -e WORKER_JOB_ID=54 airbyte/source-postgres:0.4.37 check --config source_config.json 2022-07-30 02:41:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:29 INFO i.a.i.b.a.AdaptiveSourceRunner$Runner(getSource):73 - Running source under deployment mode: OSS 2022-07-30 02:41:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:29 INFO i.a.i.b.a.AdaptiveSourceRunner$Runner(run):85 - Starting source: io.airbyte.integrations.base.ssh.SshWrappedSource 2022-07-30 02:41:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:29 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2022-07-30 02:41:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:29 INFO i.a.i.b.IntegrationRunner(runInternal):102 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2022-07-30 02:41:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:29 INFO i.a.i.b.IntegrationRunner(runInternal):103 - Command: CHECK 2022-07-30 02:41:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:29 INFO i.a.i.b.IntegrationRunner(runInternal):104 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-07-30 02:41:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:29 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:41:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:29 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:41:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:29 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:41:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:29 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:41:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:29 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword min - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:41:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:29 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword max - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:41:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:29 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL 2022-07-30 02:41:30 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:30 INFO c.z.h.HikariDataSource():80 - HikariPool-1 - Starting... 2022-07-30 02:41:30 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:30 INFO c.z.h.HikariDataSource():82 - HikariPool-1 - Start completed. 2022-07-30 02:41:30 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:30 INFO i.a.i.s.p.PostgresUtils(isCdc):29 - using CDC: true 2022-07-30 02:41:30 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:30 INFO i.a.i.s.j.AbstractJdbcSource(lambda$getCheckOperations$1):95 - Attempting to get metadata from the database to see if we can connect. 2022-07-30 02:41:30 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:30 INFO i.a.i.s.p.PostgresSource(lambda$getCheckOperations$3):236 - Attempting to find the named replication slot using the query: HikariProxyPreparedStatement@1105090408 wrapping SELECT * FROM pg_replication_slots WHERE slot_name = 'airbyte_slot' AND plugin = 'pgoutput' AND database = 'd6g4nour99s742' 2022-07-30 02:41:30 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:30 INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):38 - Set initial fetch size: 10 rows 2022-07-30 02:41:30 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:30 INFO i.a.i.s.p.PostgresSource(lambda$getCheckOperations$5):253 - Attempting to find the publication using the query: HikariProxyPreparedStatement@1622694817 wrapping SELECT * FROM pg_publication WHERE pubname = 'airbyte_publication' 2022-07-30 02:41:30 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:30 INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):38 - Set initial fetch size: 10 rows 2022-07-30 02:41:30 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:30 INFO c.z.h.HikariDataSource(close):350 - HikariPool-1 - Shutdown initiated... 2022-07-30 02:41:30 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:30 INFO c.z.h.HikariDataSource(close):352 - HikariPool-1 - Shutdown completed. 2022-07-30 02:41:30 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:30 INFO i.a.i.b.IntegrationRunner(runInternal):150 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2022-07-30 02:41:30 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:30 INFO i.a.i.b.a.AdaptiveSourceRunner$Runner(run):87 - Completed source: io.airbyte.integrations.base.ssh.SshWrappedSource 2022-07-30 02:41:30 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-07-30 02:41:30 INFO i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/54/0/logs.log 2022-07-30 02:41:30 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.39.39-alpha 2022-07-30 02:41:30 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:1.1.11 exists... 2022-07-30 02:41:30 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:1.1.11 was found locally. 2022-07-30 02:41:30 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 54 2022-07-30 02:41:30 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/54/0 --log-driver none --name destination-bigquery-check-54-0-ipjhh --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.1.11 -e WORKER_JOB_ATTEMPT=0 -e AIRBYTE_VERSION=0.39.39-alpha -e WORKER_JOB_ID=54 airbyte/destination-bigquery:1.1.11 check --config source_config.json 2022-07-30 02:41:31 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Class path contains multiple SLF4J bindings. 2022-07-30 02:41:31 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-07-30 02:41:31 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-07-30 02:41:31 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-07-30 02:41:31 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-07-30 02:41:31 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-07-30 02:41:32 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:32 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2022-07-30 02:41:32 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:32 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-07-30 02:41:32 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:32 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK 2022-07-30 02:41:32 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:32 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-07-30 02:41:32 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:32 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:41:32 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:32 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:41:32 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:32 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:41:32 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:32 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:41:34 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-30 02:41:34 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-07-30 02:41:34 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-07-30 02:41:35 INFO i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/54/0/logs.log 2022-07-30 02:41:35 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.39.39-alpha 2022-07-30 02:41:35 INFO i.a.w.g.DefaultReplicationWorker(run):116 - start sync worker. job id: 54 attempt id: 0 2022-07-30 02:41:35 INFO i.a.w.g.DefaultReplicationWorker(run):128 - configured sync modes: {public.payer_buyer_locations=incremental - append_dedup, public.active_storage_attachments=incremental - append_dedup, public.product_canonical_categories=incremental - append_dedup, public.reports=incremental - append_dedup, public.oico_radars=incremental - append_dedup, public.schema_migrations=incremental - append_dedup, public.order_categories=incremental - append_dedup, public.spatial_ref_sys=incremental - append_dedup, public.store_orders=incremental - append_dedup, public.requested_products=incremental - append_dedup, public.categories=incremental - append_dedup, public.freight_routes=incremental - append_dedup, public.product_orders=incremental - append_dedup, public.oico_radar_products=incremental - append_dedup, public.term_acceptances=incremental - append_dedup, public.heya_campaign_receipts=incremental - append_dedup, public.sidekiq_sequence_records=incremental - append_dedup, public.order_issues=incremental - append_dedup, public.freight_product_orders=incremental - append_dedup, public.buyer_contact_rules=incremental - append_dedup, public.buyer_public_informations=incremental - append_dedup, public.active_storage_variant_records=incremental - append_dedup, public.buyers=incremental - append_dedup, public.ar_internal_metadata=incremental - append_dedup, public.freight_vehicle_types=incremental - append_dedup, public.location_store_products=incremental - append_dedup, public.omie_accounts=incremental - append_dedup, public.shortened_urls=incremental - append_dedup, public.stores=incremental - append_dedup, public.store_categories=incremental - append_dedup, public.faq_categories=incremental - append_dedup, public.payment_installments=incremental - append_dedup, public.buyer_store_recommendations=incremental - append_dedup, public.order_feedbacks=incremental - append_dedup, public.active_storage_blobs=incremental - append_dedup, public.freight_partner_vehicles=incremental - append_dedup, public.product_reports=incremental - append_dedup, public.store_order_quotes=incremental - append_dedup, public.payments=incremental - append_dedup, public.heya_campaign_memberships=incremental - append_dedup, public.buyer_locations=incremental - append_dedup, public.changebase_metadata=incremental - append_dedup, public.transfeera_batches=incremental - append_dedup, public.roi_products=incremental - append_dedup, public.flipper_features=incremental - append_dedup, public.flipper_gates=incremental - append_dedup, public.oico_users=incremental - append_dedup, public.payers=incremental - append_dedup, public.store_users=incremental - append_dedup, public.popular_searches=incremental - append_dedup, public.product_canonicals=incremental - append_dedup, public.faq=incremental - append_dedup, public.orders=incremental - append_dedup, public.products=incremental - append_dedup, public.buyer_uploads=incremental - append_dedup, public.freight_route_groupings=incremental - append_dedup, public.store_locations=incremental - append_dedup, public.terms=incremental - append_dedup, public.buyer_contacts=incremental - append_dedup, public.responsible_deliveries=incremental - append_dedup, public.freights=incremental - append_dedup, public.memento_sessions=incremental - append_dedup, public.memento_states=incremental - append_dedup, public.buyer_users=incremental - append_dedup, public.freight_route_partner_costs=incremental - append_dedup, public.freight_partners=incremental - append_dedup, public.stockout_events=incremental - append_dedup} 2022-07-30 02:41:35 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination... 2022-07-30 02:41:35 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:1.1.11 exists... 2022-07-30 02:41:35 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:1.1.11 was found locally. 2022-07-30 02:41:35 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 54 2022-07-30 02:41:35 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/54/0 --log-driver none --name destination-bigquery-write-54-0-pjxob --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.1.11 -e WORKER_JOB_ATTEMPT=0 -e AIRBYTE_VERSION=0.39.39-alpha -e WORKER_JOB_ID=54 airbyte/destination-bigquery:1.1.11 write --config destination_config.json --catalog destination_catalog.json 2022-07-30 02:41:35 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-postgres:0.4.37 exists... 2022-07-30 02:41:35 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-postgres:0.4.37 was found locally. 2022-07-30 02:41:35 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 54 2022-07-30 02:41:35 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/54/0 --log-driver none --name source-postgres-read-54-0-mafac --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_CONNECTOR_IMAGE=airbyte/source-postgres:0.4.37 -e WORKER_JOB_ATTEMPT=0 -e AIRBYTE_VERSION=0.39.39-alpha -e WORKER_JOB_ID=54 airbyte/source-postgres:0.4.37 read --config source_config.json --catalog source_catalog.json 2022-07-30 02:41:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):406 - Destination output thread started. 2022-07-30 02:41:35 INFO i.a.w.g.DefaultReplicationWorker(run):170 - Waiting for source and destination threads to complete. 2022-07-30 02:41:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):299 - Replication thread started. 2022-07-30 02:41:36 destination > SLF4J: Class path contains multiple SLF4J bindings. 2022-07-30 02:41:36 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-07-30 02:41:36 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-07-30 02:41:36 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-07-30 02:41:36 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-07-30 02:41:36 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-07-30 02:41:38 source > 2022-07-30 02:41:38 INFO i.a.i.b.a.AdaptiveSourceRunner$Runner(getSource):73 - Running source under deployment mode: OSS 2022-07-30 02:41:38 destination > 2022-07-30 02:41:38 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-07-30 02:41:38 destination > 2022-07-30 02:41:38 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-07-30 02:41:38 destination > 2022-07-30 02:41:38 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: WRITE 2022-07-30 02:41:38 destination > 2022-07-30 02:41:38 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-07-30 02:41:38 source > 2022-07-30 02:41:38 INFO i.a.i.b.a.AdaptiveSourceRunner$Runner(run):85 - Starting source: io.airbyte.integrations.base.ssh.SshWrappedSource 2022-07-30 02:41:38 source > 2022-07-30 02:41:38 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {read=null, catalog=source_catalog.json, config=source_config.json} 2022-07-30 02:41:38 source > 2022-07-30 02:41:38 INFO i.a.i.b.IntegrationRunner(runInternal):102 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2022-07-30 02:41:38 source > 2022-07-30 02:41:38 INFO i.a.i.b.IntegrationRunner(runInternal):103 - Command: READ 2022-07-30 02:41:38 source > 2022-07-30 02:41:38 INFO i.a.i.b.IntegrationRunner(runInternal):104 - Integration config: IntegrationConfig{command=READ, configPath='source_config.json', catalogPath='source_catalog.json', statePath='null'} 2022-07-30 02:41:39 destination > 2022-07-30 02:41:39 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:41:39 destination > 2022-07-30 02:41:39 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:41:39 destination > 2022-07-30 02:41:39 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:41:39 source > 2022-07-30 02:41:39 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:41:39 source > 2022-07-30 02:41:39 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:41:39 source > 2022-07-30 02:41:39 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:41:39 source > 2022-07-30 02:41:39 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:41:39 source > 2022-07-30 02:41:39 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword min - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:41:39 source > 2022-07-30 02:41:39 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword max - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-30 02:41:39 destination > 2022-07-30 02:41:39 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:41:39 destination > 2022-07-30 02:41:39 WARN i.a.i.d.b.BigQueryDestination(getConsumer):197 - The "standard" upload mode is not performant, and is not recommended for production. Please use the GCS upload mode if you are syncing a large amount of data. 2022-07-30 02:41:39 destination > 2022-07-30 02:41:39 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:41:39 source > 2022-07-30 02:41:39 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL 2022-07-30 02:41:40 source > 2022-07-30 02:41:40 INFO c.z.h.HikariDataSource():80 - HikariPool-1 - Starting... 2022-07-30 02:41:40 source > 2022-07-30 02:41:40 INFO c.z.h.HikariDataSource():82 - HikariPool-1 - Start completed. 2022-07-30 02:41:40 source > 2022-07-30 02:41:40 INFO i.a.i.s.p.PostgresUtils(isCdc):29 - using CDC: true 2022-07-30 02:41:40 source > 2022-07-30 02:41:40 INFO i.a.i.s.j.AbstractJdbcSource(lambda$getCheckOperations$1):95 - Attempting to get metadata from the database to see if we can connect. 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(lambda$getCheckOperations$3):236 - Attempting to find the named replication slot using the query: HikariProxyPreparedStatement@2050275256 wrapping SELECT * FROM pg_replication_slots WHERE slot_name = 'airbyte_slot' AND plugin = 'pgoutput' AND database = 'd6g4nour99s742' 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):38 - Set initial fetch size: 10 rows 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(lambda$getCheckOperations$5):253 - Attempting to find the publication using the query: HikariProxyPreparedStatement@823758059 wrapping SELECT * FROM pg_publication WHERE pubname = 'airbyte_publication' 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):38 - Set initial fetch size: 10 rows 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO c.z.h.HikariDataSource(close):350 - HikariPool-1 - Shutdown initiated... 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO c.z.h.HikariDataSource(close):352 - HikariPool-1 - Shutdown completed. 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.StateManagerFactory(createStateManager):48 - Legacy state manager selected to manage state object with type LEGACY. 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='oico_users', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='reports', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='schema_migrations', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='order_issues', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='payments', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='active_storage_variant_records', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='shortened_urls', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='store_orders', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='heya_campaign_memberships', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='freight_vehicle_types', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='buyer_contacts', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='buyer_public_informations', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='sidekiq_sequence_records', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='freight_route_groupings', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='payment_installments', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='order_feedbacks', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='store_locations', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='product_orders', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='freight_partner_vehicles', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='freight_product_orders', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='location_store_products', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='orders', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='spatial_ref_sys', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='store_users', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='payer_buyer_locations', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='faq', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='freights', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='active_storage_attachments', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='ar_internal_metadata', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='flipper_gates', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='freight_partners', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='products', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='oico_radars', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='heya_campaign_receipts', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='categories', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='stores', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='buyer_locations', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='freight_routes', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='memento_sessions', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='memento_states', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='omie_accounts', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='product_canonical_categories', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='term_acceptances', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='requested_products', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='buyer_store_recommendations', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='buyers', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='roi_products', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='active_storage_blobs', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='order_categories', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='product_reports', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='stockout_events', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='buyer_uploads', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='buyer_users', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='faq_categories', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='flipper_features', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='transfeera_batches', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='oico_radar_products', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='terms', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='popular_searches', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='product_canonicals', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='changebase_metadata', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='payers', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='responsible_deliveries', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='store_categories', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='buyer_contact_rules', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='freight_route_partner_costs', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):161 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='store_order_quotes', namespace='public'}, New Cursor Field: null. Resetting cursor value 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.r.CdcStateManager():29 - Initialized CDC state with: null 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO c.z.h.HikariDataSource():80 - HikariPool-2 - Starting... 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO c.z.h.HikariDataSource():82 - HikariPool-2 - Start completed. 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):207 - Checking schema: public 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(discoverInternal):123 - Internal schemas to exclude: [catalog_history, information_schema, pg_catalog, pg_internal] 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):38 - Set initial fetch size: 10 rows 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.d.j.s.TwoStageSizeEstimator(getTargetBufferByteSize):72 - Max memory limit: 6174015488, JDBC buffer size: 1073741824 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_reports column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_reports column product_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_reports column buyer_user_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_reports column type (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_reports column price_when_reported (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_reports column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_reports column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_reports column product_order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table memento_sessions column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table memento_sessions column user_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table memento_sessions column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table memento_sessions column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payer_buyer_locations column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payer_buyer_locations column buyer_location_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payer_buyer_locations column payer_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payer_buyer_locations column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payer_buyer_locations column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payer_buyer_locations column buyer_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column trading_name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column business_name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column cnpj (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column cpf (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column website (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column point_of_contact (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column email (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column whatsapp (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column payment_type (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column is_dedicated (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column daily_fee (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partners column active (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_blobs column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_blobs column key (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_blobs column filename (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_blobs column content_type (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_blobs column metadata (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_blobs column byte_size (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_blobs column checksum (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_blobs column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_blobs column service_name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table location_store_products column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table location_store_products column product_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table location_store_products column store_location_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table location_store_products column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table location_store_products column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table location_store_products column pipefy_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table location_store_products column pipefy_store_location_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table location_store_products column pipefy_product_store_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_users column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_users column email (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_users column encrypted_password (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_users column reset_password_token (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_users column reset_password_sent_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_users column remember_created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_users column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_users column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_users column active (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radar_products column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radar_products column oico_radar_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radar_products column product_canonical_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radar_products column price (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radar_products column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radar_products column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table categories column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table categories column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table categories column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table categories column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table categories column category_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table categories column level (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table categories column visible_on_store_sign_up (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column state_registration (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column municipal_registration (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column business_name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column trading_name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column cnpj (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column type_company (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column average_monthly_spend (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column truora_unfiltered_data (type jsonb[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column truora_current_irs_status (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column truora_legal_type (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column truora_started_on (type date[13]) -> JsonSchemaType({type=string, format=date}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column truora_address (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column truora_size (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column truora_business_name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column truora_trading_name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column truora_main_activities (type jsonb[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column truora_check_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column conta_azul (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column location_city (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column location_state (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column default_payer_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column financing_fee (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column spend_limit (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column wholesale (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column new_orders_blocked (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyers column max_term_days (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_vehicle_types column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_vehicle_types column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_vehicle_types column description (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_vehicle_types column capacity_in_kg (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_vehicle_types column max_height (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_vehicle_types column max_lenght (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_vehicle_types column max_width (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_vehicle_types column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_vehicle_types column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_product_orders column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_product_orders column product_order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_product_orders column freight_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_product_orders column quantity_in_freight (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_product_orders column internal_product_freight_note (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_product_orders column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_product_orders column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column id (type uuid[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column payer_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column store_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column freight_partner_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column type (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column status (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column tax_document_number (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column tax_document_link (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column purchase_order_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column purchase_order_link (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column payment_value (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column paid_value (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column tax_note_issued_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column xml_link (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column discount (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column extra_fees (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column omie_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column canceled_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column created_by (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column postmark_message_id (type uuid[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column postmark_read_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payments column omie_account_id (type uuid[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table flipper_gates column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table flipper_gates column feature_key (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table flipper_gates column key (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table flipper_gates column value (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table flipper_gates column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table flipper_gates column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geography_columns column f_table_catalog (type name[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geography_columns column f_table_schema (type name[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geography_columns column f_table_name (type name[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geography_columns column f_geography_column (type name[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geography_columns column coord_dimension (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geography_columns column srid (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geography_columns column type (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column external_identify (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column description (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column details (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column product_canonical_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column price (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column oico_markup_wholesale (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column store_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column pipefy_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column pipefy_store_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column type_quantity (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column conta_azul (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column problem_reported (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column height_per_unit (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column lenght_per_unit (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column width_per_unit (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column weight_per_unit (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column canonical_associated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column trusted (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column minimum_quantity (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column ncm (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column omie_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column available_to_stores (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column oico_markup_retail (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column available (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column on_offer (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column inserted_by (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table products column changed_by (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column location (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column buyer_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column street (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column address_details (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column zipcode (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column city (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column state (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column lat (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column lng (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_locations column google_place_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table sidekiq_sequence_records column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table sidekiq_sequence_records column data (type jsonb[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table sidekiq_sequence_records column current_step (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table sidekiq_sequence_records column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table sidekiq_sequence_records column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_order_quotes column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_order_quotes column store_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_order_quotes column order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_order_quotes column product_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_order_quotes column quote_link (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_order_quotes column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_order_quotes column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_order_quotes column sent_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table popular_searches column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table popular_searches column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table popular_searches column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table popular_searches column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table faq_categories column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table faq_categories column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table faq_categories column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table faq_categories column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_uploads column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_uploads column buyer_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_uploads column buyer_user_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_uploads column file_type (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_uploads column file_url (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_uploads column done (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_uploads column filename (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_attachments column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_attachments column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_attachments column record_type (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_attachments column record_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_attachments column blob_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_attachments column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_variant_records column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_variant_records column blob_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table active_storage_variant_records column variation_digest (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column state_registration (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column municipal_registration (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column business_name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column trading_name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column cnpj (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column bank_code (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column bank_branch (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column bank_account (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column payment_type (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column priority (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column website (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column sales_point_of_contact (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column sales_email (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column sales_whatsapp (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column block (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column pix_key (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column minimum_response_time (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column bank_account_check_digit (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column manufacturer (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column omie_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column cnae (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column bank_account_holder_name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column bank_account_holder_document (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column activity (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column national_simple (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column payment_recommendations (type jsonb[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column oico_partner (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stores column store_type (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_orders column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_orders column order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_orders column store_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_orders column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_orders column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_orders column campaign_last_sent_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_public_informations column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_public_informations column type (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_public_informations column response (type jsonb[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_public_informations column buyer_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_public_informations column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_public_informations column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_public_informations column score (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_public_informations column recommended_term_limit (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_public_informations column recommended_spend_limit (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contact_rules column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contact_rules column buyer_contact_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contact_rules column buyer_location_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contact_rules column order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contact_rules column categories (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contact_rules column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contact_rules column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_partner_costs column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_partner_costs column is_dedicated (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_partner_costs column delivery_work_start_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_partner_costs column delivery_work_end_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_partner_costs column cost (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_partner_costs column extra_cost (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_partner_costs column total_cost (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_partner_costs column extra_cost_details (type jsonb[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_partner_costs column freight_partner_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_partner_costs column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_partner_costs column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table transfeera_batches column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table transfeera_batches column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table transfeera_batches column transfeera_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table transfeera_batches column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table transfeera_batches column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column original_description (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column description (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column comment (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column quantity (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column product_order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column product_canonical_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column deleted_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column done_by_client (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column unavailable (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table requested_products column user_preference (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column buyer_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column whatsapp (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column spend_limit (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column active (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column email (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column encrypted_password (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column reset_password_token (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column reset_password_sent_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column remember_created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column referral_code (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column profile (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column own_referral_code (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column confirmation_token (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column confirmed_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column confirmation_sent_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column unconfirmed_email (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column stytch_user_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column sign_in_count (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column current_sign_in_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column last_sign_in_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column current_sign_in_ip (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_users column last_sign_in_ip (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column userid (type oid[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column dbid (type oid[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column queryid (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column query (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column plans (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column total_plan_time (type float8[17]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column min_plan_time (type float8[17]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column max_plan_time (type float8[17]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column mean_plan_time (type float8[17]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column stddev_plan_time (type float8[17]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column calls (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column total_exec_time (type float8[17]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column min_exec_time (type float8[17]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column max_exec_time (type float8[17]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column mean_exec_time (type float8[17]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column stddev_exec_time (type float8[17]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column rows (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column shared_blks_hit (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column shared_blks_read (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column shared_blks_dirtied (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column shared_blks_written (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column local_blks_hit (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column local_blks_read (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column local_blks_dirtied (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column local_blks_written (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column temp_blks_read (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column temp_blks_written (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column blk_read_time (type float8[17]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column blk_write_time (type float8[17]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column wal_records (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column wal_fpi (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table pg_stat_statements column wal_bytes (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_memberships column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_memberships column user_type (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_memberships column user_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_memberships column campaign_gid (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_memberships column step_gid (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_memberships column concurrent (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_memberships column last_sent_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_memberships column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_memberships column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table terms column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table terms column link (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table terms column type (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table terms column version (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table terms column mandatory (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table terms column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table terms column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column id (type uuid[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column payment_id (type uuid[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column status (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column installment_value (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column installment_number (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column due_date (type date[13]) -> JsonSchemaType({type=string, format=date}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column paid_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column canceled_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column advance_payment (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column type (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column external_identify (type varchar[512]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column link (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column metadata (type jsonb[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column transfeera_batch_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column receipt_url (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column bank_receipt_url (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column paid_value (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payment_installments column original_due_date (type date[13]) -> JsonSchemaType({type=string, format=date}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table changebase_metadata column version (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table changebase_metadata column data (type jsonb[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table faq column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table faq column faq_category_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table faq column title (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table faq column description (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table faq column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table faq column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column cnpj (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column cpf (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column billing_address (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column phone_number (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column email (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column payment_terms_days (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column credit_limit (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column payer_confirmed (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column payer_confirmed_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column conta_azul (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column internal_notes (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column omie_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column cnae (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column activity (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column national_simple (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column bank_code (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column bank_branch (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column bank_account (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column bank_account_check_digit (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column bank_account_holder_name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column bank_account_holder_document (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column billing_address_state (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column billing_address_city (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column billing_address_street (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column billing_address_district (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column billing_address_zipcode (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column state_registration (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column tax_mode_simples (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table payers column final_consumer (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table spatial_ref_sys column srid (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table spatial_ref_sys column auth_name (type varchar[256]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table spatial_ref_sys column auth_srid (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table spatial_ref_sys column srtext (type varchar[2048]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table spatial_ref_sys column proj4text (type varchar[2048]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table shortened_urls column id (type serial[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table shortened_urls column owner_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table shortened_urls column owner_type (type varchar[20]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table shortened_urls column url (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table shortened_urls column unique_key (type varchar[10]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table shortened_urls column category (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table shortened_urls column use_count (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table shortened_urls column expires_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table shortened_urls column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table shortened_urls column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_store_recommendations column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_store_recommendations column buyer_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_store_recommendations column buyer_user_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_store_recommendations column store_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_store_recommendations column store_name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_store_recommendations column contact_name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_store_recommendations column store_email (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_store_recommendations column store_phone (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_store_recommendations column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_store_recommendations column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table term_acceptances column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table term_acceptances column term_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table term_acceptances column buyer_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table term_acceptances column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table term_acceptances column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table term_acceptances column store_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table term_acceptances column ip_address (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_receipts column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_receipts column user_type (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_receipts column user_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_receipts column step_gid (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_receipts column sent_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_receipts column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table heya_campaign_receipts column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table ar_internal_metadata column key (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table ar_internal_metadata column value (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table ar_internal_metadata column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table ar_internal_metadata column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contacts column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contacts column buyer_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contacts column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contacts column email (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contacts column phone_number (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contacts column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table buyer_contacts column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column store_location_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column buyer_location_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column freight_scheduled_pickup_time (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column freight_actual_pickup_time (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column client_delivery_notes (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column internal_delivery_notes (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column freight_weight (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column reverse_freight (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column target_delivery_datetime (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column actual_delivery_datetime (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column estimated_arrival_delivery_datetime (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column delivered (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column received_by (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column store_quote_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column notified_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column arrived_at_pick_up_location_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column picked_up_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column arrived_at_drop_off_location_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freights column distance (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonical_categories column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonical_categories column product_canonical_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonical_categories column category_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonical_categories column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonical_categories column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column store_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column location (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column street (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column address_details (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column zipcode (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column city (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column state (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column pipefy_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column lat (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column lng (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column google_place_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_locations column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table reports column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table reports column buyer_user_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table reports column sended (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table reports column message (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table reports column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table reports column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table roi_products column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table roi_products column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table roi_products column price (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column pipefy_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column freight_price (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column freight_partner_external_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column freight_scheduled_delivery_datetime (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column freight_actual_delivery_datetime (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column freight_tracking_link (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column freight_delivery_point_of_contact (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column freight_delivery_poc_phone (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column client_delivery_notes (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column product_problems (type jsonb[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column delivery_problems (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column shareable_link_hash (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column freight_partner_vehicle_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column sequence (type jsonb[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column freight_partner_dedicated_when_associated (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column total_distance (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_routes column freight_route_partner_cost_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stockout_events column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stockout_events column order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stockout_events column product_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stockout_events column price_when_deleted (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stockout_events column created_by (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stockout_events column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table stockout_events column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_groupings column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_groupings column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_groupings column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_groupings column freight_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_groupings column freight_route_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_route_groupings column delivery_note_link (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_categories column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_categories column store_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_categories column category_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_categories column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_categories column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geometry_columns column f_table_catalog (type varchar[256]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geometry_columns column f_table_schema (type name[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geometry_columns column f_table_name (type name[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geometry_columns column f_geometry_column (type name[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geometry_columns column coord_dimension (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geometry_columns column srid (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table geometry_columns column type (type varchar[30]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_feedbacks column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_feedbacks column order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_feedbacks column type (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_feedbacks column liked (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_feedbacks column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_feedbacks column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table omie_accounts column id (type uuid[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table omie_accounts column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table omie_accounts column document (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table omie_accounts column credential (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table omie_accounts column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table omie_accounts column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_issues column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_issues column order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_issues column buyer_user_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_issues column type (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_issues column delivery_problems (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_issues column product_problems (type jsonb[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_issues column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_issues column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_issues column description (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_issues column status (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_issues column confirmed_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_issues column canceled_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table responsible_deliveries column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table responsible_deliveries column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table responsible_deliveries column phone_number (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table responsible_deliveries column email (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table responsible_deliveries column buyer_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table responsible_deliveries column buyer_location_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table responsible_deliveries column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table responsible_deliveries column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table flipper_features column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table flipper_features column key (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table flipper_features column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table flipper_features column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column buyer_user_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column buyer_location_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column expected_date (type date[13]) -> JsonSchemaType({type=string, format=date}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column oico_invoice (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column shopping_list_url (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column status (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column identify (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column freight_code (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column freight_link (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column buyer_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column value (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column freight_value (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column final_value (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column client_order_form (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column pipefy_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column expected_time (type time[15]) -> JsonSchemaType({type=string, format=time, airbyte_type=time_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column fast_delivery (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column approved_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column conta_azul (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column order_form (type jsonb[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column expected_period (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column flexible_delivery (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column payer_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column last_quote (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column cancelation_reason (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column cancelation_comment (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column shareable_link_hash (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column internal_notes (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column discount (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column first_quote_sent_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column client_internal_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column client_notes (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column canceled_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column comment (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column po_file_url (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column money_saving (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column quote (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column quote_estimate (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column automatic_quote (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column parent_order_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column internal_delivery_notes (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column type (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column origin (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column events (type jsonb[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column expected_billing_due_date (type date[13]) -> JsonSchemaType({type=string, format=date}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column financing_value (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column po_value (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column more_payment_terms (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column quote_expires_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column user_preference (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column payment_method (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table orders column last_rdo_scheduling_message_sent_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radars column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radars column buyer_user_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radars column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radars column document (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radars column phone_number (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radars column email (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radars column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radars column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radars column notify_terms (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table oico_radars column shareable_link_hash (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column email (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column encrypted_password (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column reset_password_token (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column reset_password_sent_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column remember_created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column store_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column name (type text[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column phone_number (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column active (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column sign_in_count (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column current_sign_in_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column last_sign_in_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column current_sign_in_ip (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table store_users column last_sign_in_ip (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_categories column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_categories column order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_categories column category_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_categories column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table order_categories column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table memento_states column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table memento_states column action_type (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table memento_states column record_data (type bytea[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table memento_states column record_type (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table memento_states column record_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table memento_states column session_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table memento_states column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table memento_states column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table schema_migrations column version (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partner_vehicles column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partner_vehicles column freight_vehicle_type_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partner_vehicles column freight_partner_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partner_vehicles column plate (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partner_vehicles column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partner_vehicles column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partner_vehicles column start_location (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partner_vehicles column start_lat (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table freight_partner_vehicles column start_lng (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column code (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column name (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column image (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column ean (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column gtin (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column height_per_unit (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column lenght_per_unit (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column width_per_unit (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column weight_per_unit (type numeric[0]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column brand (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column reference_price (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_canonicals column created_by (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column id (type bigserial[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column product_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column order_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column quantity (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column created_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column updated_at (type timestamp[29]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column product_price_when_associated (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column location_store_product_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column pipefy_product_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column pipefy_order_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column pipefy_location_store_id (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column type_quantity (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column custom_product (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column product_cost_when_associated (type numeric[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column trusted_when_associated (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column returned_to (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column under_review (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column oversized (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column dispatched (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column store_location_id (type int8[19]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column store_quote_id (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column fits_in_motorcycle (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column quote_link (type varchar[2147483647]) -> JsonSchemaType({type=string}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column low_stock (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column canceled_by_store (type bool[1]) -> JsonSchemaType({type=boolean}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column confirmed_by (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):145 - Table product_orders column store_cancelation_reason (type int4[10]) -> JsonSchemaType({type=number}) 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.product_reports 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.memento_sessions 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.payer_buyer_locations 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.freight_partners 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.active_storage_blobs 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.location_store_products 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.oico_users 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.oico_radar_products 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.categories 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.buyers 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.freight_vehicle_types 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.freight_product_orders 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.payments 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.flipper_gates 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.geography_columns 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.products 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.buyer_locations 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.sidekiq_sequence_records 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.store_order_quotes 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.popular_searches 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.faq_categories 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.buyer_uploads 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.active_storage_attachments 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.active_storage_variant_records 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.stores 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.store_orders 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.buyer_public_informations 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.buyer_contact_rules 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.freight_route_partner_costs 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.transfeera_batches 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.requested_products 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.buyer_users 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.pg_stat_statements 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.heya_campaign_memberships 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.terms 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.payment_installments 2022-07-30 02:41:41 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.changebase_metadata 2022-07-30 02:41:42 source > 2022-07-30 02:41:41 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.faq 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.payers 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.spatial_ref_sys 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.shortened_urls 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.buyer_store_recommendations 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.term_acceptances 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.heya_campaign_receipts 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.ar_internal_metadata 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.buyer_contacts 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.freights 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.product_canonical_categories 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.store_locations 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.reports 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.roi_products 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.freight_routes 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.stockout_events 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.freight_route_groupings 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.store_categories 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.geometry_columns 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.order_feedbacks 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.omie_accounts 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.order_issues 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.responsible_deliveries 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.flipper_features 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.orders 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.oico_radars 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.store_users 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.order_categories 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.memento_states 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.schema_migrations 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.freight_partner_vehicles 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.product_canonicals 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(discoverRawTables):211 - Found table: public.product_orders 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresUtils(isCdc):29 - using CDC: true 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):38 - Set initial fetch size: 10 rows 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.d.j.s.TwoStageSizeEstimator(getTargetBufferByteSize):72 - Max memory limit: 6174015488, JDBC buffer size: 1073741824 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresCdcCatalogHelper(getPublicizedTables):92 - For CDC, only tables in publication airbyte_publication will be included in the sync: [public.oico_users, public.reports, public.schema_migrations, public.order_issues, public.payments, public.active_storage_variant_records, public.shortened_urls, public.store_orders, public.heya_campaign_memberships, public.freight_vehicle_types, public.buyer_contacts, public.buyer_public_informations, public.sidekiq_sequence_records, public.payment_installments, public.freight_route_groupings, public.order_feedbacks, public.store_locations, public.product_orders, public.freight_product_orders, public.freight_partner_vehicles, public.location_store_products, public.orders, public.spatial_ref_sys, public.store_users, public.payer_buyer_locations, public.faq, public.freights, public.active_storage_attachments, public.ar_internal_metadata, public.flipper_gates, public.freight_partners, public.products, public.oico_radars, public.heya_campaign_receipts, public.categories, public.stores, public.buyer_locations, public.freight_routes, public.memento_states, public.omie_accounts, public.memento_sessions, public.product_canonical_categories, public.term_acceptances, public.requested_products, public.buyer_store_recommendations, public.roi_products, public.buyers, public.order_categories, public.active_storage_blobs, public.product_reports, public.stockout_events, public.buyer_uploads, public.faq_categories, public.buyer_users, public.flipper_features, public.transfeera_batches, public.oico_radar_products, public.terms, public.popular_searches, public.product_canonicals, public.changebase_metadata, public.payers, public.store_categories, public.responsible_deliveries, public.buyer_contact_rules, public.freight_route_partner_costs, public.store_order_quotes] 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresUtils(isCdc):29 - using CDC: true 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresSource(getIncrementalIterators):294 - First record waiting time: 300 seconds 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.s.p.PostgresCdcTargetPosition(targetPosition):45 - identified target lsn: PgLsn{lsn=175422614568} 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.a.i.d.AirbyteDebeziumHandler(getIncrementalIterators):103 - Using CDC: true 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO o.a.k.c.c.AbstractConfig(logAll):376 - EmbeddedConfig values: 2022-07-30 02:41:42 source > access.control.allow.methods = 2022-07-30 02:41:42 source > access.control.allow.origin = 2022-07-30 02:41:42 source > admin.listeners = null 2022-07-30 02:41:42 source > bootstrap.servers = [localhost:9092] 2022-07-30 02:41:42 source > client.dns.lookup = use_all_dns_ips 2022-07-30 02:41:42 source > config.providers = [] 2022-07-30 02:41:42 source > connector.client.config.override.policy = All 2022-07-30 02:41:42 source > header.converter = class org.apache.kafka.connect.storage.SimpleHeaderConverter 2022-07-30 02:41:42 source > key.converter = class org.apache.kafka.connect.json.JsonConverter 2022-07-30 02:41:42 source > listeners = [http://:8083] 2022-07-30 02:41:42 source > metric.reporters = [] 2022-07-30 02:41:42 source > metrics.num.samples = 2 2022-07-30 02:41:42 source > metrics.recording.level = INFO 2022-07-30 02:41:42 source > metrics.sample.window.ms = 30000 2022-07-30 02:41:42 source > offset.flush.interval.ms = 1000 2022-07-30 02:41:42 source > offset.flush.timeout.ms = 5000 2022-07-30 02:41:42 source > offset.storage.file.filename = /tmp/cdc-state-offset4900424477910310481/offset.dat 2022-07-30 02:41:42 source > offset.storage.partitions = null 2022-07-30 02:41:42 source > offset.storage.replication.factor = null 2022-07-30 02:41:42 source > offset.storage.topic = 2022-07-30 02:41:42 source > plugin.path = null 2022-07-30 02:41:42 source > response.http.headers.config = 2022-07-30 02:41:42 source > rest.advertised.host.name = null 2022-07-30 02:41:42 source > rest.advertised.listener = null 2022-07-30 02:41:42 source > rest.advertised.port = null 2022-07-30 02:41:42 source > rest.extension.classes = [] 2022-07-30 02:41:42 source > ssl.cipher.suites = null 2022-07-30 02:41:42 source > ssl.client.auth = none 2022-07-30 02:41:42 source > ssl.enabled.protocols = [TLSv1.2, TLSv1.3] 2022-07-30 02:41:42 source > ssl.endpoint.identification.algorithm = https 2022-07-30 02:41:42 source > ssl.engine.factory.class = null 2022-07-30 02:41:42 source > ssl.key.password = null 2022-07-30 02:41:42 source > ssl.keymanager.algorithm = SunX509 2022-07-30 02:41:42 source > ssl.keystore.certificate.chain = null 2022-07-30 02:41:42 source > ssl.keystore.key = null 2022-07-30 02:41:42 source > ssl.keystore.location = null 2022-07-30 02:41:42 source > ssl.keystore.password = null 2022-07-30 02:41:42 source > ssl.keystore.type = JKS 2022-07-30 02:41:42 source > ssl.protocol = TLSv1.3 2022-07-30 02:41:42 source > ssl.provider = null 2022-07-30 02:41:42 source > ssl.secure.random.implementation = null 2022-07-30 02:41:42 source > ssl.trustmanager.algorithm = PKIX 2022-07-30 02:41:42 source > ssl.truststore.certificates = null 2022-07-30 02:41:42 source > ssl.truststore.location = null 2022-07-30 02:41:42 source > ssl.truststore.password = null 2022-07-30 02:41:42 source > ssl.truststore.type = JKS 2022-07-30 02:41:42 source > task.shutdown.graceful.timeout.ms = 5000 2022-07-30 02:41:42 source > topic.creation.enable = true 2022-07-30 02:41:42 source > topic.tracking.allow.reset = true 2022-07-30 02:41:42 source > topic.tracking.enable = true 2022-07-30 02:41:42 source > value.converter = class org.apache.kafka.connect.json.JsonConverter 2022-07-30 02:41:42 destination > 2022-07-30 02:41:42 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_tis_active_storage_attachments}} 2022-07-30 02:41:42 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $: unknown found, object expected 2022-07-30 02:41:42 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 WARN o.a.k.c.r.WorkerConfig(logInternalConverterRemovalWarnings):316 - The worker has been configured with one or more internal converter properties ([internal.key.converter, internal.value.converter]). Support for these properties was deprecated in version 2.0 and removed in version 3.0, and specifying them will have no effect. Instead, an instance of the JsonConverter with schemas.enable set to false will be used. For more information, please visit http://kafka.apache.org/documentation/#upgrade and consult the upgrade notesfor the 3.0 release. 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 WARN o.a.k.c.r.WorkerConfig(logPluginPathConfigProviderWarning):334 - Variables cannot be used in the 'plugin.path' property, since the property is used by plugin scanning before the config providers that replace the variables are initialized. The raw value 'null' was used for plugin scanning, as opposed to the transformed value 'null', and this may cause unexpected results. 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 WARN i.d.c.p.PostgresConnectorConfig(validateSkippedOperations):1371 - Configuration property 'truncate.handling.mode' is deprecated and will be removed soon. If you wish to retain skipped truncate functionality, please configure 'skipped.operations' with "t". 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 WARN i.d.c.p.PostgresConnectorConfig(validateTruncateHandlingMode):1333 - Configuration property 'truncate.handling.mode' is deprecated and will be removed in future versions. Please use 'skipped.operations' instead. 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 WARN i.d.c.p.PostgresConnectorConfig(validateToastedValuePlaceholder):1384 - Configuration property 'toasted.value.placeholder' is deprecated and will be removed in future versions. Please use 'unavailable.value.placeholder' instead. 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(start):124 - Starting PostgresConnectorTask with configuration: 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - connector.class = io.debezium.connector.postgresql.PostgresConnector 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - max.queue.size = 8192 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - slot.name = airbyte_slot 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - publication.name = airbyte_publication 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - offset.storage.file.filename = /tmp/cdc-state-offset4900424477910310481/offset.dat 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - decimal.handling.mode = string 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - converters = datetime 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - datetime.type = io.airbyte.integrations.debezium.internals.PostgresConverter 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - value.converter = org.apache.kafka.connect.json.JsonConverter 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - key.converter = org.apache.kafka.connect.json.JsonConverter 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - publication.autocreate.mode = disabled 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - database.user = airbyte 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - database.dbname = d6g4nour99s742 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - offset.storage = org.apache.kafka.connect.storage.FileOffsetBackingStore 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - database.server.name = d6g4nour99s742 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - offset.flush.timeout.ms = 5000 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - plugin.name = pgoutput 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - database.port = 5432 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - offset.flush.interval.ms = 1000 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - key.converter.schemas.enable = false 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - internal.key.converter = org.apache.kafka.connect.json.JsonConverter 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - database.hostname = db-oico-production.c2sxgpzdvndu.us-east-1.rds.amazonaws.com 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - database.password = ******** 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - name = d6g4nour99s742 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - value.converter.schemas.enable = false 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - internal.value.converter = org.apache.kafka.connect.json.JsonConverter 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - max.batch.size = 2048 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - table.include.list = public.active_storage_attachments,public.active_storage_blobs,public.active_storage_variant_records,public.ar_internal_metadata,public.buyer_contact_rules,public.buyer_contacts,public.buyer_locations,public.buyer_public_informations,public.buyer_store_recommendations,public.buyer_uploads,public.buyer_users,public.buyers,public.categories,public.changebase_metadata,public.faq,public.faq_categories,public.flipper_features,public.flipper_gates,public.freight_partner_vehicles,public.freight_partners,public.freight_product_orders,public.freight_route_groupings,public.freight_route_partner_costs,public.freight_routes,public.freight_vehicle_types,public.freights,public.heya_campaign_memberships,public.heya_campaign_receipts,public.location_store_products,public.memento_sessions,public.memento_states,public.oico_radar_products,public.oico_radars,public.oico_users,public.omie_accounts,public.order_categories,public.order_feedbacks,public.order_issues,public.orders,public.payer_buyer_locations,public.payers,public.payment_installments,public.payments,public.popular_searches,public.product_canonical_categories,public.product_canonicals,public.product_orders,public.product_reports,public.products,public.reports,public.requested_products,public.responsible_deliveries,public.roi_products,public.schema_migrations,public.shortened_urls,public.sidekiq_sequence_records,public.spatial_ref_sys,public.stockout_events,public.store_categories,public.store_locations,public.store_order_quotes,public.store_orders,public.store_users,public.stores,public.term_acceptances,public.terms,public.transfeera_batches 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(lambda$start$0):126 - snapshot.mode = initial 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.c.BaseSourceTask(getPreviousOffsets):318 - No previous offsets found 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.p.PostgresConnectorTask(start):108 - user 'airbyte' connected to database 'd6g4nour99s742' on PostgreSQL 13.4 on x86_64-pc-linux-gnu, compiled by gcc (GCC) 7.3.1 20180712 (Red Hat 7.3.1-12), 64-bit with roles: 2022-07-30 02:41:42 source > role 'rds_replication' [superuser: false, replication: false, inherit: true, create role: false, create db: false, can log in: false] 2022-07-30 02:41:42 source > role 'airbyte' [superuser: false, replication: false, inherit: true, create role: false, create db: false, can log in: true] 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.p.c.PostgresConnection(readReplicationSlotInfo):251 - Obtained valid replication slot ReplicationSlot [active=false, latestFlushedLsn=LSN{28/D00CC220}, catalogXmin=70647] 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.p.PostgresConnectorTask(start):117 - No previous offset found 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.p.s.InitialSnapshotter(shouldSnapshot):34 - Taking initial snapshot for new datasource 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.u.Threads(threadFactory):270 - Requested thread factory for connector PostgresConnector, id = d6g4nour99s742 named = change-event-source-coordinator 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.u.Threads$3(newThread):287 - Creating thread debezium-postgresconnector-d6g4nour99s742-change-event-source-coordinator 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.p.ChangeEventSourceCoordinator(lambda$start$0):103 - Metrics registered 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.p.ChangeEventSourceCoordinator(lambda$start$0):106 - Context created 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.p.s.InitialSnapshotter(shouldSnapshot):34 - Taking initial snapshot for new datasource 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.c.p.PostgresSnapshotChangeEventSource(getSnapshottingTask):64 - According to the connector configuration data will be snapshotted 2022-07-30 02:41:42 source > 2022-07-30 02:41:42 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):87 - Snapshot step 1 - Preparing 2022-07-30 02:41:42 destination > 2022-07-30 02:41:42 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:41:43 destination > 2022-07-30 02:41:43 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_gle_active_storage_blobs}} 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'CURRENT_TIMESTAMP' to type 'timestamp'. Expression evaluation is not supported. 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):96 - Snapshot step 2 - Determining captured tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.payer_buyer_locations to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.active_storage_attachments to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.product_canonical_categories to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.reports to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.oico_radars to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.schema_migrations to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.order_categories to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.store_orders to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.requested_products to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.categories to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.freight_routes to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.product_orders to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.oico_radar_products to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.term_acceptances to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.heya_campaign_receipts to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.sidekiq_sequence_records to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.order_issues to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.freight_product_orders to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.buyer_contact_rules to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.buyer_public_informations to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.active_storage_variant_records to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.buyers to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.ar_internal_metadata to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.freight_vehicle_types to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.location_store_products to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.omie_accounts to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.shortened_urls to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.stores to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.store_categories to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.faq_categories to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.payment_installments to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.buyer_store_recommendations to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.order_feedbacks to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.active_storage_blobs to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.freight_partner_vehicles to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.product_reports to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.store_order_quotes to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.payments to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.heya_campaign_memberships to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.buyer_locations to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.changebase_metadata to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.transfeera_batches to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.roi_products to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.flipper_features to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.flipper_gates to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.oico_users to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.payers to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.store_users to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.popular_searches to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.product_canonicals to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.faq to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.orders to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.products to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.buyer_uploads to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.freight_route_groupings to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.store_locations to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.terms to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.buyer_contacts to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.responsible_deliveries to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.freights to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.memento_sessions to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.memento_states to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.buyer_users to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.freight_route_partner_costs to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.freight_partners to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(determineCapturedTables):189 - Adding table public.stockout_events to the list of capture schema tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):103 - Snapshot step 3 - Locking captured tables [public.active_storage_attachments, public.active_storage_blobs, public.active_storage_variant_records, public.ar_internal_metadata, public.buyer_contact_rules, public.buyer_contacts, public.buyer_locations, public.buyer_public_informations, public.buyer_store_recommendations, public.buyer_uploads, public.buyer_users, public.buyers, public.categories, public.changebase_metadata, public.faq, public.faq_categories, public.flipper_features, public.flipper_gates, public.freight_partner_vehicles, public.freight_partners, public.freight_product_orders, public.freight_route_groupings, public.freight_route_partner_costs, public.freight_routes, public.freight_vehicle_types, public.freights, public.heya_campaign_memberships, public.heya_campaign_receipts, public.location_store_products, public.memento_sessions, public.memento_states, public.oico_radar_products, public.oico_radars, public.oico_users, public.omie_accounts, public.order_categories, public.order_feedbacks, public.order_issues, public.orders, public.payer_buyer_locations, public.payers, public.payment_installments, public.payments, public.popular_searches, public.product_canonical_categories, public.product_canonicals, public.product_orders, public.product_reports, public.products, public.reports, public.requested_products, public.responsible_deliveries, public.roi_products, public.schema_migrations, public.shortened_urls, public.sidekiq_sequence_records, public.stockout_events, public.store_categories, public.store_locations, public.store_order_quotes, public.store_orders, public.store_users, public.stores, public.term_acceptances, public.terms, public.transfeera_batches] 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):109 - Snapshot step 4 - Determining snapshot offset 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.c.p.PostgresOffsetContext(initialContext):231 - Creating initial offset context 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.c.p.PostgresOffsetContext(initialContext):234 - Read xlogStart at 'LSN{28/D800AC28}' from transaction '70657' 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.c.p.PostgresSnapshotChangeEventSource(updateOffsetForSnapshot):146 - Read xlogStart at 'LSN{28/D800AC28}' from transaction '70657' 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):112 - Snapshot step 5 - Reading structure of captured tables 2022-07-30 02:41:43 source > 2022-07-30 02:41:43 INFO i.d.c.p.PostgresSnapshotChangeEventSource(readTableStructure):192 - Reading structure of schema 'public' of catalog 'd6g4nour99s742' 2022-07-30 02:41:43 destination > 2022-07-30 02:41:43 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:41:44 source > 2022-07-30 02:41:44 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:41:44 source > 2022-07-30 02:41:44 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:41:44 source > 2022-07-30 02:41:44 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:41:44 source > 2022-07-30 02:41:44 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:41:44 source > 2022-07-30 02:41:44 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:41:44 source > 2022-07-30 02:41:44 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:41:44 source > 2022-07-30 02:41:44 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'CURRENT_TIMESTAMP' to type 'timestamp'. Expression evaluation is not supported. 2022-07-30 02:41:44 source > 2022-07-30 02:41:44 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):116 - Snapshot step 6 - Persisting schema history 2022-07-30 02:41:44 source > 2022-07-30 02:41:44 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):128 - Snapshot step 7 - Snapshotting data 2022-07-30 02:41:44 source > 2022-07-30 02:41:44 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEvents):302 - Snapshotting contents of 66 tables while still in transaction 2022-07-30 02:41:44 source > 2022-07-30 02:41:44 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.active_storage_attachments' (1 of 66 tables) 2022-07-30 02:41:44 source > 2022-07-30 02:41:44 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.active_storage_attachments' using select statement: 'SELECT "id", "name", "record_type", "record_id", "blob_id", "created_at" FROM "public"."active_storage_attachments"' 2022-07-30 02:41:44 destination > 2022-07-30 02:41:44 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_ddd_active_storage_variant_records}} 2022-07-30 02:41:44 destination > 2022-07-30 02:41:44 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:41:45 destination > 2022-07-30 02:41:45 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_lnb_ar_internal_metadata}} 2022-07-30 02:41:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 1000 (232 KB) 2022-07-30 02:41:45 destination > 2022-07-30 02:41:45 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:41:46 destination > 2022-07-30 02:41:46 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_tbm_buyer_contact_rules}} 2022-07-30 02:41:46 destination > 2022-07-30 02:41:46 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:41:47 destination > 2022-07-30 02:41:47 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_yoo_buyer_contacts}} 2022-07-30 02:41:47 destination > 2022-07-30 02:41:47 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:41:48 destination > 2022-07-30 02:41:48 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_hwt_buyer_locations}} 2022-07-30 02:41:48 destination > 2022-07-30 02:41:48 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:41:49 destination > 2022-07-30 02:41:49 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_ilc_buyer_public_informations}} 2022-07-30 02:41:49 destination > 2022-07-30 02:41:49 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:41:50 destination > 2022-07-30 02:41:50 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_ycm_buyer_store_recommendations}} 2022-07-30 02:41:50 destination > 2022-07-30 02:41:50 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:41:51 destination > 2022-07-30 02:41:51 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_uxi_buyer_uploads}} 2022-07-30 02:41:51 destination > 2022-07-30 02:41:51 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:41:52 destination > 2022-07-30 02:41:52 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_sap_buyer_users}} 2022-07-30 02:41:52 destination > 2022-07-30 02:41:52 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:41:53 destination > 2022-07-30 02:41:53 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_mpz_buyers}} 2022-07-30 02:41:53 destination > 2022-07-30 02:41:53 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:41:54 destination > 2022-07-30 02:41:54 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_qnf_categories}} 2022-07-30 02:41:54 destination > 2022-07-30 02:41:54 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:41:55 destination > 2022-07-30 02:41:55 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_lxh_changebase_metadata}} 2022-07-30 02:41:55 destination > 2022-07-30 02:41:55 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:41:56 destination > 2022-07-30 02:41:56 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_fql_faq}} 2022-07-30 02:41:56 destination > 2022-07-30 02:41:56 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:41:57 destination > 2022-07-30 02:41:57 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_ecf_faq_categories}} 2022-07-30 02:41:57 destination > 2022-07-30 02:41:57 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:41:58 destination > 2022-07-30 02:41:58 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_xjv_flipper_features}} 2022-07-30 02:41:58 destination > 2022-07-30 02:41:58 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:41:59 destination > 2022-07-30 02:41:59 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_udj_flipper_gates}} 2022-07-30 02:41:59 destination > 2022-07-30 02:41:59 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:00 destination > 2022-07-30 02:42:00 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_tmw_freight_partner_vehicles}} 2022-07-30 02:42:00 destination > 2022-07-30 02:42:00 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:01 destination > 2022-07-30 02:42:01 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_uva_freight_partners}} 2022-07-30 02:42:01 destination > 2022-07-30 02:42:01 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:02 destination > 2022-07-30 02:42:02 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_lwf_freight_product_orders}} 2022-07-30 02:42:02 destination > 2022-07-30 02:42:02 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:03 destination > 2022-07-30 02:42:03 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_opu_freight_route_groupings}} 2022-07-30 02:42:03 destination > 2022-07-30 02:42:03 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:03 destination > 2022-07-30 02:42:03 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_hkh_freight_route_partner_costs}} 2022-07-30 02:42:04 destination > 2022-07-30 02:42:04 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:04 destination > 2022-07-30 02:42:04 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_vpa_freight_routes}} 2022-07-30 02:42:05 destination > 2022-07-30 02:42:05 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:05 destination > 2022-07-30 02:42:05 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_chi_freight_vehicle_types}} 2022-07-30 02:42:06 destination > 2022-07-30 02:42:06 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:06 destination > 2022-07-30 02:42:06 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_dsp_freights}} 2022-07-30 02:42:07 destination > 2022-07-30 02:42:07 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:07 destination > 2022-07-30 02:42:07 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_ebg_heya_campaign_memberships}} 2022-07-30 02:42:08 destination > 2022-07-30 02:42:08 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:08 destination > 2022-07-30 02:42:08 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_ebq_heya_campaign_receipts}} 2022-07-30 02:42:09 destination > 2022-07-30 02:42:09 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:09 destination > 2022-07-30 02:42:09 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_iwc_location_store_products}} 2022-07-30 02:42:09 destination > 2022-07-30 02:42:09 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:10 destination > 2022-07-30 02:42:10 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_dqm_memento_sessions}} 2022-07-30 02:42:10 destination > 2022-07-30 02:42:10 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:11 destination > 2022-07-30 02:42:11 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_pfq_memento_states}} 2022-07-30 02:42:11 destination > 2022-07-30 02:42:11 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:12 destination > 2022-07-30 02:42:12 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_xwy_oico_radar_products}} 2022-07-30 02:42:12 destination > 2022-07-30 02:42:12 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:13 destination > 2022-07-30 02:42:13 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_dhl_oico_radars}} 2022-07-30 02:42:13 destination > 2022-07-30 02:42:13 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:14 destination > 2022-07-30 02:42:14 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_foi_oico_users}} 2022-07-30 02:42:14 destination > 2022-07-30 02:42:14 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:15 destination > 2022-07-30 02:42:15 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_zcc_omie_accounts}} 2022-07-30 02:42:15 destination > 2022-07-30 02:42:15 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:15 destination > 2022-07-30 02:42:15 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_vsj_order_categories}} 2022-07-30 02:42:16 destination > 2022-07-30 02:42:16 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:16 destination > 2022-07-30 02:42:16 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_rqq_order_feedbacks}} 2022-07-30 02:42:17 destination > 2022-07-30 02:42:17 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:17 destination > 2022-07-30 02:42:17 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_daf_order_issues}} 2022-07-30 02:42:18 destination > 2022-07-30 02:42:18 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:18 destination > 2022-07-30 02:42:18 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_uls_orders}} 2022-07-30 02:42:19 destination > 2022-07-30 02:42:19 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:19 destination > 2022-07-30 02:42:19 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_lpt_payer_buyer_locations}} 2022-07-30 02:42:19 destination > 2022-07-30 02:42:19 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:20 destination > 2022-07-30 02:42:20 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_qci_payers}} 2022-07-30 02:42:20 destination > 2022-07-30 02:42:20 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:21 destination > 2022-07-30 02:42:21 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_shi_payment_installments}} 2022-07-30 02:42:21 destination > 2022-07-30 02:42:21 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:22 destination > 2022-07-30 02:42:22 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_mqe_payments}} 2022-07-30 02:42:22 destination > 2022-07-30 02:42:22 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:23 destination > 2022-07-30 02:42:23 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_jea_popular_searches}} 2022-07-30 02:42:23 destination > 2022-07-30 02:42:23 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:24 destination > 2022-07-30 02:42:24 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_zby_product_canonical_categories}} 2022-07-30 02:42:24 destination > 2022-07-30 02:42:24 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:25 destination > 2022-07-30 02:42:25 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_kup_product_canonicals}} 2022-07-30 02:42:25 destination > 2022-07-30 02:42:25 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:26 destination > 2022-07-30 02:42:26 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_rul_product_orders}} 2022-07-30 02:42:26 destination > 2022-07-30 02:42:26 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:27 destination > 2022-07-30 02:42:27 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_sll_product_reports}} 2022-07-30 02:42:27 destination > 2022-07-30 02:42:27 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:27 destination > 2022-07-30 02:42:27 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_xpe_products}} 2022-07-30 02:42:28 destination > 2022-07-30 02:42:28 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:28 destination > 2022-07-30 02:42:28 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_ezl_reports}} 2022-07-30 02:42:29 destination > 2022-07-30 02:42:29 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:29 destination > 2022-07-30 02:42:29 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_mcs_requested_products}} 2022-07-30 02:42:29 destination > 2022-07-30 02:42:29 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:30 destination > 2022-07-30 02:42:30 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_npv_responsible_deliveries}} 2022-07-30 02:42:30 destination > 2022-07-30 02:42:30 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:31 destination > 2022-07-30 02:42:31 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_eip_roi_products}} 2022-07-30 02:42:31 destination > 2022-07-30 02:42:31 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:32 destination > 2022-07-30 02:42:32 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_nrn_schema_migrations}} 2022-07-30 02:42:32 destination > 2022-07-30 02:42:32 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:33 destination > 2022-07-30 02:42:33 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_dpy_shortened_urls}} 2022-07-30 02:42:33 destination > 2022-07-30 02:42:33 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:34 destination > 2022-07-30 02:42:34 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_shj_sidekiq_sequence_records}} 2022-07-30 02:42:34 destination > 2022-07-30 02:42:34 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:35 destination > 2022-07-30 02:42:35 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_zvw_spatial_ref_sys}} 2022-07-30 02:42:35 destination > 2022-07-30 02:42:35 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:35 destination > 2022-07-30 02:42:35 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_prx_stockout_events}} 2022-07-30 02:42:36 destination > 2022-07-30 02:42:36 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:36 destination > 2022-07-30 02:42:36 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_paf_store_categories}} 2022-07-30 02:42:37 destination > 2022-07-30 02:42:37 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:37 destination > 2022-07-30 02:42:37 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_iac_store_locations}} 2022-07-30 02:42:38 destination > 2022-07-30 02:42:38 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:38 destination > 2022-07-30 02:42:38 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_caf_store_order_quotes}} 2022-07-30 02:42:38 destination > 2022-07-30 02:42:38 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:39 destination > 2022-07-30 02:42:39 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_agt_store_orders}} 2022-07-30 02:42:39 destination > 2022-07-30 02:42:39 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:40 destination > 2022-07-30 02:42:40 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_yvh_store_users}} 2022-07-30 02:42:40 destination > 2022-07-30 02:42:40 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:41 destination > 2022-07-30 02:42:41 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_tfl_stores}} 2022-07-30 02:42:41 destination > 2022-07-30 02:42:41 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:41 destination > 2022-07-30 02:42:41 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_leg_term_acceptances}} 2022-07-30 02:42:42 destination > 2022-07-30 02:42:42 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:42 destination > 2022-07-30 02:42:42 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_xsz_terms}} 2022-07-30 02:42:43 destination > 2022-07-30 02:42:43 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-07-30 02:42:43 destination > 2022-07-30 02:42:43 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_scd_transfeera_batches}} 2022-07-30 02:42:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 2000 (475 KB) 2022-07-30 02:42:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 3000 (719 KB) 2022-07-30 02:42:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 4000 (962 KB) 2022-07-30 02:42:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 5000 (1 MB) 2022-07-30 02:42:46 source > 2022-07-30 02:42:44 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):374 - Exported 24097 records for table 'public.active_storage_attachments' after 00:01:00.613 2022-07-30 02:42:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 6000 (1 MB) 2022-07-30 02:42:46 source > 2022-07-30 02:42:44 INFO i.d.c.c.BaseSourceTask(logStatistics):182 - 2048 records sent during previous 00:01:02.593, last recorded offset: {last_snapshot_record=false, lsn=175422614568, txId=70657, ts_usec=1659148906693000, snapshot=true} 2022-07-30 02:42:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 7000 (1 MB) 2022-07-30 02:42:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 8000 (1 MB) 2022-07-30 02:42:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 9000 (2 MB) 2022-07-30 02:42:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 10000 (2 MB) 2022-07-30 02:42:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 11000 (2 MB) 2022-07-30 02:42:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 12000 (2 MB) 2022-07-30 02:42:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 13000 (3 MB) 2022-07-30 02:42:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 14000 (3 MB) 2022-07-30 02:42:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 15000 (3 MB) 2022-07-30 02:42:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 16000 (3 MB) 2022-07-30 02:42:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 17000 (3 MB) 2022-07-30 02:42:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 18000 (4 MB) 2022-07-30 02:42:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 19000 (4 MB) 2022-07-30 02:42:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 20000 (4 MB) 2022-07-30 02:42:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 21000 (4 MB) 2022-07-30 02:42:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 22000 (5 MB) 2022-07-30 02:42:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 23000 (5 MB) 2022-07-30 02:42:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 24000 (5 MB) 2022-07-30 02:42:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 25000 (5 MB) 2022-07-30 02:42:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 26000 (6 MB) 2022-07-30 02:42:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 27000 (6 MB) 2022-07-30 02:42:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 28000 (6 MB) 2022-07-30 02:42:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 29000 (6 MB) 2022-07-30 02:42:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 30000 (7 MB) 2022-07-30 02:42:55 source > 2022-07-30 02:42:55 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):374 - Exported 48673 records for table 'public.active_storage_attachments' after 00:01:10.829 2022-07-30 02:42:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 31000 (7 MB) 2022-07-30 02:42:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 32000 (7 MB) 2022-07-30 02:42:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 33000 (7 MB) 2022-07-30 02:42:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 34000 (8 MB) 2022-07-30 02:42:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 35000 (8 MB) 2022-07-30 02:42:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 36000 (8 MB) 2022-07-30 02:42:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 37000 (8 MB) 2022-07-30 02:42:57 source > 2022-07-30 02:42:57 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 56200 records for table 'public.active_storage_attachments'; total duration '00:01:12.784' 2022-07-30 02:42:57 source > 2022-07-30 02:42:57 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.active_storage_blobs' (2 of 66 tables) 2022-07-30 02:42:57 source > 2022-07-30 02:42:57 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.active_storage_blobs' using select statement: 'SELECT "id", "key", "filename", "content_type", "metadata", "byte_size", "checksum", "created_at", "service_name" FROM "public"."active_storage_blobs"' 2022-07-30 02:42:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 38000 (9 MB) 2022-07-30 02:42:58 source > 2022-07-30 02:42:57 INFO i.d.c.c.BaseSourceTask(logStatistics):182 - 2048 records sent during previous 00:00:12.896, last recorded offset: {last_snapshot_record=false, lsn=175422614568, txId=70657, ts_usec=1659148975384000, snapshot=true} 2022-07-30 02:42:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 39000 (9 MB) 2022-07-30 02:42:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 40000 (9 MB) 2022-07-30 02:42:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 41000 (9 MB) 2022-07-30 02:43:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 42000 (10 MB) 2022-07-30 02:43:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 43000 (10 MB) 2022-07-30 02:43:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 44000 (10 MB) 2022-07-30 02:43:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 45000 (10 MB) 2022-07-30 02:43:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 46000 (11 MB) 2022-07-30 02:43:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 47000 (11 MB) 2022-07-30 02:43:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 48000 (11 MB) 2022-07-30 02:43:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 49000 (11 MB) 2022-07-30 02:43:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 50000 (12 MB) 2022-07-30 02:43:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 51000 (12 MB) 2022-07-30 02:43:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 52000 (12 MB) 2022-07-30 02:43:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 53000 (12 MB) 2022-07-30 02:43:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 54000 (13 MB) 2022-07-30 02:43:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 55000 (13 MB) 2022-07-30 02:43:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 56000 (13 MB) 2022-07-30 02:43:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 57000 (13 MB) 2022-07-30 02:43:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 58000 (14 MB) 2022-07-30 02:43:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 59000 (14 MB) 2022-07-30 02:43:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 60000 (15 MB) 2022-07-30 02:43:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 61000 (15 MB) 2022-07-30 02:43:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 62000 (15 MB) 2022-07-30 02:43:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 63000 (16 MB) 2022-07-30 02:43:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 64000 (16 MB) 2022-07-30 02:43:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 65000 (17 MB) 2022-07-30 02:43:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 66000 (17 MB) 2022-07-30 02:43:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 67000 (17 MB) 2022-07-30 02:43:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 68000 (18 MB) 2022-07-30 02:43:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 69000 (18 MB) 2022-07-30 02:43:09 source > 2022-07-30 02:43:08 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):374 - Exported 30720 records for table 'public.active_storage_blobs' after 00:00:11.446 2022-07-30 02:43:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 70000 (19 MB) 2022-07-30 02:43:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 71000 (19 MB) 2022-07-30 02:43:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 72000 (19 MB) 2022-07-30 02:43:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 73000 (20 MB) 2022-07-30 02:43:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 74000 (20 MB) 2022-07-30 02:43:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 75000 (21 MB) 2022-07-30 02:43:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 76000 (21 MB) 2022-07-30 02:43:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 77000 (21 MB) 2022-07-30 02:43:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 78000 (22 MB) 2022-07-30 02:43:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 79000 (22 MB) 2022-07-30 02:43:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 80000 (23 MB) 2022-07-30 02:43:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 81000 (23 MB) 2022-07-30 02:43:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 82000 (24 MB) 2022-07-30 02:43:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 83000 (24 MB) 2022-07-30 02:43:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 84000 (24 MB) 2022-07-30 02:43:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 85000 (25 MB) 2022-07-30 02:43:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 86000 (25 MB) 2022-07-30 02:43:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 87000 (26 MB) 2022-07-30 02:43:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 88000 (26 MB) 2022-07-30 02:43:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 89000 (27 MB) 2022-07-30 02:43:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 90000 (27 MB) 2022-07-30 02:43:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 91000 (27 MB) 2022-07-30 02:43:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 92000 (28 MB) 2022-07-30 02:43:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 93000 (28 MB) 2022-07-30 02:43:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 94000 (29 MB) 2022-07-30 02:43:17 source > 2022-07-30 02:43:17 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 56461 records for table 'public.active_storage_blobs'; total duration '00:00:20.089' 2022-07-30 02:43:17 source > 2022-07-30 02:43:17 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.active_storage_variant_records' (3 of 66 tables) 2022-07-30 02:43:17 source > 2022-07-30 02:43:17 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.active_storage_variant_records' using select statement: 'SELECT "id", "blob_id", "variation_digest" FROM "public"."active_storage_variant_records"' 2022-07-30 02:43:17 source > 2022-07-30 02:43:17 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 0 records for table 'public.active_storage_variant_records'; total duration '00:00:00.004' 2022-07-30 02:43:17 source > 2022-07-30 02:43:17 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.ar_internal_metadata' (4 of 66 tables) 2022-07-30 02:43:17 source > 2022-07-30 02:43:17 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.ar_internal_metadata' using select statement: 'SELECT "key", "value", "created_at", "updated_at" FROM "public"."ar_internal_metadata"' 2022-07-30 02:43:17 source > 2022-07-30 02:43:17 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 1 records for table 'public.ar_internal_metadata'; total duration '00:00:00.005' 2022-07-30 02:43:17 source > 2022-07-30 02:43:17 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.buyer_contact_rules' (5 of 66 tables) 2022-07-30 02:43:17 source > 2022-07-30 02:43:17 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.buyer_contact_rules' using select statement: 'SELECT "id", "buyer_contact_id", "buyer_location_id", "order_id", "categories", "created_at", "updated_at" FROM "public"."buyer_contact_rules"' 2022-07-30 02:43:17 source > 2022-07-30 02:43:17 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 5 records for table 'public.buyer_contact_rules'; total duration '00:00:00.009' 2022-07-30 02:43:17 source > 2022-07-30 02:43:17 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.buyer_contacts' (6 of 66 tables) 2022-07-30 02:43:17 source > 2022-07-30 02:43:17 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.buyer_contacts' using select statement: 'SELECT "id", "buyer_id", "name", "email", "phone_number", "created_at", "updated_at" FROM "public"."buyer_contacts"' 2022-07-30 02:43:17 source > 2022-07-30 02:43:17 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 5 records for table 'public.buyer_contacts'; total duration '00:00:00.007' 2022-07-30 02:43:17 source > 2022-07-30 02:43:17 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.buyer_locations' (7 of 66 tables) 2022-07-30 02:43:17 source > 2022-07-30 02:43:17 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.buyer_locations' using select statement: 'SELECT "id", "location", "buyer_id", "created_at", "updated_at", "street", "address_details", "zipcode", "city", "state", "name", "lat", "lng", "google_place_id" FROM "public"."buyer_locations"' 2022-07-30 02:43:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 95000 (29 MB) 2022-07-30 02:43:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 96000 (29 MB) 2022-07-30 02:43:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 97000 (30 MB) 2022-07-30 02:43:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 98000 (30 MB) 2022-07-30 02:43:19 source > 2022-07-30 02:43:18 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 4168 records for table 'public.buyer_locations'; total duration '00:00:01.564' 2022-07-30 02:43:19 source > 2022-07-30 02:43:18 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.buyer_public_informations' (8 of 66 tables) 2022-07-30 02:43:19 source > 2022-07-30 02:43:18 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.buyer_public_informations' using select statement: 'SELECT "id", "type", "response", "buyer_id", "created_at", "updated_at", "score", "recommended_term_limit", "recommended_spend_limit" FROM "public"."buyer_public_informations"' 2022-07-30 02:43:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 99000 (31 MB) 2022-07-30 02:43:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 100000 (31 MB) 2022-07-30 02:43:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 101000 (32 MB) 2022-07-30 02:43:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 102000 (32 MB) 2022-07-30 02:43:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 103000 (32 MB) 2022-07-30 02:43:20 source > 2022-07-30 02:43:20 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 2011 records for table 'public.buyer_public_informations'; total duration '00:00:01.678' 2022-07-30 02:43:20 source > 2022-07-30 02:43:20 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.buyer_store_recommendations' (9 of 66 tables) 2022-07-30 02:43:20 source > 2022-07-30 02:43:20 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.buyer_store_recommendations' using select statement: 'SELECT "id", "buyer_id", "buyer_user_id", "store_id", "store_name", "contact_name", "store_email", "store_phone", "created_at", "updated_at" FROM "public"."buyer_store_recommendations"' 2022-07-30 02:43:20 source > 2022-07-30 02:43:20 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 1 records for table 'public.buyer_store_recommendations'; total duration '00:00:00.006' 2022-07-30 02:43:20 source > 2022-07-30 02:43:20 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.buyer_uploads' (10 of 66 tables) 2022-07-30 02:43:20 source > 2022-07-30 02:43:20 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.buyer_uploads' using select statement: 'SELECT "id", "buyer_id", "buyer_user_id", "file_type", "file_url", "done", "filename" FROM "public"."buyer_uploads"' 2022-07-30 02:43:20 source > 2022-07-30 02:43:20 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 14 records for table 'public.buyer_uploads'; total duration '00:00:00.008' 2022-07-30 02:43:20 source > 2022-07-30 02:43:20 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.buyer_users' (11 of 66 tables) 2022-07-30 02:43:20 source > 2022-07-30 02:43:20 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.buyer_users' using select statement: 'SELECT "id", "buyer_id", "name", "whatsapp", "spend_limit", "active", "created_at", "updated_at", "email", "encrypted_password", "reset_password_token", "reset_password_sent_at", "remember_created_at", "referral_code", "profile", "own_referral_code", "confirmation_token", "confirmed_at", "confirmation_sent_at", "unconfirmed_email", "stytch_user_id", "sign_in_count", "current_sign_in_at", "last_sign_in_at", "current_sign_in_ip", "last_sign_in_ip" FROM "public"."buyer_users"' 2022-07-30 02:43:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 104000 (33 MB) 2022-07-30 02:43:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 105000 (33 MB) 2022-07-30 02:43:21 source > 2022-07-30 02:43:21 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 1833 records for table 'public.buyer_users'; total duration '00:00:00.598' 2022-07-30 02:43:21 source > 2022-07-30 02:43:21 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.buyers' (12 of 66 tables) 2022-07-30 02:43:21 source > 2022-07-30 02:43:21 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.buyers' using select statement: 'SELECT "id", "state_registration", "municipal_registration", "business_name", "trading_name", "cnpj", "type_company", "average_monthly_spend", "created_at", "updated_at", "truora_unfiltered_data", "truora_current_irs_status", "truora_legal_type", "truora_started_on", "truora_address", "truora_size", "truora_business_name", "truora_trading_name", "truora_main_activities", "truora_check_id", "conta_azul", "location_city", "location_state", "default_payer_id", "financing_fee", "spend_limit", "wholesale", "new_orders_blocked", "max_term_days" FROM "public"."buyers"' 2022-07-30 02:43:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 106000 (34 MB) 2022-07-30 02:43:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 107000 (34 MB) 2022-07-30 02:43:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 108000 (35 MB) 2022-07-30 02:43:22 source > 2022-07-30 02:43:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 1201 records for table 'public.buyers'; total duration '00:00:00.992' 2022-07-30 02:43:22 source > 2022-07-30 02:43:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.categories' (13 of 66 tables) 2022-07-30 02:43:22 source > 2022-07-30 02:43:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.categories' using select statement: 'SELECT "id", "name", "created_at", "updated_at", "category_id", "level", "visible_on_store_sign_up" FROM "public"."categories"' 2022-07-30 02:43:22 source > 2022-07-30 02:43:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 43 records for table 'public.categories'; total duration '00:00:00.017' 2022-07-30 02:43:22 source > 2022-07-30 02:43:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.changebase_metadata' (14 of 66 tables) 2022-07-30 02:43:22 source > 2022-07-30 02:43:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.changebase_metadata' using select statement: 'SELECT "version", "data" FROM "public"."changebase_metadata"' 2022-07-30 02:43:22 source > 2022-07-30 02:43:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 0 records for table 'public.changebase_metadata'; total duration '00:00:00.004' 2022-07-30 02:43:22 source > 2022-07-30 02:43:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.faq' (15 of 66 tables) 2022-07-30 02:43:22 source > 2022-07-30 02:43:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.faq' using select statement: 'SELECT "id", "faq_category_id", "title", "description", "created_at", "updated_at" FROM "public"."faq"' 2022-07-30 02:43:22 source > 2022-07-30 02:43:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 23 records for table 'public.faq'; total duration '00:00:00.018' 2022-07-30 02:43:22 source > 2022-07-30 02:43:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.faq_categories' (16 of 66 tables) 2022-07-30 02:43:22 source > 2022-07-30 02:43:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.faq_categories' using select statement: 'SELECT "id", "name", "created_at", "updated_at" FROM "public"."faq_categories"' 2022-07-30 02:43:22 source > 2022-07-30 02:43:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 8 records for table 'public.faq_categories'; total duration '00:00:00.013' 2022-07-30 02:43:22 source > 2022-07-30 02:43:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.flipper_features' (17 of 66 tables) 2022-07-30 02:43:22 source > 2022-07-30 02:43:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.flipper_features' using select statement: 'SELECT "id", "key", "created_at", "updated_at" FROM "public"."flipper_features"' 2022-07-30 02:43:22 source > 2022-07-30 02:43:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 10 records for table 'public.flipper_features'; total duration '00:00:00.019' 2022-07-30 02:43:22 source > 2022-07-30 02:43:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.flipper_gates' (18 of 66 tables) 2022-07-30 02:43:22 source > 2022-07-30 02:43:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.flipper_gates' using select statement: 'SELECT "id", "feature_key", "key", "value", "created_at", "updated_at" FROM "public"."flipper_gates"' 2022-07-30 02:43:22 source > 2022-07-30 02:43:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 11 records for table 'public.flipper_gates'; total duration '00:00:00.011' 2022-07-30 02:43:22 source > 2022-07-30 02:43:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.freight_partner_vehicles' (19 of 66 tables) 2022-07-30 02:43:22 source > 2022-07-30 02:43:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.freight_partner_vehicles' using select statement: 'SELECT "id", "freight_vehicle_type_id", "freight_partner_id", "plate", "created_at", "updated_at", "start_location", "start_lat", "start_lng" FROM "public"."freight_partner_vehicles"' 2022-07-30 02:43:22 source > 2022-07-30 02:43:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 113 records for table 'public.freight_partner_vehicles'; total duration '00:00:00.073' 2022-07-30 02:43:22 source > 2022-07-30 02:43:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.freight_partners' (20 of 66 tables) 2022-07-30 02:43:22 source > 2022-07-30 02:43:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.freight_partners' using select statement: 'SELECT "id", "trading_name", "business_name", "cnpj", "cpf", "website", "point_of_contact", "email", "whatsapp", "payment_type", "created_at", "updated_at", "is_dedicated", "daily_fee", "active" FROM "public"."freight_partners"' 2022-07-30 02:43:22 source > 2022-07-30 02:43:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 99 records for table 'public.freight_partners'; total duration '00:00:00.027' 2022-07-30 02:43:22 source > 2022-07-30 02:43:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.freight_product_orders' (21 of 66 tables) 2022-07-30 02:43:22 source > 2022-07-30 02:43:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.freight_product_orders' using select statement: 'SELECT "id", "product_order_id", "freight_id", "quantity_in_freight", "internal_product_freight_note", "created_at", "updated_at" FROM "public"."freight_product_orders"' 2022-07-30 02:43:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 109000 (35 MB) 2022-07-30 02:43:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 110000 (35 MB) 2022-07-30 02:43:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 111000 (36 MB) 2022-07-30 02:43:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 112000 (36 MB) 2022-07-30 02:43:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 113000 (37 MB) 2022-07-30 02:43:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 114000 (37 MB) 2022-07-30 02:43:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 115000 (38 MB) 2022-07-30 02:43:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 116000 (38 MB) 2022-07-30 02:43:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 117000 (39 MB) 2022-07-30 02:43:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 118000 (43 MB) 2022-07-30 02:43:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 119000 (44 MB) 2022-07-30 02:43:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 120000 (44 MB) 2022-07-30 02:43:28 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:43:28 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:43:28 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:43:28 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:43:28 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:43:28 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:43:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 121000 (46 MB) 2022-07-30 02:43:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 122000 (47 MB) 2022-07-30 02:43:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 123000 (48 MB) 2022-07-30 02:43:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 124000 (48 MB) 2022-07-30 02:43:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 125000 (48 MB) 2022-07-30 02:43:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 126000 (49 MB) 2022-07-30 02:43:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 127000 (49 MB) 2022-07-30 02:43:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 128000 (49 MB) 2022-07-30 02:43:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 129000 (49 MB) 2022-07-30 02:43:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 130000 (50 MB) 2022-07-30 02:43:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 131000 (50 MB) 2022-07-30 02:43:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 132000 (50 MB) 2022-07-30 02:43:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 133000 (51 MB) 2022-07-30 02:43:32 source > 2022-07-30 02:43:32 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):374 - Exported 30303 records for table 'public.freight_product_orders' after 00:00:10.14 2022-07-30 02:43:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 134000 (51 MB) 2022-07-30 02:43:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 135000 (51 MB) 2022-07-30 02:43:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 136000 (52 MB) 2022-07-30 02:43:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 137000 (52 MB) 2022-07-30 02:43:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 138000 (52 MB) 2022-07-30 02:43:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 139000 (52 MB) 2022-07-30 02:43:34 source > 2022-07-30 02:43:34 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 35042 records for table 'public.freight_product_orders'; total duration '00:00:11.666' 2022-07-30 02:43:34 source > 2022-07-30 02:43:34 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.freight_route_groupings' (22 of 66 tables) 2022-07-30 02:43:34 source > 2022-07-30 02:43:34 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.freight_route_groupings' using select statement: 'SELECT "id", "created_at", "updated_at", "freight_id", "freight_route_id", "delivery_note_link" FROM "public"."freight_route_groupings"' 2022-07-30 02:43:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 140000 (53 MB) 2022-07-30 02:43:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 141000 (53 MB) 2022-07-30 02:43:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 142000 (53 MB) 2022-07-30 02:43:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 143000 (54 MB) 2022-07-30 02:43:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 144000 (54 MB) 2022-07-30 02:43:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 145000 (54 MB) 2022-07-30 02:43:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 146000 (54 MB) 2022-07-30 02:43:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 147000 (55 MB) 2022-07-30 02:43:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 148000 (55 MB) 2022-07-30 02:43:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 149000 (55 MB) 2022-07-30 02:43:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 150000 (56 MB) 2022-07-30 02:43:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 151000 (56 MB) 2022-07-30 02:43:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 152000 (56 MB) 2022-07-30 02:43:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 153000 (56 MB) 2022-07-30 02:43:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 154000 (57 MB) 2022-07-30 02:43:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 155000 (57 MB) 2022-07-30 02:43:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 156000 (57 MB) 2022-07-30 02:43:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 157000 (58 MB) 2022-07-30 02:43:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 158000 (58 MB) 2022-07-30 02:43:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 159000 (58 MB) 2022-07-30 02:43:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 160000 (58 MB) 2022-07-30 02:43:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 161000 (59 MB) 2022-07-30 02:43:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 162000 (59 MB) 2022-07-30 02:43:40 source > 2022-07-30 02:43:39 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 24000 records for table 'public.freight_route_groupings'; total duration '00:00:05.573' 2022-07-30 02:43:40 source > 2022-07-30 02:43:39 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.freight_route_partner_costs' (23 of 66 tables) 2022-07-30 02:43:40 source > 2022-07-30 02:43:39 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.freight_route_partner_costs' using select statement: 'SELECT "id", "is_dedicated", "delivery_work_start_at", "delivery_work_end_at", "cost", "extra_cost", "total_cost", "extra_cost_details", "freight_partner_id", "created_at", "updated_at" FROM "public"."freight_route_partner_costs"' 2022-07-30 02:43:40 source > 2022-07-30 02:43:39 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 73 records for table 'public.freight_route_partner_costs'; total duration '00:00:00.024' 2022-07-30 02:43:40 source > 2022-07-30 02:43:39 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.freight_routes' (24 of 66 tables) 2022-07-30 02:43:40 source > 2022-07-30 02:43:39 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.freight_routes' using select statement: 'SELECT "id", "pipefy_id", "freight_price", "freight_partner_external_id", "freight_scheduled_delivery_datetime", "freight_actual_delivery_datetime", "freight_tracking_link", "freight_delivery_point_of_contact", "freight_delivery_poc_phone", "client_delivery_notes", "product_problems", "delivery_problems", "created_at", "updated_at", "shareable_link_hash", "freight_partner_vehicle_id", "sequence", "freight_partner_dedicated_when_associated", "total_distance", "freight_route_partner_cost_id" FROM "public"."freight_routes"' 2022-07-30 02:43:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 163000 (60 MB) 2022-07-30 02:43:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 164000 (60 MB) 2022-07-30 02:43:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 165000 (60 MB) 2022-07-30 02:43:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 166000 (60 MB) 2022-07-30 02:43:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 167000 (61 MB) 2022-07-30 02:43:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 168000 (62 MB) 2022-07-30 02:43:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 169000 (63 MB) 2022-07-30 02:43:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 170000 (63 MB) 2022-07-30 02:43:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 171000 (64 MB) 2022-07-30 02:43:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 172000 (65 MB) 2022-07-30 02:43:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 173000 (66 MB) 2022-07-30 02:43:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 174000 (66 MB) 2022-07-30 02:43:44 source > 2022-07-30 02:43:44 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 9577 records for table 'public.freight_routes'; total duration '00:00:04.29' 2022-07-30 02:43:44 source > 2022-07-30 02:43:44 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.freight_vehicle_types' (25 of 66 tables) 2022-07-30 02:43:44 source > 2022-07-30 02:43:44 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.freight_vehicle_types' using select statement: 'SELECT "id", "name", "description", "capacity_in_kg", "max_height", "max_lenght", "max_width", "created_at", "updated_at" FROM "public"."freight_vehicle_types"' 2022-07-30 02:43:44 source > 2022-07-30 02:43:44 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 22 records for table 'public.freight_vehicle_types'; total duration '00:00:00.01' 2022-07-30 02:43:44 source > 2022-07-30 02:43:44 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.freights' (26 of 66 tables) 2022-07-30 02:43:44 source > 2022-07-30 02:43:44 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.freights' using select statement: 'SELECT "id", "order_id", "store_location_id", "buyer_location_id", "freight_scheduled_pickup_time", "freight_actual_pickup_time", "client_delivery_notes", "internal_delivery_notes", "created_at", "updated_at", "freight_weight", "reverse_freight", "target_delivery_datetime", "actual_delivery_datetime", "estimated_arrival_delivery_datetime", "delivered", "received_by", "store_quote_id", "notified_at", "arrived_at_pick_up_location_at", "picked_up_at", "arrived_at_drop_off_location_at", "distance" FROM "public"."freights"' 2022-07-30 02:43:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 175000 (67 MB) 2022-07-30 02:43:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 176000 (68 MB) 2022-07-30 02:43:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 177000 (69 MB) 2022-07-30 02:43:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 178000 (69 MB) 2022-07-30 02:43:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 179000 (70 MB) 2022-07-30 02:43:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 180000 (71 MB) 2022-07-30 02:43:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 181000 (72 MB) 2022-07-30 02:43:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 182000 (73 MB) 2022-07-30 02:43:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 183000 (74 MB) 2022-07-30 02:43:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 184000 (75 MB) 2022-07-30 02:43:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 185000 (75 MB) 2022-07-30 02:43:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 186000 (76 MB) 2022-07-30 02:43:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 187000 (77 MB) 2022-07-30 02:43:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 188000 (78 MB) 2022-07-30 02:43:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 189000 (81 MB) 2022-07-30 02:43:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 190000 (84 MB) 2022-07-30 02:43:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 191000 (87 MB) 2022-07-30 02:43:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 192000 (87 MB) 2022-07-30 02:43:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 193000 (88 MB) 2022-07-30 02:43:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 194000 (89 MB) 2022-07-30 02:43:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 195000 (90 MB) 2022-07-30 02:43:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 196000 (91 MB) 2022-07-30 02:43:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 197000 (91 MB) 2022-07-30 02:43:54 source > 2022-07-30 02:43:53 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 25242 records for table 'public.freights'; total duration '00:00:09.689' 2022-07-30 02:43:54 source > 2022-07-30 02:43:53 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.heya_campaign_memberships' (27 of 66 tables) 2022-07-30 02:43:54 source > 2022-07-30 02:43:53 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.heya_campaign_memberships' using select statement: 'SELECT "id", "user_type", "user_id", "campaign_gid", "step_gid", "concurrent", "last_sent_at", "created_at", "updated_at" FROM "public"."heya_campaign_memberships"' 2022-07-30 02:43:54 source > 2022-07-30 02:43:53 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 14 records for table 'public.heya_campaign_memberships'; total duration '00:00:00.013' 2022-07-30 02:43:54 source > 2022-07-30 02:43:53 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.heya_campaign_receipts' (28 of 66 tables) 2022-07-30 02:43:54 source > 2022-07-30 02:43:53 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.heya_campaign_receipts' using select statement: 'SELECT "id", "user_type", "user_id", "step_gid", "sent_at", "created_at", "updated_at" FROM "public"."heya_campaign_receipts"' 2022-07-30 02:43:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 198000 (92 MB) 2022-07-30 02:43:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 199000 (93 MB) 2022-07-30 02:43:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 200000 (94 MB) 2022-07-30 02:43:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 201000 (95 MB) 2022-07-30 02:43:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 202000 (95 MB) 2022-07-30 02:43:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 203000 (96 MB) 2022-07-30 02:43:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 204000 (97 MB) 2022-07-30 02:43:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 205000 (98 MB) 2022-07-30 02:43:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 206000 (99 MB) 2022-07-30 02:43:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 207000 (99 MB) 2022-07-30 02:43:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 208000 (100 MB) 2022-07-30 02:43:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 209000 (101 MB) 2022-07-30 02:43:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 210000 (102 MB) 2022-07-30 02:44:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 211000 (103 MB) 2022-07-30 02:44:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 212000 (104 MB) 2022-07-30 02:44:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 213000 (105 MB) 2022-07-30 02:44:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 214000 (105 MB) 2022-07-30 02:44:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 215000 (106 MB) 2022-07-30 02:44:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 216000 (107 MB) 2022-07-30 02:44:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 217000 (108 MB) 2022-07-30 02:44:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 218000 (108 MB) 2022-07-30 02:44:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 219000 (108 MB) 2022-07-30 02:44:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 220000 (109 MB) 2022-07-30 02:44:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 221000 (109 MB) 2022-07-30 02:44:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 222000 (109 MB) 2022-07-30 02:44:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 223000 (110 MB) 2022-07-30 02:44:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 224000 (110 MB) 2022-07-30 02:44:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 225000 (111 MB) 2022-07-30 02:44:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 226000 (111 MB) 2022-07-30 02:44:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 227000 (111 MB) 2022-07-30 02:44:05 source > 2022-07-30 02:44:04 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):374 - Exported 29104 records for table 'public.heya_campaign_receipts' after 00:00:10.325 2022-07-30 02:44:05 source > 2022-07-30 02:44:04 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 30676 records for table 'public.heya_campaign_receipts'; total duration '00:00:10.459' 2022-07-30 02:44:05 source > 2022-07-30 02:44:04 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.location_store_products' (29 of 66 tables) 2022-07-30 02:44:05 source > 2022-07-30 02:44:04 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.location_store_products' using select statement: 'SELECT "id", "product_id", "store_location_id", "created_at", "updated_at", "pipefy_id", "pipefy_store_location_id", "pipefy_product_store_id" FROM "public"."location_store_products"' 2022-07-30 02:44:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 228000 (112 MB) 2022-07-30 02:44:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 229000 (112 MB) 2022-07-30 02:44:05 source > 2022-07-30 02:44:04 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 1244 records for table 'public.location_store_products'; total duration '00:00:00.259' 2022-07-30 02:44:05 source > 2022-07-30 02:44:04 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.memento_sessions' (30 of 66 tables) 2022-07-30 02:44:05 source > 2022-07-30 02:44:04 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.memento_sessions' using select statement: 'SELECT "id", "user_id", "created_at", "updated_at" FROM "public"."memento_sessions"' 2022-07-30 02:44:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 230000 (112 MB) 2022-07-30 02:44:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 231000 (113 MB) 2022-07-30 02:44:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 232000 (113 MB) 2022-07-30 02:44:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 233000 (113 MB) 2022-07-30 02:44:07 source > 2022-07-30 02:44:05 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 3370 records for table 'public.memento_sessions'; total duration '00:00:01.097' 2022-07-30 02:44:07 source > 2022-07-30 02:44:05 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.memento_states' (31 of 66 tables) 2022-07-30 02:44:07 source > 2022-07-30 02:44:05 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.memento_states' using select statement: 'SELECT "id", "action_type", "record_data", "record_type", "record_id", "session_id", "created_at", "updated_at" FROM "public"."memento_states"' 2022-07-30 02:44:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 234000 (114 MB) 2022-07-30 02:44:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 235000 (114 MB) 2022-07-30 02:44:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 236000 (115 MB) 2022-07-30 02:44:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 237000 (115 MB) 2022-07-30 02:44:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 238000 (115 MB) 2022-07-30 02:44:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 239000 (116 MB) 2022-07-30 02:44:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 240000 (116 MB) 2022-07-30 02:44:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 241000 (116 MB) 2022-07-30 02:44:09 source > 2022-07-30 02:44:08 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 9238 records for table 'public.memento_states'; total duration '00:00:02.431' 2022-07-30 02:44:09 source > 2022-07-30 02:44:08 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.oico_radar_products' (32 of 66 tables) 2022-07-30 02:44:09 source > 2022-07-30 02:44:08 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.oico_radar_products' using select statement: 'SELECT "id", "oico_radar_id", "product_canonical_id", "price", "created_at", "updated_at" FROM "public"."oico_radar_products"' 2022-07-30 02:44:09 source > 2022-07-30 02:44:08 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 7 records for table 'public.oico_radar_products'; total duration '00:00:00.007' 2022-07-30 02:44:09 source > 2022-07-30 02:44:08 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.oico_radars' (33 of 66 tables) 2022-07-30 02:44:09 source > 2022-07-30 02:44:08 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.oico_radars' using select statement: 'SELECT "id", "buyer_user_id", "name", "document", "phone_number", "email", "created_at", "updated_at", "notify_terms", "shareable_link_hash" FROM "public"."oico_radars"' 2022-07-30 02:44:09 source > 2022-07-30 02:44:08 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 3 records for table 'public.oico_radars'; total duration '00:00:00.006' 2022-07-30 02:44:09 source > 2022-07-30 02:44:08 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.oico_users' (34 of 66 tables) 2022-07-30 02:44:09 source > 2022-07-30 02:44:08 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.oico_users' using select statement: 'SELECT "id", "email", "encrypted_password", "reset_password_token", "reset_password_sent_at", "remember_created_at", "created_at", "updated_at", "active" FROM "public"."oico_users"' 2022-07-30 02:44:09 source > 2022-07-30 02:44:08 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 13 records for table 'public.oico_users'; total duration '00:00:00.005' 2022-07-30 02:44:09 source > 2022-07-30 02:44:08 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.omie_accounts' (35 of 66 tables) 2022-07-30 02:44:09 source > 2022-07-30 02:44:08 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.omie_accounts' using select statement: 'SELECT "id", "name", "document", "credential", "created_at", "updated_at" FROM "public"."omie_accounts"' 2022-07-30 02:44:09 source > 2022-07-30 02:44:08 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 1 records for table 'public.omie_accounts'; total duration '00:00:00.005' 2022-07-30 02:44:09 source > 2022-07-30 02:44:08 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.order_categories' (36 of 66 tables) 2022-07-30 02:44:09 source > 2022-07-30 02:44:08 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.order_categories' using select statement: 'SELECT "id", "order_id", "category_id", "created_at", "updated_at" FROM "public"."order_categories"' 2022-07-30 02:44:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 242000 (117 MB) 2022-07-30 02:44:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 243000 (117 MB) 2022-07-30 02:44:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 244000 (117 MB) 2022-07-30 02:44:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 245000 (118 MB) 2022-07-30 02:44:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 246000 (118 MB) 2022-07-30 02:44:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 247000 (119 MB) 2022-07-30 02:44:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 248000 (119 MB) 2022-07-30 02:44:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 249000 (119 MB) 2022-07-30 02:44:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 250000 (119 MB) 2022-07-30 02:44:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 251000 (119 MB) 2022-07-30 02:44:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 252000 (120 MB) 2022-07-30 02:44:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 253000 (120 MB) 2022-07-30 02:44:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 254000 (121 MB) 2022-07-30 02:44:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 255000 (121 MB) 2022-07-30 02:44:13 source > 2022-07-30 02:44:12 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 13725 records for table 'public.order_categories'; total duration '00:00:03.834' 2022-07-30 02:44:13 source > 2022-07-30 02:44:12 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.order_feedbacks' (37 of 66 tables) 2022-07-30 02:44:13 source > 2022-07-30 02:44:12 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.order_feedbacks' using select statement: 'SELECT "id", "order_id", "type", "liked", "created_at", "updated_at" FROM "public"."order_feedbacks"' 2022-07-30 02:44:13 source > 2022-07-30 02:44:12 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 324 records for table 'public.order_feedbacks'; total duration '00:00:00.015' 2022-07-30 02:44:13 source > 2022-07-30 02:44:12 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.order_issues' (38 of 66 tables) 2022-07-30 02:44:13 source > 2022-07-30 02:44:12 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.order_issues' using select statement: 'SELECT "id", "order_id", "buyer_user_id", "type", "delivery_problems", "product_problems", "created_at", "updated_at", "description", "status", "confirmed_at", "canceled_at" FROM "public"."order_issues"' 2022-07-30 02:44:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 256000 (122 MB) 2022-07-30 02:44:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 257000 (122 MB) 2022-07-30 02:44:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 258000 (123 MB) 2022-07-30 02:44:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 259000 (123 MB) 2022-07-30 02:44:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 260000 (124 MB) 2022-07-30 02:44:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 261000 (124 MB) 2022-07-30 02:44:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 262000 (125 MB) 2022-07-30 02:44:15 source > 2022-07-30 02:44:14 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 6547 records for table 'public.order_issues'; total duration '00:00:01.57' 2022-07-30 02:44:15 source > 2022-07-30 02:44:14 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.orders' (39 of 66 tables) 2022-07-30 02:44:15 source > 2022-07-30 02:44:14 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.orders' using select statement: 'SELECT "id", "buyer_user_id", "buyer_location_id", "expected_date", "oico_invoice", "shopping_list_url", "created_at", "updated_at", "status", "identify", "freight_code", "freight_link", "buyer_id", "value", "freight_value", "final_value", "client_order_form", "pipefy_id", "expected_time", "fast_delivery", "approved_at", "conta_azul", "order_form", "expected_period", "flexible_delivery", "payer_id", "last_quote", "cancelation_reason", "cancelation_comment", "shareable_link_hash", "internal_notes", "discount", "first_quote_sent_at", "client_internal_id", "client_notes", "canceled_at", "comment", "po_file_url", "money_saving", "quote", "quote_estimate", "automatic_quote", "parent_order_id", "internal_delivery_notes", "type", "origin", "events", "expected_billing_due_date", "financing_value", "po_value", "more_payment_terms", "quote_expires_at", "user_preference", "payment_method", "last_rdo_scheduling_message_sent_at" FROM "public"."orders"' 2022-07-30 02:44:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 263000 (125 MB) 2022-07-30 02:44:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 264000 (125 MB) 2022-07-30 02:44:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 265000 (125 MB) 2022-07-30 02:44:16 source > 2022-07-30 02:44:14 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:14 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:14 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '00:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:14 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '18:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:14 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '15:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:14 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '00:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:14 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '02:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:14 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:14 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:14 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:14 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:30:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:14 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:14 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '18:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:14 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '17:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:30:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:30:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '17:50:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:41:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '20:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '09:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '20:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '20:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 266000 (126 MB) 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '09:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '08:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '18:45:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '10:30:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:40:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '14:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '17:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '15:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '09:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:45:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:30:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '08:00:00' to LocalDateTime type 2022-07-30 02:44:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 267000 (126 MB) 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:30:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '15:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:30:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '14:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:30:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '15:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:30:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:30:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '08:00:00' to LocalDateTime type 2022-07-30 02:44:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 268000 (126 MB) 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:16 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:17 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '15:00:00' to LocalDateTime type 2022-07-30 02:44:17 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '09:00:00' to LocalDateTime type 2022-07-30 02:44:17 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '08:00:00' to LocalDateTime type 2022-07-30 02:44:17 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:02:00' to LocalDateTime type 2022-07-30 02:44:17 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '15:00:00' to LocalDateTime type 2022-07-30 02:44:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 269000 (126 MB) 2022-07-30 02:44:17 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:30:00' to LocalDateTime type 2022-07-30 02:44:17 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '08:00:00' to LocalDateTime type 2022-07-30 02:44:17 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:30:00' to LocalDateTime type 2022-07-30 02:44:17 source > 2022-07-30 02:44:15 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:00:00' to LocalDateTime type 2022-07-30 02:44:17 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '14:00:00' to LocalDateTime type 2022-07-30 02:44:17 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:30:00' to LocalDateTime type 2022-07-30 02:44:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 270000 (126 MB) 2022-07-30 02:44:17 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:17 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:17 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:17 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:17 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 271000 (127 MB) 2022-07-30 02:44:17 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '09:00:00' to LocalDateTime type 2022-07-30 02:44:17 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:30:00' to LocalDateTime type 2022-07-30 02:44:17 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:17 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:17 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:30:00' to LocalDateTime type 2022-07-30 02:44:17 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:30:00' to LocalDateTime type 2022-07-30 02:44:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 272000 (127 MB) 2022-07-30 02:44:17 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:47:00' to LocalDateTime type 2022-07-30 02:44:17 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:17 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '02:00:00' to LocalDateTime type 2022-07-30 02:44:17 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:17 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:17 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '17:00:00' to LocalDateTime type 2022-07-30 02:44:17 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:30:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:30:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 273000 (127 MB) 2022-07-30 02:44:18 source > 2022-07-30 02:44:16 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '17:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '09:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '17:30:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '18:30:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:30:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:30:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '18:40:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '17:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '19:13:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '10:30:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:30:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '15:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:20:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '14:30:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '10:45:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '15:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '17:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:45:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:30:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '15:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:15:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '06:00:00' to LocalDateTime type 2022-07-30 02:44:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 274000 (127 MB) 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '09:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:30:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '00:30:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '08:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 INFO i.d.c.c.BaseSourceTask(logStatistics):182 - 2048 records sent during previous 00:01:19.549, last recorded offset: {last_snapshot_record=false, lsn=175422614568, txId=70657, ts_usec=1659149056930000, snapshot=true} 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '14:30:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '01:39:30' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '08:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '21:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '09:00:00' to LocalDateTime type 2022-07-30 02:44:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 275000 (128 MB) 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:49:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '17:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '15:30:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:18 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '17:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '17:00:00' to LocalDateTime type 2022-07-30 02:44:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 276000 (128 MB) 2022-07-30 02:44:19 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '14:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '18:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:40:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '14:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '17:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '14:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '17:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '18:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '14:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '18:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:17 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '15:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '17:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '17:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '18:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '21:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '19:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '17:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '15:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '10:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '20:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '15:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '17:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 277000 (129 MB) 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '17:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '15:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '15:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '14:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '19:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '20:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '08:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '08:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '10:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '09:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '18:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '09:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '08:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '09:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:30:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '09:00:00' to LocalDateTime type 2022-07-30 02:44:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 278000 (129 MB) 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '19:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '08:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '09:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '09:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '09:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '21:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '09:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '09:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '15:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '09:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 279000 (129 MB) 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:19 source > 2022-07-30 02:44:18 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '08:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:30:00' to LocalDateTime type 2022-07-30 02:44:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 280000 (130 MB) 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:30:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '08:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '15:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '14:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:29:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '17:30:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '16:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:30:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:30:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '20:00:00' to LocalDateTime type 2022-07-30 02:44:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 281000 (130 MB) 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '20:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:30:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:20 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:20 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:20 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:20 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:20 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:20 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:20 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:20 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:20 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:20 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:20 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:20 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:20 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:20 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:20 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '19:13:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:30:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:30:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '15:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:30:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '15:30:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '11:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '13:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:19 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:20 source > 2022-07-30 02:44:20 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 282000 (132 MB) 2022-07-30 02:44:21 source > 2022-07-30 02:44:20 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '08:00:00' to LocalDateTime type 2022-07-30 02:44:21 source > 2022-07-30 02:44:20 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:21 source > 2022-07-30 02:44:20 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '08:00:00' to LocalDateTime type 2022-07-30 02:44:21 source > 2022-07-30 02:44:20 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '08:00:00' to LocalDateTime type 2022-07-30 02:44:21 source > 2022-07-30 02:44:20 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:21 source > 2022-07-30 02:44:20 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '12:00:00' to LocalDateTime type 2022-07-30 02:44:21 source > 2022-07-30 02:44:20 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '08:00:00' to LocalDateTime type 2022-07-30 02:44:21 source > 2022-07-30 02:44:20 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '10:00:00' to LocalDateTime type 2022-07-30 02:44:21 source > 2022-07-30 02:44:20 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '09:00:00' to LocalDateTime type 2022-07-30 02:44:21 source > 2022-07-30 02:44:20 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '08:00:00' to LocalDateTime type 2022-07-30 02:44:21 source > 2022-07-30 02:44:20 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '08:00:00' to LocalDateTime type 2022-07-30 02:44:21 source > 2022-07-30 02:44:20 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '10:00:00' to LocalDateTime type 2022-07-30 02:44:21 source > 2022-07-30 02:44:20 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '10:00:00' to LocalDateTime type 2022-07-30 02:44:21 source > 2022-07-30 02:44:20 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '09:00:00' to LocalDateTime type 2022-07-30 02:44:21 source > 2022-07-30 02:44:20 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '10:00:00' to LocalDateTime type 2022-07-30 02:44:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 283000 (134 MB) 2022-07-30 02:44:21 source > 2022-07-30 02:44:21 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '08:00:00' to LocalDateTime type 2022-07-30 02:44:21 source > 2022-07-30 02:44:21 WARN i.a.i.d.i.DebeziumConverterUtils(convertDate):52 - Cannot convert value '22:30:00' to LocalDateTime type 2022-07-30 02:44:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 284000 (136 MB) 2022-07-30 02:44:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 285000 (139 MB) 2022-07-30 02:44:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 286000 (141 MB) 2022-07-30 02:44:23 source > 2022-07-30 02:44:23 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 17858 records for table 'public.orders'; total duration '00:00:09.209' 2022-07-30 02:44:23 source > 2022-07-30 02:44:23 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.payer_buyer_locations' (40 of 66 tables) 2022-07-30 02:44:23 source > 2022-07-30 02:44:23 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.payer_buyer_locations' using select statement: 'SELECT "id", "buyer_location_id", "payer_id", "created_at", "updated_at", "buyer_id" FROM "public"."payer_buyer_locations"' 2022-07-30 02:44:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 287000 (143 MB) 2022-07-30 02:44:24 source > 2022-07-30 02:44:23 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 4868 records for table 'public.payer_buyer_locations'; total duration '00:00:00.451' 2022-07-30 02:44:24 source > 2022-07-30 02:44:23 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.payers' (41 of 66 tables) 2022-07-30 02:44:24 source > 2022-07-30 02:44:23 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.payers' using select statement: 'SELECT "id", "cnpj", "cpf", "name", "billing_address", "phone_number", "email", "payment_terms_days", "credit_limit", "created_at", "updated_at", "payer_confirmed", "payer_confirmed_at", "conta_azul", "internal_notes", "omie_id", "cnae", "activity", "national_simple", "bank_code", "bank_branch", "bank_account", "bank_account_check_digit", "bank_account_holder_name", "bank_account_holder_document", "billing_address_state", "billing_address_city", "billing_address_street", "billing_address_district", "billing_address_zipcode", "state_registration", "tax_mode_simples", "final_consumer" FROM "public"."payers"' 2022-07-30 02:44:27 source > 2022-07-30 02:44:25 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 1936 records for table 'public.payers'; total duration '00:00:01.4' 2022-07-30 02:44:27 source > 2022-07-30 02:44:25 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.payment_installments' (42 of 66 tables) 2022-07-30 02:44:29 source > 2022-07-30 02:44:25 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.payment_installments' using select statement: 'SELECT "id", "payment_id", "status", "installment_value", "installment_number", "due_date", "paid_at", "canceled_at", "created_at", "updated_at", "advance_payment", "type", "external_identify", "link", "metadata", "transfeera_batch_id", "receipt_url", "bank_receipt_url", "paid_value", "original_due_date" FROM "public"."payment_installments"' 2022-07-30 02:44:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 288000 (160 MB) 2022-07-30 02:44:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 289000 (162 MB) 2022-07-30 02:44:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 290000 (164 MB) 2022-07-30 02:44:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 291000 (167 MB) 2022-07-30 02:44:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 292000 (170 MB) 2022-07-30 02:44:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 293000 (172 MB) 2022-07-30 02:44:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 294000 (174 MB) 2022-07-30 02:44:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 295000 (176 MB) 2022-07-30 02:44:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 296000 (178 MB) 2022-07-30 02:44:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 297000 (180 MB) 2022-07-30 02:44:36 source > 2022-07-30 02:44:35 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):374 - Exported 10109 records for table 'public.payment_installments' after 00:00:10.453 2022-07-30 02:44:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 298000 (182 MB) 2022-07-30 02:44:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 299000 (184 MB) 2022-07-30 02:44:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 300000 (184 MB) 2022-07-30 02:44:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 301000 (184 MB) 2022-07-30 02:44:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 302000 (185 MB) 2022-07-30 02:44:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 303000 (185 MB) 2022-07-30 02:44:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 304000 (185 MB) 2022-07-30 02:44:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 305000 (186 MB) 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 ERROR c.n.s.DateTimeValidator(isLegalDateTime):91 - The supplied date/time format type does not match the specification, expected: date 2022-07-30 02:44:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 306000 (187 MB) 2022-07-30 02:44:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 307000 (188 MB) 2022-07-30 02:44:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 308000 (189 MB) 2022-07-30 02:44:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 309000 (189 MB) 2022-07-30 02:44:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 310000 (190 MB) 2022-07-30 02:44:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 311000 (191 MB) 2022-07-30 02:44:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 312000 (192 MB) 2022-07-30 02:44:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 313000 (192 MB) 2022-07-30 02:44:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 314000 (193 MB) 2022-07-30 02:44:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 315000 (194 MB) 2022-07-30 02:44:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 316000 (195 MB) 2022-07-30 02:44:43 source > 2022-07-30 02:44:42 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 29117 records for table 'public.payment_installments'; total duration '00:00:17.418' 2022-07-30 02:44:43 source > 2022-07-30 02:44:42 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.payments' (43 of 66 tables) 2022-07-30 02:44:43 source > 2022-07-30 02:44:42 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.payments' using select statement: 'SELECT "id", "order_id", "payer_id", "store_id", "freight_partner_id", "type", "status", "tax_document_number", "tax_document_link", "purchase_order_id", "purchase_order_link", "payment_value", "paid_value", "tax_note_issued_at", "created_at", "updated_at", "xml_link", "discount", "extra_fees", "omie_id", "canceled_at", "created_by", "postmark_message_id", "postmark_read_at", "omie_account_id" FROM "public"."payments"' 2022-07-30 02:44:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 317000 (195 MB) 2022-07-30 02:44:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 318000 (196 MB) 2022-07-30 02:44:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 319000 (197 MB) 2022-07-30 02:44:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 320000 (198 MB) 2022-07-30 02:44:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 321000 (198 MB) 2022-07-30 02:44:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 322000 (199 MB) 2022-07-30 02:44:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 323000 (200 MB) 2022-07-30 02:44:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 324000 (200 MB) 2022-07-30 02:44:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 325000 (201 MB) 2022-07-30 02:44:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 326000 (202 MB) 2022-07-30 02:44:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 327000 (202 MB) 2022-07-30 02:44:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 328000 (203 MB) 2022-07-30 02:44:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 329000 (204 MB) 2022-07-30 02:44:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 330000 (205 MB) 2022-07-30 02:44:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 331000 (206 MB) 2022-07-30 02:44:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 332000 (206 MB) 2022-07-30 02:44:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 333000 (207 MB) 2022-07-30 02:44:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 334000 (208 MB) 2022-07-30 02:44:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 335000 (209 MB) 2022-07-30 02:44:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 336000 (210 MB) 2022-07-30 02:44:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 337000 (210 MB) 2022-07-30 02:44:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 338000 (211 MB) 2022-07-30 02:44:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 339000 (212 MB) 2022-07-30 02:44:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 340000 (213 MB) 2022-07-30 02:44:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 341000 (214 MB) 2022-07-30 02:44:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 342000 (215 MB) 2022-07-30 02:44:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 343000 (215 MB) 2022-07-30 02:44:53 source > 2022-07-30 02:44:52 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):374 - Exported 26450 records for table 'public.payments' after 00:00:10.1 2022-07-30 02:44:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 344000 (216 MB) 2022-07-30 02:44:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 345000 (217 MB) 2022-07-30 02:44:54 source > 2022-07-30 02:44:54 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 28660 records for table 'public.payments'; total duration '00:00:11.343' 2022-07-30 02:44:54 source > 2022-07-30 02:44:54 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.popular_searches' (44 of 66 tables) 2022-07-30 02:44:54 source > 2022-07-30 02:44:54 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.popular_searches' using select statement: 'SELECT "id", "name", "created_at", "updated_at" FROM "public"."popular_searches"' 2022-07-30 02:44:54 source > 2022-07-30 02:44:54 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 6 records for table 'public.popular_searches'; total duration '00:00:00.007' 2022-07-30 02:44:54 source > 2022-07-30 02:44:54 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.product_canonical_categories' (45 of 66 tables) 2022-07-30 02:44:54 source > 2022-07-30 02:44:54 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.product_canonical_categories' using select statement: 'SELECT "id", "product_canonical_id", "category_id", "created_at", "updated_at" FROM "public"."product_canonical_categories"' 2022-07-30 02:44:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 346000 (218 MB) 2022-07-30 02:44:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 347000 (219 MB) 2022-07-30 02:44:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 348000 (220 MB) 2022-07-30 02:44:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 349000 (221 MB) 2022-07-30 02:44:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 350000 (222 MB) 2022-07-30 02:44:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 351000 (223 MB) 2022-07-30 02:44:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 352000 (223 MB) 2022-07-30 02:44:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 353000 (224 MB) 2022-07-30 02:44:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 354000 (225 MB) 2022-07-30 02:44:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 355000 (226 MB) 2022-07-30 02:44:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 356000 (228 MB) 2022-07-30 02:44:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 357000 (229 MB) 2022-07-30 02:44:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 358000 (230 MB) 2022-07-30 02:44:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 359000 (231 MB) 2022-07-30 02:45:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 360000 (232 MB) 2022-07-30 02:45:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 361000 (233 MB) 2022-07-30 02:45:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 362000 (233 MB) 2022-07-30 02:45:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 363000 (234 MB) 2022-07-30 02:45:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 364000 (235 MB) 2022-07-30 02:45:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 365000 (235 MB) 2022-07-30 02:45:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 366000 (235 MB) 2022-07-30 02:45:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 367000 (236 MB) 2022-07-30 02:45:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 368000 (236 MB) 2022-07-30 02:45:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 369000 (236 MB) 2022-07-30 02:45:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 370000 (236 MB) 2022-07-30 02:45:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 371000 (237 MB) 2022-07-30 02:45:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 372000 (237 MB) 2022-07-30 02:45:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 373000 (237 MB) 2022-07-30 02:45:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 374000 (237 MB) 2022-07-30 02:45:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 375000 (238 MB) 2022-07-30 02:45:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 376000 (238 MB) 2022-07-30 02:45:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 377000 (238 MB) 2022-07-30 02:45:05 source > 2022-07-30 02:45:04 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):374 - Exported 32198 records for table 'public.product_canonical_categories' after 00:00:10.378 2022-07-30 02:45:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 378000 (238 MB) 2022-07-30 02:45:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 379000 (238 MB) 2022-07-30 02:45:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 380000 (239 MB) 2022-07-30 02:45:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 381000 (239 MB) 2022-07-30 02:45:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 382000 (239 MB) 2022-07-30 02:45:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 383000 (239 MB) 2022-07-30 02:45:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 384000 (240 MB) 2022-07-30 02:45:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 385000 (240 MB) 2022-07-30 02:45:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 386000 (240 MB) 2022-07-30 02:45:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 387000 (240 MB) 2022-07-30 02:45:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 388000 (241 MB) 2022-07-30 02:45:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 389000 (241 MB) 2022-07-30 02:45:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 390000 (241 MB) 2022-07-30 02:45:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 391000 (241 MB) 2022-07-30 02:45:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 392000 (241 MB) 2022-07-30 02:45:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 393000 (242 MB) 2022-07-30 02:45:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 394000 (242 MB) 2022-07-30 02:45:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 395000 (242 MB) 2022-07-30 02:45:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 396000 (242 MB) 2022-07-30 02:45:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 397000 (243 MB) 2022-07-30 02:45:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 398000 (243 MB) 2022-07-30 02:45:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 399000 (243 MB) 2022-07-30 02:45:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 400000 (243 MB) 2022-07-30 02:45:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 401000 (244 MB) 2022-07-30 02:45:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 402000 (244 MB) 2022-07-30 02:45:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 403000 (244 MB) 2022-07-30 02:45:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 404000 (244 MB) 2022-07-30 02:45:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 405000 (245 MB) 2022-07-30 02:45:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 406000 (245 MB) 2022-07-30 02:45:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 407000 (245 MB) 2022-07-30 02:45:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 408000 (245 MB) 2022-07-30 02:45:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 409000 (245 MB) 2022-07-30 02:45:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 410000 (246 MB) 2022-07-30 02:45:13 source > 2022-07-30 02:45:12 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 65857 records for table 'public.product_canonical_categories'; total duration '00:00:18.252' 2022-07-30 02:45:13 source > 2022-07-30 02:45:12 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.product_canonicals' (46 of 66 tables) 2022-07-30 02:45:13 source > 2022-07-30 02:45:12 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.product_canonicals' using select statement: 'SELECT "id", "code", "name", "image", "created_at", "updated_at", "ean", "gtin", "height_per_unit", "lenght_per_unit", "width_per_unit", "weight_per_unit", "brand", "reference_price", "created_by" FROM "public"."product_canonicals"' 2022-07-30 02:45:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 411000 (246 MB) 2022-07-30 02:45:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 412000 (246 MB) 2022-07-30 02:45:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 413000 (246 MB) 2022-07-30 02:45:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 414000 (247 MB) 2022-07-30 02:45:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 415000 (247 MB) 2022-07-30 02:45:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 416000 (247 MB) 2022-07-30 02:45:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 417000 (247 MB) 2022-07-30 02:45:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 418000 (248 MB) 2022-07-30 02:45:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 419000 (248 MB) 2022-07-30 02:45:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 420000 (248 MB) 2022-07-30 02:45:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 421000 (248 MB) 2022-07-30 02:45:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 422000 (249 MB) 2022-07-30 02:45:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 423000 (249 MB) 2022-07-30 02:45:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 424000 (249 MB) 2022-07-30 02:45:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 425000 (249 MB) 2022-07-30 02:45:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 426000 (249 MB) 2022-07-30 02:45:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 427000 (250 MB) 2022-07-30 02:45:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 428000 (250 MB) 2022-07-30 02:45:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 429000 (250 MB) 2022-07-30 02:45:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 430000 (250 MB) 2022-07-30 02:45:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 431000 (251 MB) 2022-07-30 02:45:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 432000 (251 MB) 2022-07-30 02:45:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 433000 (252 MB) 2022-07-30 02:45:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 434000 (252 MB) 2022-07-30 02:45:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 435000 (253 MB) 2022-07-30 02:45:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 436000 (253 MB) 2022-07-30 02:45:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 437000 (254 MB) 2022-07-30 02:45:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 438000 (254 MB) 2022-07-30 02:45:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 439000 (255 MB) 2022-07-30 02:45:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 440000 (255 MB) 2022-07-30 02:45:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 441000 (255 MB) 2022-07-30 02:45:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 442000 (256 MB) 2022-07-30 02:45:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 443000 (256 MB) 2022-07-30 02:45:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 444000 (257 MB) 2022-07-30 02:45:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 445000 (257 MB) 2022-07-30 02:45:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 446000 (258 MB) 2022-07-30 02:45:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 447000 (258 MB) 2022-07-30 02:45:23 source > 2022-07-30 02:45:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):374 - Exported 35973 records for table 'public.product_canonicals' after 00:00:10.158 2022-07-30 02:45:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 448000 (259 MB) 2022-07-30 02:45:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 449000 (259 MB) 2022-07-30 02:45:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 450000 (259 MB) 2022-07-30 02:45:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 451000 (260 MB) 2022-07-30 02:45:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 452000 (260 MB) 2022-07-30 02:45:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 453000 (261 MB) 2022-07-30 02:45:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 454000 (261 MB) 2022-07-30 02:45:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 455000 (262 MB) 2022-07-30 02:45:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 456000 (262 MB) 2022-07-30 02:45:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 457000 (263 MB) 2022-07-30 02:45:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 458000 (263 MB) 2022-07-30 02:45:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 459000 (264 MB) 2022-07-30 02:45:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 460000 (264 MB) 2022-07-30 02:45:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 461000 (264 MB) 2022-07-30 02:45:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 462000 (265 MB) 2022-07-30 02:45:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 463000 (265 MB) 2022-07-30 02:45:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 464000 (266 MB) 2022-07-30 02:45:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 465000 (266 MB) 2022-07-30 02:45:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 466000 (267 MB) 2022-07-30 02:45:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 467000 (267 MB) 2022-07-30 02:45:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 468000 (268 MB) 2022-07-30 02:45:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 469000 (268 MB) 2022-07-30 02:45:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 470000 (269 MB) 2022-07-30 02:45:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 471000 (269 MB) 2022-07-30 02:45:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 472000 (270 MB) 2022-07-30 02:45:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 473000 (270 MB) 2022-07-30 02:45:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 474000 (270 MB) 2022-07-30 02:45:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 475000 (271 MB) 2022-07-30 02:45:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 476000 (271 MB) 2022-07-30 02:45:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 477000 (272 MB) 2022-07-30 02:45:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 478000 (272 MB) 2022-07-30 02:45:33 source > 2022-07-30 02:45:32 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 67652 records for table 'public.product_canonicals'; total duration '00:00:19.958' 2022-07-30 02:45:33 source > 2022-07-30 02:45:32 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.product_orders' (47 of 66 tables) 2022-07-30 02:45:33 source > 2022-07-30 02:45:32 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.product_orders' using select statement: 'SELECT "id", "product_id", "order_id", "quantity", "created_at", "updated_at", "product_price_when_associated", "location_store_product_id", "pipefy_product_id", "pipefy_order_id", "pipefy_location_store_id", "type_quantity", "custom_product", "product_cost_when_associated", "trusted_when_associated", "returned_to", "under_review", "oversized", "dispatched", "store_location_id", "store_quote_id", "fits_in_motorcycle", "quote_link", "low_stock", "canceled_by_store", "confirmed_by", "store_cancelation_reason" FROM "public"."product_orders"' 2022-07-30 02:45:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 479000 (273 MB) 2022-07-30 02:45:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 480000 (273 MB) 2022-07-30 02:45:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 481000 (274 MB) 2022-07-30 02:45:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 482000 (274 MB) 2022-07-30 02:45:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 483000 (275 MB) 2022-07-30 02:45:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 484000 (275 MB) 2022-07-30 02:45:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 485000 (276 MB) 2022-07-30 02:45:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 486000 (276 MB) 2022-07-30 02:45:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 487000 (277 MB) 2022-07-30 02:45:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 488000 (277 MB) 2022-07-30 02:45:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 489000 (278 MB) 2022-07-30 02:45:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 490000 (278 MB) 2022-07-30 02:45:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 491000 (279 MB) 2022-07-30 02:45:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 492000 (279 MB) 2022-07-30 02:45:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 493000 (279 MB) 2022-07-30 02:45:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 494000 (280 MB) 2022-07-30 02:45:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 495000 (280 MB) 2022-07-30 02:45:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 496000 (281 MB) 2022-07-30 02:45:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 497000 (281 MB) 2022-07-30 02:45:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 498000 (282 MB) 2022-07-30 02:45:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 499000 (283 MB) 2022-07-30 02:45:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 500000 (284 MB) 2022-07-30 02:45:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 501000 (284 MB) 2022-07-30 02:45:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 502000 (285 MB) 2022-07-30 02:45:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 503000 (286 MB) 2022-07-30 02:45:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 504000 (287 MB) 2022-07-30 02:45:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 505000 (287 MB) 2022-07-30 02:45:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 506000 (288 MB) 2022-07-30 02:45:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 507000 (289 MB) 2022-07-30 02:45:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 508000 (290 MB) 2022-07-30 02:45:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 509000 (290 MB) 2022-07-30 02:45:43 source > 2022-07-30 02:45:42 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):374 - Exported 31521 records for table 'public.product_orders' after 00:00:10.056 2022-07-30 02:45:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 510000 (291 MB) 2022-07-30 02:45:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 511000 (292 MB) 2022-07-30 02:45:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 512000 (293 MB) 2022-07-30 02:45:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 513000 (293 MB) 2022-07-30 02:45:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 514000 (294 MB) 2022-07-30 02:45:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 515000 (295 MB) 2022-07-30 02:45:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 516000 (296 MB) 2022-07-30 02:45:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 517000 (296 MB) 2022-07-30 02:45:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 518000 (297 MB) 2022-07-30 02:45:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 519000 (298 MB) 2022-07-30 02:45:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 520000 (299 MB) 2022-07-30 02:45:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 521000 (299 MB) 2022-07-30 02:45:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 522000 (300 MB) 2022-07-30 02:45:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 523000 (301 MB) 2022-07-30 02:45:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 524000 (302 MB) 2022-07-30 02:45:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 525000 (302 MB) 2022-07-30 02:45:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 526000 (303 MB) 2022-07-30 02:45:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 527000 (304 MB) 2022-07-30 02:45:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 528000 (305 MB) 2022-07-30 02:45:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 529000 (305 MB) 2022-07-30 02:45:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 530000 (306 MB) 2022-07-30 02:45:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 531000 (307 MB) 2022-07-30 02:45:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 532000 (308 MB) 2022-07-30 02:45:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 533000 (308 MB) 2022-07-30 02:45:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 534000 (309 MB) 2022-07-30 02:45:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 535000 (310 MB) 2022-07-30 02:45:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 536000 (311 MB) 2022-07-30 02:45:53 source > 2022-07-30 02:45:52 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):374 - Exported 57113 records for table 'public.product_orders' after 00:00:20.091 2022-07-30 02:45:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 537000 (311 MB) 2022-07-30 02:45:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 538000 (312 MB) 2022-07-30 02:45:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 539000 (313 MB) 2022-07-30 02:45:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 540000 (314 MB) 2022-07-30 02:45:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 541000 (315 MB) 2022-07-30 02:45:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 542000 (315 MB) 2022-07-30 02:45:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 543000 (316 MB) 2022-07-30 02:45:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 544000 (317 MB) 2022-07-30 02:45:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 545000 (318 MB) 2022-07-30 02:45:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 546000 (318 MB) 2022-07-30 02:45:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 547000 (319 MB) 2022-07-30 02:45:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 548000 (320 MB) 2022-07-30 02:45:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 549000 (321 MB) 2022-07-30 02:45:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 550000 (322 MB) 2022-07-30 02:45:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 551000 (322 MB) 2022-07-30 02:45:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 552000 (323 MB) 2022-07-30 02:45:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 553000 (324 MB) 2022-07-30 02:46:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 554000 (324 MB) 2022-07-30 02:46:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 555000 (325 MB) 2022-07-30 02:46:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 556000 (326 MB) 2022-07-30 02:46:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 557000 (327 MB) 2022-07-30 02:46:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 558000 (327 MB) 2022-07-30 02:46:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 559000 (328 MB) 2022-07-30 02:46:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 560000 (329 MB) 2022-07-30 02:46:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 561000 (330 MB) 2022-07-30 02:46:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 562000 (330 MB) 2022-07-30 02:46:03 source > 2022-07-30 02:46:02 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 84773 records for table 'public.product_orders'; total duration '00:00:29.817' 2022-07-30 02:46:03 source > 2022-07-30 02:46:02 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.product_reports' (48 of 66 tables) 2022-07-30 02:46:03 source > 2022-07-30 02:46:02 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.product_reports' using select statement: 'SELECT "id", "product_id", "buyer_user_id", "type", "price_when_reported", "created_at", "updated_at", "product_order_id" FROM "public"."product_reports"' 2022-07-30 02:46:03 source > 2022-07-30 02:46:02 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 211 records for table 'public.product_reports'; total duration '00:00:00.009' 2022-07-30 02:46:03 source > 2022-07-30 02:46:02 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.products' (49 of 66 tables) 2022-07-30 02:46:03 source > 2022-07-30 02:46:02 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.products' using select statement: 'SELECT "id", "external_identify", "name", "description", "details", "product_canonical_id", "created_at", "updated_at", "price", "oico_markup_wholesale", "store_id", "pipefy_id", "pipefy_store_id", "type_quantity", "conta_azul", "problem_reported", "height_per_unit", "lenght_per_unit", "width_per_unit", "weight_per_unit", "canonical_associated_at", "trusted", "minimum_quantity", "ncm", "omie_id", "available_to_stores", "oico_markup_retail", "available", "on_offer", "inserted_by", "changed_by" FROM "public"."products"' 2022-07-30 02:46:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 563000 (331 MB) 2022-07-30 02:46:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 564000 (332 MB) 2022-07-30 02:46:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 565000 (333 MB) 2022-07-30 02:46:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 566000 (333 MB) 2022-07-30 02:46:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 567000 (334 MB) 2022-07-30 02:46:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 568000 (335 MB) 2022-07-30 02:46:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 569000 (335 MB) 2022-07-30 02:46:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 570000 (336 MB) 2022-07-30 02:46:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 571000 (337 MB) 2022-07-30 02:46:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 572000 (338 MB) 2022-07-30 02:46:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 573000 (338 MB) 2022-07-30 02:46:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 574000 (339 MB) 2022-07-30 02:46:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 575000 (340 MB) 2022-07-30 02:46:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 576000 (341 MB) 2022-07-30 02:46:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 577000 (341 MB) 2022-07-30 02:46:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 578000 (342 MB) 2022-07-30 02:46:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 579000 (343 MB) 2022-07-30 02:46:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 580000 (344 MB) 2022-07-30 02:46:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 581000 (344 MB) 2022-07-30 02:46:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 582000 (345 MB) 2022-07-30 02:46:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 583000 (346 MB) 2022-07-30 02:46:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 584000 (347 MB) 2022-07-30 02:46:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 585000 (347 MB) 2022-07-30 02:46:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 586000 (348 MB) 2022-07-30 02:46:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 587000 (349 MB) 2022-07-30 02:46:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 588000 (350 MB) 2022-07-30 02:46:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 589000 (351 MB) 2022-07-30 02:46:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 590000 (352 MB) 2022-07-30 02:46:13 source > 2022-07-30 02:46:13 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):374 - Exported 26697 records for table 'public.products' after 00:00:10.696 2022-07-30 02:46:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 591000 (352 MB) 2022-07-30 02:46:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 592000 (353 MB) 2022-07-30 02:46:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 593000 (354 MB) 2022-07-30 02:46:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 594000 (355 MB) 2022-07-30 02:46:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 595000 (356 MB) 2022-07-30 02:46:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 596000 (357 MB) 2022-07-30 02:46:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 597000 (357 MB) 2022-07-30 02:46:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 598000 (358 MB) 2022-07-30 02:46:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 599000 (359 MB) 2022-07-30 02:46:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 600000 (360 MB) 2022-07-30 02:46:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 601000 (361 MB) 2022-07-30 02:46:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 602000 (362 MB) 2022-07-30 02:46:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 603000 (362 MB) 2022-07-30 02:46:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 604000 (363 MB) 2022-07-30 02:46:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 605000 (364 MB) 2022-07-30 02:46:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 606000 (365 MB) 2022-07-30 02:46:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 607000 (366 MB) 2022-07-30 02:46:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 608000 (367 MB) 2022-07-30 02:46:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 609000 (367 MB) 2022-07-30 02:46:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 610000 (368 MB) 2022-07-30 02:46:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 611000 (369 MB) 2022-07-30 02:46:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 612000 (370 MB) 2022-07-30 02:46:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 613000 (371 MB) 2022-07-30 02:46:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 614000 (372 MB) 2022-07-30 02:46:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 615000 (372 MB) 2022-07-30 02:46:24 source > 2022-07-30 02:46:23 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):374 - Exported 51273 records for table 'public.products' after 00:00:21.153 2022-07-30 02:46:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 616000 (373 MB) 2022-07-30 02:46:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 617000 (374 MB) 2022-07-30 02:46:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 618000 (375 MB) 2022-07-30 02:46:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 619000 (376 MB) 2022-07-30 02:46:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 620000 (377 MB) 2022-07-30 02:46:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 621000 (377 MB) 2022-07-30 02:46:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 622000 (378 MB) 2022-07-30 02:46:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 623000 (379 MB) 2022-07-30 02:46:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 624000 (380 MB) 2022-07-30 02:46:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 625000 (381 MB) 2022-07-30 02:46:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 626000 (381 MB) 2022-07-30 02:46:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 627000 (382 MB) 2022-07-30 02:46:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 628000 (383 MB) 2022-07-30 02:46:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 629000 (384 MB) 2022-07-30 02:46:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 630000 (385 MB) 2022-07-30 02:46:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 631000 (385 MB) 2022-07-30 02:46:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 632000 (386 MB) 2022-07-30 02:46:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 633000 (387 MB) 2022-07-30 02:46:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 634000 (388 MB) 2022-07-30 02:46:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 635000 (389 MB) 2022-07-30 02:46:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 636000 (389 MB) 2022-07-30 02:46:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 637000 (390 MB) 2022-07-30 02:46:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 638000 (391 MB) 2022-07-30 02:46:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 639000 (392 MB) 2022-07-30 02:46:34 source > 2022-07-30 02:46:33 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):374 - Exported 75849 records for table 'public.products' after 00:00:31.17 2022-07-30 02:46:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 640000 (393 MB) 2022-07-30 02:46:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 641000 (393 MB) 2022-07-30 02:46:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 642000 (394 MB) 2022-07-30 02:46:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 643000 (395 MB) 2022-07-30 02:46:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 644000 (396 MB) 2022-07-30 02:46:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 645000 (397 MB) 2022-07-30 02:46:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 646000 (398 MB) 2022-07-30 02:46:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 647000 (398 MB) 2022-07-30 02:46:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 648000 (399 MB) 2022-07-30 02:46:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 649000 (400 MB) 2022-07-30 02:46:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 650000 (401 MB) 2022-07-30 02:46:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 651000 (402 MB) 2022-07-30 02:46:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 652000 (402 MB) 2022-07-30 02:46:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 653000 (403 MB) 2022-07-30 02:46:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 654000 (404 MB) 2022-07-30 02:46:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 655000 (405 MB) 2022-07-30 02:46:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 656000 (406 MB) 2022-07-30 02:46:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 657000 (406 MB) 2022-07-30 02:46:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 658000 (407 MB) 2022-07-30 02:46:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 659000 (408 MB) 2022-07-30 02:46:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 660000 (409 MB) 2022-07-30 02:46:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 661000 (410 MB) 2022-07-30 02:46:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 662000 (411 MB) 2022-07-30 02:46:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 663000 (411 MB) 2022-07-30 02:46:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 664000 (412 MB) 2022-07-30 02:46:44 source > 2022-07-30 02:46:43 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):374 - Exported 100425 records for table 'public.products' after 00:00:41.429 2022-07-30 02:46:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 665000 (413 MB) 2022-07-30 02:46:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 666000 (414 MB) 2022-07-30 02:46:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 667000 (415 MB) 2022-07-30 02:46:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 668000 (416 MB) 2022-07-30 02:46:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 669000 (416 MB) 2022-07-30 02:46:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 670000 (417 MB) 2022-07-30 02:46:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 671000 (418 MB) 2022-07-30 02:46:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 672000 (419 MB) 2022-07-30 02:46:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 673000 (420 MB) 2022-07-30 02:46:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 674000 (420 MB) 2022-07-30 02:46:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 675000 (421 MB) 2022-07-30 02:46:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 676000 (422 MB) 2022-07-30 02:46:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 677000 (423 MB) 2022-07-30 02:46:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 678000 (424 MB) 2022-07-30 02:46:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 679000 (425 MB) 2022-07-30 02:46:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 680000 (425 MB) 2022-07-30 02:46:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 681000 (426 MB) 2022-07-30 02:46:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 682000 (427 MB) 2022-07-30 02:46:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 683000 (428 MB) 2022-07-30 02:46:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 684000 (429 MB) 2022-07-30 02:46:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 685000 (429 MB) 2022-07-30 02:46:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 686000 (430 MB) 2022-07-30 02:46:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 687000 (431 MB) 2022-07-30 02:46:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 688000 (432 MB) 2022-07-30 02:46:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 689000 (433 MB) 2022-07-30 02:46:54 source > 2022-07-30 02:46:54 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):374 - Exported 125001 records for table 'public.products' after 00:00:51.732 2022-07-30 02:46:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 690000 (433 MB) 2022-07-30 02:46:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 691000 (434 MB) 2022-07-30 02:46:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 692000 (435 MB) 2022-07-30 02:46:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 693000 (436 MB) 2022-07-30 02:46:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 694000 (437 MB) 2022-07-30 02:46:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 695000 (438 MB) 2022-07-30 02:46:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 696000 (438 MB) 2022-07-30 02:46:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 697000 (439 MB) 2022-07-30 02:46:58 source > 2022-07-30 02:46:57 INFO i.d.c.c.BaseSourceTask(logStatistics):182 - 2048 records sent during previous 00:02:40.051, last recorded offset: {last_snapshot_record=false, lsn=175422614568, txId=70657, ts_usec=1659149214396000, snapshot=true} 2022-07-30 02:46:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 698000 (440 MB) 2022-07-30 02:46:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 699000 (441 MB) 2022-07-30 02:46:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 700000 (442 MB) 2022-07-30 02:46:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 701000 (442 MB) 2022-07-30 02:47:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 702000 (443 MB) 2022-07-30 02:47:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 703000 (444 MB) 2022-07-30 02:47:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 704000 (445 MB) 2022-07-30 02:47:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 705000 (446 MB) 2022-07-30 02:47:01 source > 2022-07-30 02:47:00 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 142407 records for table 'public.products'; total duration '00:00:58.411' 2022-07-30 02:47:01 source > 2022-07-30 02:47:01 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.reports' (50 of 66 tables) 2022-07-30 02:47:01 source > 2022-07-30 02:47:01 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.reports' using select statement: 'SELECT "id", "buyer_user_id", "sended", "message", "created_at", "updated_at" FROM "public"."reports"' 2022-07-30 02:47:01 source > 2022-07-30 02:47:01 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 0 records for table 'public.reports'; total duration '00:00:00.003' 2022-07-30 02:47:01 source > 2022-07-30 02:47:01 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.requested_products' (51 of 66 tables) 2022-07-30 02:47:01 source > 2022-07-30 02:47:01 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.requested_products' using select statement: 'SELECT "id", "original_description", "description", "comment", "quantity", "order_id", "product_order_id", "product_canonical_id", "created_at", "updated_at", "deleted_at", "done_by_client", "unavailable", "user_preference" FROM "public"."requested_products"' 2022-07-30 02:47:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 706000 (446 MB) 2022-07-30 02:47:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 707000 (447 MB) 2022-07-30 02:47:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 708000 (448 MB) 2022-07-30 02:47:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 709000 (449 MB) 2022-07-30 02:47:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 710000 (450 MB) 2022-07-30 02:47:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 711000 (450 MB) 2022-07-30 02:47:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 712000 (451 MB) 2022-07-30 02:47:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 713000 (452 MB) 2022-07-30 02:47:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 714000 (453 MB) 2022-07-30 02:47:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 715000 (454 MB) 2022-07-30 02:47:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 716000 (455 MB) 2022-07-30 02:47:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 717000 (455 MB) 2022-07-30 02:47:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 718000 (456 MB) 2022-07-30 02:47:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 719000 (457 MB) 2022-07-30 02:47:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 720000 (458 MB) 2022-07-30 02:47:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 721000 (459 MB) 2022-07-30 02:47:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 722000 (459 MB) 2022-07-30 02:47:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 723000 (460 MB) 2022-07-30 02:47:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 724000 (461 MB) 2022-07-30 02:47:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 725000 (462 MB) 2022-07-30 02:47:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 726000 (462 MB) 2022-07-30 02:47:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 727000 (463 MB) 2022-07-30 02:47:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 728000 (463 MB) 2022-07-30 02:47:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 729000 (464 MB) 2022-07-30 02:47:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 730000 (464 MB) 2022-07-30 02:47:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 731000 (465 MB) 2022-07-30 02:47:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 732000 (465 MB) 2022-07-30 02:47:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 733000 (466 MB) 2022-07-30 02:47:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 734000 (466 MB) 2022-07-30 02:47:12 source > 2022-07-30 02:47:11 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):374 - Exported 27650 records for table 'public.requested_products' after 00:00:10.45 2022-07-30 02:47:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 735000 (467 MB) 2022-07-30 02:47:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 736000 (468 MB) 2022-07-30 02:47:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 737000 (468 MB) 2022-07-30 02:47:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 738000 (469 MB) 2022-07-30 02:47:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 739000 (469 MB) 2022-07-30 02:47:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 740000 (470 MB) 2022-07-30 02:47:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 741000 (470 MB) 2022-07-30 02:47:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 742000 (471 MB) 2022-07-30 02:47:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 743000 (471 MB) 2022-07-30 02:47:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 744000 (472 MB) 2022-07-30 02:47:15 source > 2022-07-30 02:47:15 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 38716 records for table 'public.requested_products'; total duration '00:00:13.94' 2022-07-30 02:47:15 source > 2022-07-30 02:47:15 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.responsible_deliveries' (52 of 66 tables) 2022-07-30 02:47:15 source > 2022-07-30 02:47:15 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.responsible_deliveries' using select statement: 'SELECT "id", "name", "phone_number", "email", "buyer_id", "buyer_location_id", "created_at", "updated_at" FROM "public"."responsible_deliveries"' 2022-07-30 02:47:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 745000 (472 MB) 2022-07-30 02:47:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 746000 (473 MB) 2022-07-30 02:47:16 source > 2022-07-30 02:47:15 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 2729 records for table 'public.responsible_deliveries'; total duration '00:00:00.52' 2022-07-30 02:47:16 source > 2022-07-30 02:47:15 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.roi_products' (53 of 66 tables) 2022-07-30 02:47:16 source > 2022-07-30 02:47:15 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.roi_products' using select statement: 'SELECT "id", "name", "price" FROM "public"."roi_products"' 2022-07-30 02:47:16 source > 2022-07-30 02:47:15 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 5 records for table 'public.roi_products'; total duration '00:00:00.012' 2022-07-30 02:47:16 source > 2022-07-30 02:47:15 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.schema_migrations' (54 of 66 tables) 2022-07-30 02:47:16 source > 2022-07-30 02:47:15 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.schema_migrations' using select statement: 'SELECT "version" FROM "public"."schema_migrations"' 2022-07-30 02:47:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 747000 (473 MB) 2022-07-30 02:47:16 source > 2022-07-30 02:47:15 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 385 records for table 'public.schema_migrations'; total duration '00:00:00.009' 2022-07-30 02:47:16 source > 2022-07-30 02:47:15 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.shortened_urls' (55 of 66 tables) 2022-07-30 02:47:16 source > 2022-07-30 02:47:15 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.shortened_urls' using select statement: 'SELECT "id", "owner_id", "owner_type", "url", "unique_key", "category", "use_count", "expires_at", "created_at", "updated_at" FROM "public"."shortened_urls"' 2022-07-30 02:47:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 748000 (474 MB) 2022-07-30 02:47:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 749000 (474 MB) 2022-07-30 02:47:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 750000 (475 MB) 2022-07-30 02:47:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 751000 (475 MB) 2022-07-30 02:47:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 752000 (476 MB) 2022-07-30 02:47:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 753000 (476 MB) 2022-07-30 02:47:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 754000 (477 MB) 2022-07-30 02:47:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 755000 (477 MB) 2022-07-30 02:47:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 756000 (478 MB) 2022-07-30 02:47:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 757000 (478 MB) 2022-07-30 02:47:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 758000 (479 MB) 2022-07-30 02:47:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 759000 (479 MB) 2022-07-30 02:47:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 760000 (480 MB) 2022-07-30 02:47:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 761000 (480 MB) 2022-07-30 02:47:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 762000 (481 MB) 2022-07-30 02:47:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 763000 (481 MB) 2022-07-30 02:47:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 764000 (481 MB) 2022-07-30 02:47:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 765000 (482 MB) 2022-07-30 02:47:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 766000 (482 MB) 2022-07-30 02:47:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 767000 (482 MB) 2022-07-30 02:47:23 source > 2022-07-30 02:47:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 19386 records for table 'public.shortened_urls'; total duration '00:00:06.521' 2022-07-30 02:47:23 source > 2022-07-30 02:47:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.sidekiq_sequence_records' (56 of 66 tables) 2022-07-30 02:47:23 source > 2022-07-30 02:47:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.sidekiq_sequence_records' using select statement: 'SELECT "id", "data", "current_step", "created_at", "updated_at" FROM "public"."sidekiq_sequence_records"' 2022-07-30 02:47:23 source > 2022-07-30 02:47:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 2 records for table 'public.sidekiq_sequence_records'; total duration '00:00:00.005' 2022-07-30 02:47:23 source > 2022-07-30 02:47:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.stockout_events' (57 of 66 tables) 2022-07-30 02:47:23 source > 2022-07-30 02:47:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.stockout_events' using select statement: 'SELECT "id", "order_id", "product_id", "price_when_deleted", "created_by", "created_at", "updated_at" FROM "public"."stockout_events"' 2022-07-30 02:47:23 source > 2022-07-30 02:47:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 1134 records for table 'public.stockout_events'; total duration '00:00:00.079' 2022-07-30 02:47:23 source > 2022-07-30 02:47:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.store_categories' (58 of 66 tables) 2022-07-30 02:47:23 source > 2022-07-30 02:47:22 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.store_categories' using select statement: 'SELECT "id", "store_id", "category_id", "created_at", "updated_at" FROM "public"."store_categories"' 2022-07-30 02:47:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 768000 (483 MB) 2022-07-30 02:47:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 769000 (483 MB) 2022-07-30 02:47:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 770000 (484 MB) 2022-07-30 02:47:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 771000 (484 MB) 2022-07-30 02:47:24 source > 2022-07-30 02:47:23 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 2427 records for table 'public.store_categories'; total duration '00:00:00.927' 2022-07-30 02:47:24 source > 2022-07-30 02:47:23 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.store_locations' (59 of 66 tables) 2022-07-30 02:47:24 source > 2022-07-30 02:47:23 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.store_locations' using select statement: 'SELECT "id", "store_id", "location", "created_at", "updated_at", "street", "address_details", "zipcode", "city", "state", "pipefy_id", "lat", "lng", "google_place_id", "name" FROM "public"."store_locations"' 2022-07-30 02:47:24 source > 2022-07-30 02:47:23 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 1334 records for table 'public.store_locations'; total duration '00:00:00.086' 2022-07-30 02:47:24 source > 2022-07-30 02:47:23 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.store_order_quotes' (60 of 66 tables) 2022-07-30 02:47:24 source > 2022-07-30 02:47:23 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.store_order_quotes' using select statement: 'SELECT "id", "store_id", "order_id", "product_id", "quote_link", "created_at", "updated_at", "sent_at" FROM "public"."store_order_quotes"' 2022-07-30 02:47:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 772000 (484 MB) 2022-07-30 02:47:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 773000 (485 MB) 2022-07-30 02:47:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 774000 (485 MB) 2022-07-30 02:47:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 775000 (486 MB) 2022-07-30 02:47:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 776000 (486 MB) 2022-07-30 02:47:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 777000 (487 MB) 2022-07-30 02:47:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 778000 (487 MB) 2022-07-30 02:47:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 779000 (487 MB) 2022-07-30 02:47:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 780000 (488 MB) 2022-07-30 02:47:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 781000 (488 MB) 2022-07-30 02:47:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 782000 (489 MB) 2022-07-30 02:47:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 783000 (489 MB) 2022-07-30 02:47:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 784000 (489 MB) 2022-07-30 02:47:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 785000 (490 MB) 2022-07-30 02:47:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 786000 (490 MB) 2022-07-30 02:47:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 787000 (491 MB) 2022-07-30 02:47:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 788000 (491 MB) 2022-07-30 02:47:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 789000 (491 MB) 2022-07-30 02:47:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 790000 (491 MB) 2022-07-30 02:47:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 791000 (492 MB) 2022-07-30 02:47:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 792000 (492 MB) 2022-07-30 02:47:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 793000 (493 MB) 2022-07-30 02:47:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 794000 (493 MB) 2022-07-30 02:47:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 795000 (493 MB) 2022-07-30 02:47:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 796000 (494 MB) 2022-07-30 02:47:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 797000 (494 MB) 2022-07-30 02:47:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 798000 (495 MB) 2022-07-30 02:47:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 799000 (495 MB) 2022-07-30 02:47:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 800000 (495 MB) 2022-07-30 02:47:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 801000 (496 MB) 2022-07-30 02:47:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 802000 (496 MB) 2022-07-30 02:47:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 803000 (497 MB) 2022-07-30 02:47:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 804000 (497 MB) 2022-07-30 02:47:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 805000 (497 MB) 2022-07-30 02:47:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 806000 (498 MB) 2022-07-30 02:47:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 807000 (498 MB) 2022-07-30 02:47:34 source > 2022-07-30 02:47:33 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):374 - Exported 35260 records for table 'public.store_order_quotes' after 00:00:10.049 2022-07-30 02:47:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 808000 (499 MB) 2022-07-30 02:47:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 809000 (499 MB) 2022-07-30 02:47:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 810000 (499 MB) 2022-07-30 02:47:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 811000 (500 MB) 2022-07-30 02:47:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 812000 (500 MB) 2022-07-30 02:47:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 813000 (500 MB) 2022-07-30 02:47:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 814000 (501 MB) 2022-07-30 02:47:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 815000 (501 MB) 2022-07-30 02:47:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 816000 (502 MB) 2022-07-30 02:47:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 817000 (502 MB) 2022-07-30 02:47:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 818000 (502 MB) 2022-07-30 02:47:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 819000 (503 MB) 2022-07-30 02:47:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 820000 (503 MB) 2022-07-30 02:47:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 821000 (504 MB) 2022-07-30 02:47:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 822000 (504 MB) 2022-07-30 02:47:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 823000 (504 MB) 2022-07-30 02:47:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 824000 (505 MB) 2022-07-30 02:47:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 825000 (505 MB) 2022-07-30 02:47:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 826000 (505 MB) 2022-07-30 02:47:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 827000 (506 MB) 2022-07-30 02:47:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 828000 (506 MB) 2022-07-30 02:47:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 829000 (507 MB) 2022-07-30 02:47:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 830000 (507 MB) 2022-07-30 02:47:41 source > 2022-07-30 02:47:40 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 58933 records for table 'public.store_order_quotes'; total duration '00:00:16.381' 2022-07-30 02:47:41 source > 2022-07-30 02:47:40 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.store_orders' (61 of 66 tables) 2022-07-30 02:47:41 source > 2022-07-30 02:47:40 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.store_orders' using select statement: 'SELECT "id", "order_id", "store_id", "created_at", "updated_at", "campaign_last_sent_at" FROM "public"."store_orders"' 2022-07-30 02:47:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 831000 (507 MB) 2022-07-30 02:47:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 832000 (508 MB) 2022-07-30 02:47:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 833000 (508 MB) 2022-07-30 02:47:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 834000 (509 MB) 2022-07-30 02:47:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 835000 (509 MB) 2022-07-30 02:47:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 836000 (509 MB) 2022-07-30 02:47:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 837000 (510 MB) 2022-07-30 02:47:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 838000 (510 MB) 2022-07-30 02:47:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 839000 (511 MB) 2022-07-30 02:47:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 840000 (511 MB) 2022-07-30 02:47:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 841000 (511 MB) 2022-07-30 02:47:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 842000 (512 MB) 2022-07-30 02:47:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 843000 (512 MB) 2022-07-30 02:47:44 source > 2022-07-30 02:47:43 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 13115 records for table 'public.store_orders'; total duration '00:00:03.221' 2022-07-30 02:47:44 source > 2022-07-30 02:47:43 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.store_users' (62 of 66 tables) 2022-07-30 02:47:44 source > 2022-07-30 02:47:43 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.store_users' using select statement: 'SELECT "id", "email", "encrypted_password", "reset_password_token", "reset_password_sent_at", "remember_created_at", "created_at", "updated_at", "store_id", "name", "phone_number", "active", "sign_in_count", "current_sign_in_at", "last_sign_in_at", "current_sign_in_ip", "last_sign_in_ip" FROM "public"."store_users"' 2022-07-30 02:47:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 844000 (513 MB) 2022-07-30 02:47:44 source > 2022-07-30 02:47:43 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 226 records for table 'public.store_users'; total duration '00:00:00.315' 2022-07-30 02:47:44 source > 2022-07-30 02:47:43 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.stores' (63 of 66 tables) 2022-07-30 02:47:44 source > 2022-07-30 02:47:43 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.stores' using select statement: 'SELECT "id", "state_registration", "municipal_registration", "business_name", "trading_name", "cnpj", "created_at", "updated_at", "bank_code", "bank_branch", "bank_account", "payment_type", "priority", "website", "sales_point_of_contact", "sales_email", "sales_whatsapp", "block", "pix_key", "minimum_response_time", "bank_account_check_digit", "manufacturer", "omie_id", "cnae", "bank_account_holder_name", "bank_account_holder_document", "activity", "national_simple", "payment_recommendations", "oico_partner", "store_type" FROM "public"."stores"' 2022-07-30 02:47:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 845000 (513 MB) 2022-07-30 02:47:45 source > 2022-07-30 02:47:43 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 1208 records for table 'public.stores'; total duration '00:00:00.14' 2022-07-30 02:47:45 source > 2022-07-30 02:47:44 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.term_acceptances' (64 of 66 tables) 2022-07-30 02:47:45 source > 2022-07-30 02:47:44 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.term_acceptances' using select statement: 'SELECT "id", "term_id", "buyer_id", "created_at", "updated_at", "store_id", "ip_address" FROM "public"."term_acceptances"' 2022-07-30 02:47:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 846000 (513 MB) 2022-07-30 02:47:45 source > 2022-07-30 02:47:44 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 1164 records for table 'public.term_acceptances'; total duration '00:00:00.149' 2022-07-30 02:47:45 source > 2022-07-30 02:47:44 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.terms' (65 of 66 tables) 2022-07-30 02:47:45 source > 2022-07-30 02:47:44 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.terms' using select statement: 'SELECT "id", "link", "type", "version", "mandatory", "created_at", "updated_at" FROM "public"."terms"' 2022-07-30 02:47:45 source > 2022-07-30 02:47:44 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 2 records for table 'public.terms'; total duration '00:00:00.006' 2022-07-30 02:47:45 source > 2022-07-30 02:47:44 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):338 - Exporting data from table 'public.transfeera_batches' (66 of 66 tables) 2022-07-30 02:47:45 source > 2022-07-30 02:47:44 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):346 - For table 'public.transfeera_batches' using select statement: 'SELECT "id", "name", "transfeera_id", "created_at", "updated_at" FROM "public"."transfeera_batches"' 2022-07-30 02:47:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 847000 (514 MB) 2022-07-30 02:47:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 848000 (514 MB) 2022-07-30 02:47:46 source > 2022-07-30 02:47:44 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):392 - Finished exporting 1820 records for table 'public.transfeera_batches'; total duration '00:00:00.514' 2022-07-30 02:47:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 849000 (514 MB) 2022-07-30 02:47:46 source > 2022-07-30 02:47:44 INFO i.d.p.s.AbstractSnapshotChangeEventSource(execute):88 - Snapshot - Final stage 2022-07-30 02:47:46 source > 2022-07-30 02:47:44 INFO i.d.p.ChangeEventSourceCoordinator(doSnapshot):156 - Snapshot ended with SnapshotResult [status=COMPLETED, offset=PostgresOffsetContext [sourceInfoSchema=Schema{io.debezium.connector.postgresql.Source:STRUCT}, sourceInfo=source_info[server='d6g4nour99s742'db='d6g4nour99s742', lsn=LSN{28/D800AC28}, txId=70657, timestamp=2022-07-30T02:47:44.973Z, snapshot=FALSE, schema=public, table=transfeera_batches], lastSnapshotRecord=true, lastCompletelyProcessedLsn=null, lastCommitLsn=null, streamingStoppingLsn=null, transactionContext=TransactionContext [currentTransactionId=null, perTableEventCount={}, totalEventCount=0], incrementalSnapshotContext=IncrementalSnapshotContext [windowOpened=false, chunkEndPosition=null, dataCollectionsToSnapshot=[], lastEventKeySent=null, maximumKey=null]]] 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.p.ChangeEventSourceCoordinator(streamingConnected):234 - Connected metrics set to 'true' 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.payer_buyer_locations' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.active_storage_attachments' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.product_canonical_categories' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 850000 (515 MB) 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.reports' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.oico_radars' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.schema_migrations' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.order_categories' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.store_orders' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.requested_products' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.categories' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.freight_routes' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.product_orders' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.oico_radar_products' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.term_acceptances' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.heya_campaign_receipts' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.sidekiq_sequence_records' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.order_issues' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.freight_product_orders' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.buyer_contact_rules' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.buyer_public_informations' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.active_storage_variant_records' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.buyers' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.ar_internal_metadata' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.freight_vehicle_types' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.location_store_products' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.omie_accounts' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.shortened_urls' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.stores' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.store_categories' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.faq_categories' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.payment_installments' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.buyer_store_recommendations' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.order_feedbacks' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.active_storage_blobs' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.freight_partner_vehicles' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.product_reports' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.store_order_quotes' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.payments' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.heya_campaign_memberships' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.buyer_locations' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.changebase_metadata' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.transfeera_batches' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.roi_products' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.flipper_features' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.flipper_gates' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.oico_users' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.payers' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.store_users' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.popular_searches' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.product_canonicals' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.faq' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.orders' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.products' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.buyer_uploads' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.freight_route_groupings' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.store_locations' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.terms' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.buyer_contacts' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.responsible_deliveries' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.freights' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.memento_sessions' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.memento_states' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.buyer_users' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.freight_route_partner_costs' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.freight_partners' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.stockout_events' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:47:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 851000 (515 MB) 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'CURRENT_TIMESTAMP' to type 'timestamp'. Expression evaluation is not supported. 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.p.ChangeEventSourceCoordinator(streamEvents):173 - Starting streaming 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.PostgresStreamingChangeEventSource(execute):127 - Retrieved latest position from stored offset 'LSN{28/D800AC28}' 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.c.WalPositionLocator():40 - Looking for WAL restart position for last commit LSN 'null' and last change LSN 'LSN{28/D800AC28}' 2022-07-30 02:47:46 source > 2022-07-30 02:47:45 INFO i.d.c.p.c.PostgresReplicationConnection(initPublication):145 - Initializing PgOutput logical decoder publication 2022-07-30 02:47:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 852000 (515 MB) 2022-07-30 02:47:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 853000 (516 MB) 2022-07-30 02:47:47 source > 2022-07-30 02:47:46 INFO i.d.c.p.c.PostgresConnection(readReplicationSlotInfo):251 - Obtained valid replication slot ReplicationSlot [active=false, latestFlushedLsn=LSN{28/D00CC220}, catalogXmin=70647] 2022-07-30 02:47:47 source > 2022-07-30 02:47:46 INFO i.d.j.JdbcConnection(lambda$doClose$3):956 - Connection gracefully closed 2022-07-30 02:47:47 source > 2022-07-30 02:47:46 INFO i.d.u.Threads(threadFactory):270 - Requested thread factory for connector PostgresConnector, id = d6g4nour99s742 named = keep-alive 2022-07-30 02:47:47 source > 2022-07-30 02:47:46 INFO i.d.u.Threads$3(newThread):287 - Creating thread debezium-postgresconnector-d6g4nour99s742-keep-alive 2022-07-30 02:47:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 854000 (516 MB) 2022-07-30 02:47:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 855000 (516 MB) 2022-07-30 02:47:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 856000 (516 MB) 2022-07-30 02:47:47 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.payer_buyer_locations' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:47 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.active_storage_attachments' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:47 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.product_canonical_categories' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:47 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.reports' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:47 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.oico_radars' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:47 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.schema_migrations' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:47 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.order_categories' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:47 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.store_orders' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:47 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.requested_products' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:47 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.categories' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:47 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.freight_routes' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:47 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.product_orders' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:47 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.oico_radar_products' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:47 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.term_acceptances' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:47 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.heya_campaign_receipts' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:47 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.sidekiq_sequence_records' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.order_issues' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.freight_product_orders' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.buyer_contact_rules' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.buyer_public_informations' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.active_storage_variant_records' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.buyers' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.ar_internal_metadata' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.freight_vehicle_types' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.location_store_products' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.omie_accounts' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.shortened_urls' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.stores' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.store_categories' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.faq_categories' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.payment_installments' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.buyer_store_recommendations' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.order_feedbacks' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.active_storage_blobs' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.freight_partner_vehicles' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.product_reports' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.store_order_quotes' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.payments' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.heya_campaign_memberships' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.buyer_locations' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.changebase_metadata' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.transfeera_batches' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.roi_products' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.flipper_features' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.flipper_gates' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.oico_users' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.payers' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.store_users' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.popular_searches' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.product_canonicals' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.faq' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.orders' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.products' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.buyer_uploads' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.freight_route_groupings' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.store_locations' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.terms' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.buyer_contacts' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.responsible_deliveries' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.freights' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.memento_sessions' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.memento_states' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.buyer_users' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.freight_route_partner_costs' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 857000 (517 MB) 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.freight_partners' is 'FULL'; UPDATE AND DELETE events will contain the previous values of all the columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):103 - REPLICA IDENTITY for 'public.stockout_events' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'public.gen_random_uuid()' to type 'uuid'. Expression evaluation is not supported. 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 WARN i.d.c.p.c.PostgresDefaultValueConverter(parseDefaultValue):90 - Cannot parse column default value 'CURRENT_TIMESTAMP' to type 'timestamp'. Expression evaluation is not supported. 2022-07-30 02:47:48 source > 2022-07-30 02:47:47 INFO i.d.c.p.PostgresStreamingChangeEventSource(searchWalPosition):314 - Searching for WAL resume position 2022-07-30 02:47:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 858000 (517 MB) 2022-07-30 02:47:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 859000 (517 MB) 2022-07-30 02:47:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 860000 (517 MB) 2022-07-30 02:47:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 861000 (518 MB) 2022-07-30 02:47:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 862000 (518 MB) 2022-07-30 02:47:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 863000 (518 MB) 2022-07-30 02:47:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 864000 (519 MB) 2022-07-30 02:47:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 865000 (519 MB) 2022-07-30 02:47:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 866000 (520 MB) 2022-07-30 02:47:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):325 - Records read: 867000 (520 MB) 2022-07-30 02:47:50 source > 2022-07-30 02:47:49 INFO i.d.e.EmbeddedEngine(stop):1047 - Stopping the embedded engine 2022-07-30 02:47:50 source > 2022-07-30 02:47:49 INFO i.d.e.EmbeddedEngine(stop):1055 - Waiting for PT5M for connector to stop 2022-07-30 02:47:50 source > 2022-07-30 02:47:49 INFO i.d.e.EmbeddedEngine(run):846 - Stopping the task and engine 2022-07-30 02:47:50 source > 2022-07-30 02:47:49 INFO i.d.c.c.BaseSourceTask(stop):238 - Stopping down connector 2022-07-30 02:47:50 source > 2022-07-30 02:47:49 INFO i.d.c.p.PostgresStreamingChangeEventSource(searchWalPosition):335 - WAL resume position 'null' discovered 2022-07-30 02:47:50 source > 2022-07-30 02:47:49 INFO i.d.j.JdbcConnection(lambda$doClose$3):956 - Connection gracefully closed 2022-07-30 02:47:50 source > 2022-07-30 02:47:49 INFO i.d.j.JdbcConnection(lambda$doClose$3):956 - Connection gracefully closed 2022-07-30 02:47:50 source > 2022-07-30 02:47:50 INFO i.d.c.p.c.PostgresReplicationConnection(initPublication):145 - Initializing PgOutput logical decoder publication 2022-07-30 02:47:50 source > 2022-07-30 02:47:50 INFO i.d.u.Threads(threadFactory):270 - Requested thread factory for connector PostgresConnector, id = d6g4nour99s742 named = keep-alive 2022-07-30 02:47:50 source > 2022-07-30 02:47:50 INFO i.d.u.Threads$3(newThread):287 - Creating thread debezium-postgresconnector-d6g4nour99s742-keep-alive 2022-07-30 02:47:50 source > 2022-07-30 02:47:50 INFO i.d.c.p.PostgresStreamingChangeEventSource(processMessages):202 - Processing messages 2022-07-30 02:47:50 source > 2022-07-30 02:47:50 INFO i.d.j.JdbcConnection(lambda$doClose$3):956 - Connection gracefully closed 2022-07-30 02:47:50 source > 2022-07-30 02:47:50 INFO i.d.p.ChangeEventSourceCoordinator(streamEvents):175 - Finished streaming 2022-07-30 02:47:50 source > 2022-07-30 02:47:50 INFO i.d.p.ChangeEventSourceCoordinator(streamingConnected):234 - Connected metrics set to 'false' 2022-07-30 02:47:50 source > 2022-07-30 02:47:50 INFO i.d.j.JdbcConnection(lambda$doClose$3):956 - Connection gracefully closed 2022-07-30 02:47:50 source > 2022-07-30 02:47:50 INFO i.d.j.JdbcConnection(lambda$doClose$3):956 - Connection gracefully closed 2022-07-30 02:47:50 source > 2022-07-30 02:47:50 INFO i.a.i.d.i.DebeziumRecordPublisher(lambda$start$1):86 - Debezium engine shutdown. 2022-07-30 02:47:50 source > 2022-07-30 02:47:50 INFO i.a.i.s.p.PostgresCdcStateHandler(saveState):32 - debezium state: {"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"} 2022-07-30 02:47:50 source > 2022-07-30 02:47:50 INFO i.a.i.s.r.s.LegacyStateManager(toState):96 - Generated legacy state for 67 streams 2022-07-30 02:47:50 source > 2022-07-30 02:47:50 INFO i.a.i.s.r.AbstractDbSource(lambda$read$2):139 - Closing database connection pool. 2022-07-30 02:47:50 source > 2022-07-30 02:47:50 INFO c.z.h.HikariDataSource(close):350 - HikariPool-2 - Shutdown initiated... 2022-07-30 02:47:50 source > 2022-07-30 02:47:50 INFO c.z.h.HikariDataSource(close):352 - HikariPool-2 - Shutdown completed. 2022-07-30 02:47:50 source > 2022-07-30 02:47:50 INFO i.a.i.s.r.AbstractDbSource(lambda$read$2):141 - Closed database connection pool. 2022-07-30 02:47:50 source > 2022-07-30 02:47:50 INFO i.a.i.b.IntegrationRunner(runInternal):150 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2022-07-30 02:47:50 source > 2022-07-30 02:47:50 INFO i.a.i.b.a.AdaptiveSourceRunner$Runner(run):87 - Completed source: io.airbyte.integrations.base.ssh.SshWrappedSource 2022-07-30 02:47:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):336 - Total records read: 867257 (520 MB) 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicbuyer_public_informations. Error messages: [$.recommended_spend_limit is of an incorrect type. Expected it to be number, $.recommended_term_limit is of an incorrect type. Expected it to be string, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicfreight_product_orders. Error messages: [$.internal_product_freight_note is of an incorrect type. Expected it to be string, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicbuyer_store_recommendations. Error messages: [$.store_id is of an incorrect type. Expected it to be number, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicresponsible_deliveries. Error messages: [$.email is of an incorrect type. Expected it to be string, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicproduct_reports. Error messages: [$.price_when_reported is of an incorrect type. Expected it to be number, $.product_order_id is of an incorrect type. Expected it to be number, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicfreight_vehicle_types. Error messages: [$.description is of an incorrect type. Expected it to be string, $.max_lenght is of an incorrect type. Expected it to be number, $.max_width is of an incorrect type. Expected it to be number, $.max_height is of an incorrect type. Expected it to be number, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicomie_accounts. Error messages: [$._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicstore_orders. Error messages: [$.campaign_last_sent_at is of an incorrect type. Expected it to be string, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicflipper_features. Error messages: [$._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicbuyer_locations. Error messages: [$.street is of an incorrect type. Expected it to be string, $.google_place_id is of an incorrect type. Expected it to be string, $.lng is of an incorrect type. Expected it to be number, $.address_details is of an incorrect type. Expected it to be string, $.zipcode is of an incorrect type. Expected it to be string, $.city is of an incorrect type. Expected it to be string, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string, $.lat is of an incorrect type. Expected it to be number] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicsidekiq_sequence_records. Error messages: [$._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicroi_products. Error messages: [$.price is of an incorrect type. Expected it to be number, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicbuyer_contacts. Error messages: [$._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publiccategories. Error messages: [$.category_id is of an incorrect type. Expected it to be number, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicstore_locations. Error messages: [$.lng is of an incorrect type. Expected it to be number, $.address_details is of an incorrect type. Expected it to be string, $.pipefy_id is of an incorrect type. Expected it to be number, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string, $.lat is of an incorrect type. Expected it to be number] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicfreight_route_groupings. Error messages: [$.delivery_note_link is of an incorrect type. Expected it to be string, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicproduct_orders. Error messages: [$.pipefy_order_id is of an incorrect type. Expected it to be number, $.store_quote_id is of an incorrect type. Expected it to be string, $.under_review is of an incorrect type. Expected it to be boolean, $.location_store_product_id is of an incorrect type. Expected it to be number, $.store_location_id is of an incorrect type. Expected it to be number, $.quote_link is of an incorrect type. Expected it to be string, $.product_cost_when_associated is of an incorrect type. Expected it to be number, $.type_quantity is of an incorrect type. Expected it to be number, $.product_price_when_associated is of an incorrect type. Expected it to be number, $.pipefy_location_store_id is of an incorrect type. Expected it to be number, $.pipefy_product_id is of an incorrect type. Expected it to be number, $.store_cancelation_reason is of an incorrect type. Expected it to be number, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicstore_users. Error messages: [$.reset_password_sent_at is of an incorrect type. Expected it to be string, $.phone_number is of an incorrect type. Expected it to be string, $.reset_password_token is of an incorrect type. Expected it to be string, $.remember_created_at is of an incorrect type. Expected it to be string, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicpayer_buyer_locations. Error messages: [$.buyer_id is of an incorrect type. Expected it to be number, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicstores. Error messages: [$.website is of an incorrect type. Expected it to be string, $.bank_account_holder_document is of an incorrect type. Expected it to be string, $.activity is of an incorrect type. Expected it to be number, $.bank_account_check_digit is of an incorrect type. Expected it to be string, $.pix_key is of an incorrect type. Expected it to be string, $.payment_type is of an incorrect type. Expected it to be number, $.sales_email is of an incorrect type. Expected it to be string, $.minimum_response_time is of an incorrect type. Expected it to be number, $.sales_point_of_contact is of an incorrect type. Expected it to be string, $.bank_account is of an incorrect type. Expected it to be string, $.municipal_registration is of an incorrect type. Expected it to be string, $.state_registration is of an incorrect type. Expected it to be string, $.bank_branch is of an incorrect type. Expected it to be string, $.cnae is of an incorrect type. Expected it to be string, $.bank_account_holder_name is of an incorrect type. Expected it to be string, $.omie_id is of an incorrect type. Expected it to be string, $.bank_code is of an incorrect type. Expected it to be string, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicpayers. Error messages: [$.bank_account_holder_document is of an incorrect type. Expected it to be string, $.credit_limit is of an incorrect type. Expected it to be number, $.activity is of an incorrect type. Expected it to be number, $.conta_azul is of an incorrect type. Expected it to be string, $.bank_account_check_digit is of an incorrect type. Expected it to be string, $.cnpj is of an incorrect type. Expected it to be string, $.bank_account is of an incorrect type. Expected it to be string, $.state_registration is of an incorrect type. Expected it to be string, $.billing_address_city is of an incorrect type. Expected it to be string, $.bank_branch is of an incorrect type. Expected it to be string, $.cnae is of an incorrect type. Expected it to be string, $.bank_account_holder_name is of an incorrect type. Expected it to be string, $.billing_address_state is of an incorrect type. Expected it to be string, $.omie_id is of an incorrect type. Expected it to be string, $.cpf is of an incorrect type. Expected it to be string, $.internal_notes is of an incorrect type. Expected it to be string, $.bank_code is of an incorrect type. Expected it to be string, $.billing_address_zipcode is of an incorrect type. Expected it to be string, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string, $.billing_address_district is of an incorrect type. Expected it to be string, $.billing_address_street is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicpopular_searches. Error messages: [$._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicactive_storage_blobs. Error messages: [$._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicschema_migrations. Error messages: [$._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicfaq. Error messages: [$._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicflipper_gates. Error messages: [$._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicstockout_events. Error messages: [$.price_when_deleted is of an incorrect type. Expected it to be number, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicmemento_states. Error messages: [$._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicbuyer_uploads. Error messages: [$.filename is of an incorrect type. Expected it to be string, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicproduct_canonicals. Error messages: [$.reference_price is of an incorrect type. Expected it to be number, $.gtin is of an incorrect type. Expected it to be string, $.image is of an incorrect type. Expected it to be string, $.lenght_per_unit is of an incorrect type. Expected it to be number, $.weight_per_unit is of an incorrect type. Expected it to be number, $.height_per_unit is of an incorrect type. Expected it to be number, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string, $.width_per_unit is of an incorrect type. Expected it to be number] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicheya_campaign_receipts. Error messages: [$._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicorder_issues. Error messages: [$.description is of an incorrect type. Expected it to be string, $.delivery_problems is of an incorrect type. Expected it to be number, $.product_problems is of an incorrect type. Expected it to be string, $.canceled_at is of an incorrect type. Expected it to be string, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicpayment_installments. Error messages: [$.original_due_date is of an incorrect type. Expected it to be string, $.original_due_date is of an incorrect type. Expected it to be date, $.transfeera_batch_id is of an incorrect type. Expected it to be number, $.metadata is of an incorrect type. Expected it to be string, $.canceled_at is of an incorrect type. Expected it to be string, $.external_identify is of an incorrect type. Expected it to be string, $.link is of an incorrect type. Expected it to be string, $.paid_value is of an incorrect type. Expected it to be number, $.installment_value is of an incorrect type. Expected it to be number, $.paid_at is of an incorrect type. Expected it to be string, $.bank_receipt_url is of an incorrect type. Expected it to be string, $.receipt_url is of an incorrect type. Expected it to be string, $.due_date is of an incorrect type. Expected it to be date, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicmemento_sessions. Error messages: [$._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicfreight_routes. Error messages: [$.freight_route_partner_cost_id is of an incorrect type. Expected it to be number, $.freight_partner_external_id is of an incorrect type. Expected it to be string, $.client_delivery_notes is of an incorrect type. Expected it to be string, $.delivery_problems is of an incorrect type. Expected it to be number, $.pipefy_id is of an incorrect type. Expected it to be string, $.freight_partner_dedicated_when_associated is of an incorrect type. Expected it to be boolean, $.freight_scheduled_delivery_datetime is of an incorrect type. Expected it to be string, $.sequence is of an incorrect type. Expected it to be string, $.freight_price is of an incorrect type. Expected it to be number, $.freight_tracking_link is of an incorrect type. Expected it to be string, $.freight_actual_delivery_datetime is of an incorrect type. Expected it to be string, $.total_distance is of an incorrect type. Expected it to be number, $.product_problems is of an incorrect type. Expected it to be string, $.shareable_link_hash is of an incorrect type. Expected it to be string, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicbuyers. Error messages: [$.conta_azul is of an incorrect type. Expected it to be string, $.truora_address is of an incorrect type. Expected it to be string, $.spend_limit is of an incorrect type. Expected it to be number, $.cnpj is of an incorrect type. Expected it to be string, $.truora_size is of an incorrect type. Expected it to be string, $.truora_legal_type is of an incorrect type. Expected it to be string, $.municipal_registration is of an incorrect type. Expected it to be string, $.financing_fee is of an incorrect type. Expected it to be number, $.state_registration is of an incorrect type. Expected it to be string, $.location_city is of an incorrect type. Expected it to be string, $.truora_current_irs_status is of an incorrect type. Expected it to be string, $.default_payer_id is of an incorrect type. Expected it to be number, $.truora_started_on is of an incorrect type. Expected it to be date, $.average_monthly_spend is of an incorrect type. Expected it to be number, $.location_state is of an incorrect type. Expected it to be string, $.business_name is of an incorrect type. Expected it to be string, $.truora_started_on is of an incorrect type. Expected it to be string, $.truora_business_name is of an incorrect type. Expected it to be string, $.truora_trading_name is of an incorrect type. Expected it to be string, $.truora_check_id is of an incorrect type. Expected it to be string, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string, $.type_company is of an incorrect type. Expected it to be number] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicfreight_partner_vehicles. Error messages: [$.start_location is of an incorrect type. Expected it to be string, $.start_lat is of an incorrect type. Expected it to be number, $.plate is of an incorrect type. Expected it to be string, $.start_lng is of an incorrect type. Expected it to be number, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicheya_campaign_memberships. Error messages: [$._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicoico_users. Error messages: [$.reset_password_sent_at is of an incorrect type. Expected it to be string, $.reset_password_token is of an incorrect type. Expected it to be string, $.remember_created_at is of an incorrect type. Expected it to be string, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicoico_radar_products. Error messages: [$.price is of an incorrect type. Expected it to be number, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicstore_categories. Error messages: [$._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicfreight_partners. Error messages: [$.website is of an incorrect type. Expected it to be string, $.daily_fee is of an incorrect type. Expected it to be number, $.payment_type is of an incorrect type. Expected it to be number, $.email is of an incorrect type. Expected it to be string, $.cnpj is of an incorrect type. Expected it to be string, $.cpf is of an incorrect type. Expected it to be string, $.point_of_contact is of an incorrect type. Expected it to be string, $.whatsapp is of an incorrect type. Expected it to be string, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicorder_categories. Error messages: [$._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicar_internal_metadata. Error messages: [$._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicoico_radars. Error messages: [$.phone_number is of an incorrect type. Expected it to be string, $.email is of an incorrect type. Expected it to be string, $.name is of an incorrect type. Expected it to be string, $.document is of an incorrect type. Expected it to be string, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicbuyer_users. Error messages: [$.reset_password_sent_at is of an incorrect type. Expected it to be string, $.confirmed_at is of an incorrect type. Expected it to be string, $.spend_limit is of an incorrect type. Expected it to be number, $.unconfirmed_email is of an incorrect type. Expected it to be string, $.referral_code is of an incorrect type. Expected it to be string, $.reset_password_token is of an incorrect type. Expected it to be string, $.remember_created_at is of an incorrect type. Expected it to be string, $.stytch_user_id is of an incorrect type. Expected it to be string, $.confirmation_sent_at is of an incorrect type. Expected it to be string, $.confirmation_token is of an incorrect type. Expected it to be string, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicshortened_urls. Error messages: [$.category is of an incorrect type. Expected it to be string, $.owner_id is of an incorrect type. Expected it to be number, $.expires_at is of an incorrect type. Expected it to be string, $.owner_type is of an incorrect type. Expected it to be string, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicproducts. Error messages: [$.ncm is of an incorrect type. Expected it to be string, $.conta_azul is of an incorrect type. Expected it to be string, $.pipefy_store_id is of an incorrect type. Expected it to be number, $.pipefy_id is of an incorrect type. Expected it to be number, $.problem_reported is of an incorrect type. Expected it to be number, $.minimum_quantity is of an incorrect type. Expected it to be number, $.width_per_unit is of an incorrect type. Expected it to be number, $.price is of an incorrect type. Expected it to be number, $.details is of an incorrect type. Expected it to be string, $.lenght_per_unit is of an incorrect type. Expected it to be number, $.weight_per_unit is of an incorrect type. Expected it to be number, $.canonical_associated_at is of an incorrect type. Expected it to be string, $.omie_id is of an incorrect type. Expected it to be string, $.height_per_unit is of an incorrect type. Expected it to be number, $.oico_markup_wholesale is of an incorrect type. Expected it to be number, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string, $.oico_markup_retail is of an incorrect type. Expected it to be number] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicstore_order_quotes. Error messages: [$.product_id is of an incorrect type. Expected it to be number, $.sent_at is of an incorrect type. Expected it to be string, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicterm_acceptances. Error messages: [$.store_id is of an incorrect type. Expected it to be number, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publictransfeera_batches. Error messages: [$._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicrequested_products. Error messages: [$.comment is of an incorrect type. Expected it to be string, $.deleted_at is of an incorrect type. Expected it to be string, $.product_canonical_id is of an incorrect type. Expected it to be number, $.product_order_id is of an incorrect type. Expected it to be number, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicactive_storage_attachments. Error messages: [$._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publiclocation_store_products. Error messages: [$.pipefy_product_store_id is of an incorrect type. Expected it to be number, $.pipefy_store_location_id is of an incorrect type. Expected it to be number, $.pipefy_id is of an incorrect type. Expected it to be number, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicpayments. Error messages: [$.postmark_read_at is of an incorrect type. Expected it to be string, $.created_by is of an incorrect type. Expected it to be string, $.purchase_order_id is of an incorrect type. Expected it to be string, $.store_id is of an incorrect type. Expected it to be number, $.extra_fees is of an incorrect type. Expected it to be number, $.canceled_at is of an incorrect type. Expected it to be string, $.tax_document_number is of an incorrect type. Expected it to be string, $.payment_value is of an incorrect type. Expected it to be number, $.discount is of an incorrect type. Expected it to be number, $.payer_id is of an incorrect type. Expected it to be number, $.paid_value is of an incorrect type. Expected it to be number, $.tax_document_link is of an incorrect type. Expected it to be string, $.postmark_message_id is of an incorrect type. Expected it to be string, $.xml_link is of an incorrect type. Expected it to be string, $.omie_id is of an incorrect type. Expected it to be string, $.purchase_order_link is of an incorrect type. Expected it to be string, $.freight_partner_id is of an incorrect type. Expected it to be number, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string, $.tax_note_issued_at is of an incorrect type. Expected it to be string, $.omie_account_id is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicproduct_canonical_categories. Error messages: [$._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicorder_feedbacks. Error messages: [$._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicorders. Error messages: [$.freight_link is of an incorrect type. Expected it to be string, $.last_quote is of an incorrect type. Expected it to be string, $.canceled_at is of an incorrect type. Expected it to be string, $.expected_date is of an incorrect type. Expected it to be string, $.expected_time is of an incorrect type. Expected it to be string, $.first_quote_sent_at is of an incorrect type. Expected it to be string, $.discount is of an incorrect type. Expected it to be number, $.comment is of an incorrect type. Expected it to be string, $.payer_id is of an incorrect type. Expected it to be number, $.quote_expires_at is of an incorrect type. Expected it to be string, $.internal_delivery_notes is of an incorrect type. Expected it to be string, $.freight_code is of an incorrect type. Expected it to be string, $.internal_notes is of an incorrect type. Expected it to be string, $.client_order_form is of an incorrect type. Expected it to be string, $.cancelation_reason is of an incorrect type. Expected it to be number, $.financing_value is of an incorrect type. Expected it to be number, $.conta_azul is of an incorrect type. Expected it to be string, $.expected_billing_due_date is of an incorrect type. Expected it to be string, $.cancelation_comment is of an incorrect type. Expected it to be string, $.client_notes is of an incorrect type. Expected it to be string, $.final_value is of an incorrect type. Expected it to be number, $.pipefy_id is of an incorrect type. Expected it to be number, $.approved_at is of an incorrect type. Expected it to be string, $.last_rdo_scheduling_message_sent_at is of an incorrect type. Expected it to be string, $.po_value is of an incorrect type. Expected it to be number, $.parent_order_id is of an incorrect type. Expected it to be number, $.value is of an incorrect type. Expected it to be number, $.quote_estimate is of an incorrect type. Expected it to be number, $.po_file_url is of an incorrect type. Expected it to be string, $.client_internal_id is of an incorrect type. Expected it to be string, $.money_saving is of an incorrect type. Expected it to be number, $.freight_value is of an incorrect type. Expected it to be number, $.expected_date is of an incorrect type. Expected it to be date, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicfreights. Error messages: [$.actual_delivery_datetime is of an incorrect type. Expected it to be string, $.client_delivery_notes is of an incorrect type. Expected it to be string, $.store_quote_id is of an incorrect type. Expected it to be string, $.arrived_at_drop_off_location_at is of an incorrect type. Expected it to be string, $.picked_up_at is of an incorrect type. Expected it to be string, $.arrived_at_pick_up_location_at is of an incorrect type. Expected it to be string, $.notified_at is of an incorrect type. Expected it to be string, $.distance is of an incorrect type. Expected it to be number, $.estimated_arrival_delivery_datetime is of an incorrect type. Expected it to be string, $.freight_weight is of an incorrect type. Expected it to be number, $.received_by is of an incorrect type. Expected it to be string, $.freight_scheduled_pickup_time is of an incorrect type. Expected it to be string, $.freight_actual_pickup_time is of an incorrect type. Expected it to be string, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicfreight_route_partner_costs. Error messages: [$.extra_cost is of an incorrect type. Expected it to be number, $.cost is of an incorrect type. Expected it to be number, $.total_cost is of an incorrect type. Expected it to be number, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicbuyer_contact_rules. Error messages: [$.order_id is of an incorrect type. Expected it to be number, $.buyer_location_id is of an incorrect type. Expected it to be number, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicfaq_categories. Error messages: [$._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):339 - Schema validation errors found for stream publicterms. Error messages: [$._ab_cdc_deleted_at is of an incorrect type. Expected it to be string] 2022-07-30 02:47:50 INFO i.a.w.g.DefaultReplicationWorker(run):175 - One of source or destination thread complete. Waiting on the other. 2022-07-30 02:47:50 destination > 2022-07-30 02:47:50 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded. 2022-07-30 02:47:50 destination > 2022-07-30 02:47:50 INFO i.a.i.d.b.BigQueryRecordConsumer(close):58 - Started closing all connections 2022-07-30 02:47:50 destination > 2022-07-30 02:47:50 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_faq, tmpTable=_airbyte_tmp_fql_faq, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:47:51 destination > 2022-07-30 02:47:51 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=ccafc028-55e9-4ac3-895d-4c80afc2836b, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149270794, endTime=null, startTime=1659149271051, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=NczbcvLCjSu3JIJEjjTyWg==, generatedId=dwcasa:US.ccafc028-55e9-4ac3-895d-4c80afc2836b, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/ccafc028-55e9-4ac3-895d-4c80afc2836b?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_fql_faq}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:47:55 destination > 2022-07-30 02:47:55 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=ccafc028-55e9-4ac3-895d-4c80afc2836b, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149270794, endTime=null, startTime=1659149271051, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=NczbcvLCjSu3JIJEjjTyWg==, generatedId=dwcasa:US.ccafc028-55e9-4ac3-895d-4c80afc2836b, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/ccafc028-55e9-4ac3-895d-4c80afc2836b?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_fql_faq}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:47:55 destination > 2022-07-30 02:47:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_fql_faq to the source table _airbyte_raw_faq. 2022-07-30 02:47:55 destination > 2022-07-30 02:47:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:47:59 destination > 2022-07-30 02:47:59 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_fql_faq}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_faq}} 2022-07-30 02:47:59 destination > 2022-07-30 02:47:59 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_faq! 2022-07-30 02:47:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@4fcc742e[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@410b83a7[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:47:59 destination > 2022-07-30 02:47:59 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:47:59 destination > 2022-07-30 02:47:59 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:47:59 destination > 2022-07-30 02:47:59 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:47:59 destination > 2022-07-30 02:47:59 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_faq, tmpTable=_airbyte_tmp_fql_faq, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:47:59 destination > 2022-07-30 02:47:59 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_freight_vehicle_types, tmpTable=_airbyte_tmp_chi_freight_vehicle_types, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:48:00 destination > 2022-07-30 02:48:00 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=7e2adb1a-daee-4269-84b7-ced79253db40, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149279821, endTime=null, startTime=1659149280101, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=pMebx65L5ryAe/AluUKgMg==, generatedId=dwcasa:US.7e2adb1a-daee-4269-84b7-ced79253db40, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/7e2adb1a-daee-4269-84b7-ced79253db40?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_chi_freight_vehicle_types}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:48:02 destination > 2022-07-30 02:48:02 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=7e2adb1a-daee-4269-84b7-ced79253db40, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149279821, endTime=null, startTime=1659149280101, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=pMebx65L5ryAe/AluUKgMg==, generatedId=dwcasa:US.7e2adb1a-daee-4269-84b7-ced79253db40, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/7e2adb1a-daee-4269-84b7-ced79253db40?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_chi_freight_vehicle_types}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:48:02 destination > 2022-07-30 02:48:02 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_chi_freight_vehicle_types to the source table _airbyte_raw_freight_vehicle_types. 2022-07-30 02:48:02 destination > 2022-07-30 02:48:02 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:48:06 destination > 2022-07-30 02:48:06 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_chi_freight_vehicle_types}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_freight_vehicle_types}} 2022-07-30 02:48:06 destination > 2022-07-30 02:48:06 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_freight_vehicle_types! 2022-07-30 02:48:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@45341f5e[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@36899c[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:48:06 WARN i.a.w.i.AirbyteMessageTracker(handleDestinationEmittedState):160 - The message tracker encountered an issue that prevents committed record counts from being reliably computed. 2022-07-30 02:48:06 WARN i.a.w.i.AirbyteMessageTracker(handleDestinationEmittedState):161 - This only impacts metadata and does not indicate a problem with actual sync data. 2022-07-30 02:48:06 WARN i.a.w.i.AirbyteMessageTracker(handleDestinationEmittedState):162 - State hash 1308144813 was already committed, likely indicating a state hash collision io.airbyte.workers.internal.StateDeltaTracker$StateDeltaTrackerException: State hash 1308144813 was already committed, likely indicating a state hash collision at io.airbyte.workers.internal.StateDeltaTracker.commitStateHash(StateDeltaTracker.java:114) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] at io.airbyte.workers.internal.AirbyteMessageTracker.handleDestinationEmittedState(AirbyteMessageTracker.java:157) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] at io.airbyte.workers.internal.AirbyteMessageTracker.acceptFromDestination(AirbyteMessageTracker.java:102) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getDestinationOutputRunnable$7(DefaultReplicationWorker.java:417) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) [?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) [?:?] at java.lang.Thread.run(Thread.java:1589) [?:?] 2022-07-30 02:48:06 destination > 2022-07-30 02:48:06 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:48:06 destination > 2022-07-30 02:48:06 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:48:06 destination > 2022-07-30 02:48:06 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:48:06 destination > 2022-07-30 02:48:06 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_freight_vehicle_types, tmpTable=_airbyte_tmp_chi_freight_vehicle_types, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:48:06 destination > 2022-07-30 02:48:06 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_shortened_urls, tmpTable=_airbyte_tmp_dpy_shortened_urls, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:48:07 destination > 2022-07-30 02:48:07 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=1a10fbbb-ed15-48bf-afb3-b0a4f7a75202, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149287464, endTime=null, startTime=1659149287766, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=PAj3CwAbKM2pYpgeWXIx/A==, generatedId=dwcasa:US.1a10fbbb-ed15-48bf-afb3-b0a4f7a75202, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/1a10fbbb-ed15-48bf-afb3-b0a4f7a75202?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_dpy_shortened_urls}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:48:13 destination > 2022-07-30 02:48:13 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=1a10fbbb-ed15-48bf-afb3-b0a4f7a75202, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149287464, endTime=null, startTime=1659149287766, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=PAj3CwAbKM2pYpgeWXIx/A==, generatedId=dwcasa:US.1a10fbbb-ed15-48bf-afb3-b0a4f7a75202, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/1a10fbbb-ed15-48bf-afb3-b0a4f7a75202?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_dpy_shortened_urls}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:48:13 destination > 2022-07-30 02:48:13 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_dpy_shortened_urls to the source table _airbyte_raw_shortened_urls. 2022-07-30 02:48:13 destination > 2022-07-30 02:48:13 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:48:17 destination > 2022-07-30 02:48:17 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_dpy_shortened_urls}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_shortened_urls}} 2022-07-30 02:48:17 destination > 2022-07-30 02:48:17 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_shortened_urls! 2022-07-30 02:48:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@2c77f0b0[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@31fc4822[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:48:17 destination > 2022-07-30 02:48:17 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:48:17 destination > 2022-07-30 02:48:17 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:48:17 destination > 2022-07-30 02:48:17 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:48:17 destination > 2022-07-30 02:48:17 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_shortened_urls, tmpTable=_airbyte_tmp_dpy_shortened_urls, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:48:17 destination > 2022-07-30 02:48:17 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_heya_campaign_memberships, tmpTable=_airbyte_tmp_ebg_heya_campaign_memberships, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:48:18 destination > 2022-07-30 02:48:18 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=c96232bf-ab17-4b66-ba6a-e09618474cb3, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149298037, endTime=null, startTime=1659149298312, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=AUadKHE70nRXZHTRoQn9gw==, generatedId=dwcasa:US.c96232bf-ab17-4b66-ba6a-e09618474cb3, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/c96232bf-ab17-4b66-ba6a-e09618474cb3?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_ebg_heya_campaign_memberships}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:48:22 destination > 2022-07-30 02:48:22 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=c96232bf-ab17-4b66-ba6a-e09618474cb3, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149298037, endTime=null, startTime=1659149298312, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=AUadKHE70nRXZHTRoQn9gw==, generatedId=dwcasa:US.c96232bf-ab17-4b66-ba6a-e09618474cb3, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/c96232bf-ab17-4b66-ba6a-e09618474cb3?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_ebg_heya_campaign_memberships}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:48:22 destination > 2022-07-30 02:48:22 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_ebg_heya_campaign_memberships to the source table _airbyte_raw_heya_campaign_memberships. 2022-07-30 02:48:22 destination > 2022-07-30 02:48:22 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:48:25 destination > 2022-07-30 02:48:25 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_ebg_heya_campaign_memberships}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_heya_campaign_memberships}} 2022-07-30 02:48:25 destination > 2022-07-30 02:48:25 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_heya_campaign_memberships! 2022-07-30 02:48:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@54576fac[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@601976d3[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:48:25 destination > 2022-07-30 02:48:25 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:48:25 destination > 2022-07-30 02:48:25 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:48:25 destination > 2022-07-30 02:48:25 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:48:25 destination > 2022-07-30 02:48:25 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_heya_campaign_memberships, tmpTable=_airbyte_tmp_ebg_heya_campaign_memberships, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:48:25 destination > 2022-07-30 02:48:25 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_payment_installments, tmpTable=_airbyte_tmp_shi_payment_installments, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:48:26 destination > 2022-07-30 02:48:26 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=5d60122b-dd76-4da1-8014-7df1c072aa3d, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149306029, endTime=null, startTime=1659149306284, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=O2fUWVDZdH20Vd0BZoggUA==, generatedId=dwcasa:US.5d60122b-dd76-4da1-8014-7df1c072aa3d, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/5d60122b-dd76-4da1-8014-7df1c072aa3d?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_shi_payment_installments}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:48:32 destination > 2022-07-30 02:48:32 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=5d60122b-dd76-4da1-8014-7df1c072aa3d, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149306029, endTime=null, startTime=1659149306284, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=O2fUWVDZdH20Vd0BZoggUA==, generatedId=dwcasa:US.5d60122b-dd76-4da1-8014-7df1c072aa3d, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/5d60122b-dd76-4da1-8014-7df1c072aa3d?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_shi_payment_installments}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:48:32 destination > 2022-07-30 02:48:32 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_shi_payment_installments to the source table _airbyte_raw_payment_installments. 2022-07-30 02:48:32 destination > 2022-07-30 02:48:32 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:48:35 destination > 2022-07-30 02:48:35 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_shi_payment_installments}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_payment_installments}} 2022-07-30 02:48:35 destination > 2022-07-30 02:48:35 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_payment_installments! 2022-07-30 02:48:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@73f8f810[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@20961315[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:48:35 destination > 2022-07-30 02:48:35 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:48:35 destination > 2022-07-30 02:48:35 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:48:35 destination > 2022-07-30 02:48:35 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:48:35 destination > 2022-07-30 02:48:35 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_payment_installments, tmpTable=_airbyte_tmp_shi_payment_installments, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:48:35 destination > 2022-07-30 02:48:35 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_stockout_events, tmpTable=_airbyte_tmp_prx_stockout_events, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:48:35 destination > 2022-07-30 02:48:35 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=f4eaddb0-9cc7-4ef2-9e7e-0f3fa75fa2f2, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149315659, endTime=null, startTime=1659149315888, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=TGwk8rAx2zD+orbLquqJmA==, generatedId=dwcasa:US.f4eaddb0-9cc7-4ef2-9e7e-0f3fa75fa2f2, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/f4eaddb0-9cc7-4ef2-9e7e-0f3fa75fa2f2?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_prx_stockout_events}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:48:38 destination > 2022-07-30 02:48:38 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=f4eaddb0-9cc7-4ef2-9e7e-0f3fa75fa2f2, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149315659, endTime=null, startTime=1659149315888, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=TGwk8rAx2zD+orbLquqJmA==, generatedId=dwcasa:US.f4eaddb0-9cc7-4ef2-9e7e-0f3fa75fa2f2, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/f4eaddb0-9cc7-4ef2-9e7e-0f3fa75fa2f2?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_prx_stockout_events}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:48:38 destination > 2022-07-30 02:48:38 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_prx_stockout_events to the source table _airbyte_raw_stockout_events. 2022-07-30 02:48:38 destination > 2022-07-30 02:48:38 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:48:40 destination > 2022-07-30 02:48:40 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_prx_stockout_events}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_stockout_events}} 2022-07-30 02:48:40 destination > 2022-07-30 02:48:40 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_stockout_events! 2022-07-30 02:48:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@4f5322a4[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@64576a73[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:48:40 destination > 2022-07-30 02:48:40 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:48:40 destination > 2022-07-30 02:48:40 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:48:41 destination > 2022-07-30 02:48:41 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:48:41 destination > 2022-07-30 02:48:41 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_stockout_events, tmpTable=_airbyte_tmp_prx_stockout_events, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:48:41 destination > 2022-07-30 02:48:41 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_location_store_products, tmpTable=_airbyte_tmp_iwc_location_store_products, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:48:41 destination > 2022-07-30 02:48:41 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=d79c0110-c837-4d60-853f-963a96c88b94, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149321480, endTime=null, startTime=1659149321742, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=05y3oXJoclauOqommU+eSA==, generatedId=dwcasa:US.d79c0110-c837-4d60-853f-963a96c88b94, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/d79c0110-c837-4d60-853f-963a96c88b94?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_iwc_location_store_products}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:48:46 destination > 2022-07-30 02:48:46 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=d79c0110-c837-4d60-853f-963a96c88b94, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149321480, endTime=null, startTime=1659149321742, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=05y3oXJoclauOqommU+eSA==, generatedId=dwcasa:US.d79c0110-c837-4d60-853f-963a96c88b94, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/d79c0110-c837-4d60-853f-963a96c88b94?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_iwc_location_store_products}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:48:46 destination > 2022-07-30 02:48:46 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_iwc_location_store_products to the source table _airbyte_raw_location_store_products. 2022-07-30 02:48:46 destination > 2022-07-30 02:48:46 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:48:49 destination > 2022-07-30 02:48:49 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_iwc_location_store_products}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_location_store_products}} 2022-07-30 02:48:49 destination > 2022-07-30 02:48:49 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_location_store_products! 2022-07-30 02:48:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@50db3691[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@40c58924[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:48:49 destination > 2022-07-30 02:48:49 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:48:49 destination > 2022-07-30 02:48:49 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:48:50 destination > 2022-07-30 02:48:50 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:48:50 destination > 2022-07-30 02:48:50 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_location_store_products, tmpTable=_airbyte_tmp_iwc_location_store_products, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:48:50 destination > 2022-07-30 02:48:50 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_freight_product_orders, tmpTable=_airbyte_tmp_lwf_freight_product_orders, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:48:50 destination > 2022-07-30 02:48:50 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=0cf2fb06-fc76-49e1-8a0b-a1eb4476641f, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149330415, endTime=null, startTime=1659149330694, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=sA3R4E/OAQRbFoHAuNCLAw==, generatedId=dwcasa:US.0cf2fb06-fc76-49e1-8a0b-a1eb4476641f, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/0cf2fb06-fc76-49e1-8a0b-a1eb4476641f?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_lwf_freight_product_orders}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:48:55 destination > 2022-07-30 02:48:55 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=0cf2fb06-fc76-49e1-8a0b-a1eb4476641f, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149330415, endTime=null, startTime=1659149330694, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=sA3R4E/OAQRbFoHAuNCLAw==, generatedId=dwcasa:US.0cf2fb06-fc76-49e1-8a0b-a1eb4476641f, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/0cf2fb06-fc76-49e1-8a0b-a1eb4476641f?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_lwf_freight_product_orders}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:48:55 destination > 2022-07-30 02:48:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_lwf_freight_product_orders to the source table _airbyte_raw_freight_product_orders. 2022-07-30 02:48:55 destination > 2022-07-30 02:48:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:49:00 destination > 2022-07-30 02:49:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_lwf_freight_product_orders}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_freight_product_orders}} 2022-07-30 02:49:00 destination > 2022-07-30 02:49:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_freight_product_orders! 2022-07-30 02:49:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@1655c59a[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@490e21d1[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:49:00 destination > 2022-07-30 02:49:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:49:00 destination > 2022-07-30 02:49:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:49:00 destination > 2022-07-30 02:49:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:49:00 destination > 2022-07-30 02:49:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_freight_product_orders, tmpTable=_airbyte_tmp_lwf_freight_product_orders, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:49:00 destination > 2022-07-30 02:49:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_buyer_store_recommendations, tmpTable=_airbyte_tmp_ycm_buyer_store_recommendations, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:49:00 destination > 2022-07-30 02:49:00 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=97c04199-ca6c-4853-9c5a-13d9ca78487e, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149340569, endTime=null, startTime=1659149340790, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=DjX5FiuNTYUlPrwdvMBFag==, generatedId=dwcasa:US.97c04199-ca6c-4853-9c5a-13d9ca78487e, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/97c04199-ca6c-4853-9c5a-13d9ca78487e?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_ycm_buyer_store_recommendations}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:49:02 destination > 2022-07-30 02:49:02 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=97c04199-ca6c-4853-9c5a-13d9ca78487e, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149340569, endTime=null, startTime=1659149340790, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=DjX5FiuNTYUlPrwdvMBFag==, generatedId=dwcasa:US.97c04199-ca6c-4853-9c5a-13d9ca78487e, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/97c04199-ca6c-4853-9c5a-13d9ca78487e?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_ycm_buyer_store_recommendations}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:49:02 destination > 2022-07-30 02:49:02 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_ycm_buyer_store_recommendations to the source table _airbyte_raw_buyer_store_recommendations. 2022-07-30 02:49:02 destination > 2022-07-30 02:49:02 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:49:06 destination > 2022-07-30 02:49:06 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_ycm_buyer_store_recommendations}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_buyer_store_recommendations}} 2022-07-30 02:49:06 destination > 2022-07-30 02:49:06 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_buyer_store_recommendations! 2022-07-30 02:49:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@40e8e9df[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@2c08c44f[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:49:06 destination > 2022-07-30 02:49:06 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:49:06 destination > 2022-07-30 02:49:06 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:49:07 destination > 2022-07-30 02:49:07 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:49:07 destination > 2022-07-30 02:49:07 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_buyer_store_recommendations, tmpTable=_airbyte_tmp_ycm_buyer_store_recommendations, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:49:07 destination > 2022-07-30 02:49:07 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_term_acceptances, tmpTable=_airbyte_tmp_leg_term_acceptances, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:49:07 destination > 2022-07-30 02:49:07 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=628b618c-b3e5-413d-937d-a23dd24638c3, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149347525, endTime=null, startTime=1659149347753, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=0GeFXz0Rw2JhrJuzPL3grA==, generatedId=dwcasa:US.628b618c-b3e5-413d-937d-a23dd24638c3, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/628b618c-b3e5-413d-937d-a23dd24638c3?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_leg_term_acceptances}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:49:13 destination > 2022-07-30 02:49:13 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=628b618c-b3e5-413d-937d-a23dd24638c3, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149347525, endTime=null, startTime=1659149347753, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=0GeFXz0Rw2JhrJuzPL3grA==, generatedId=dwcasa:US.628b618c-b3e5-413d-937d-a23dd24638c3, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/628b618c-b3e5-413d-937d-a23dd24638c3?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_leg_term_acceptances}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:49:13 destination > 2022-07-30 02:49:13 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_leg_term_acceptances to the source table _airbyte_raw_term_acceptances. 2022-07-30 02:49:13 destination > 2022-07-30 02:49:13 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:49:16 destination > 2022-07-30 02:49:16 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_leg_term_acceptances}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_term_acceptances}} 2022-07-30 02:49:16 destination > 2022-07-30 02:49:16 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_term_acceptances! 2022-07-30 02:49:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@1449ad41[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@2cf106b0[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:49:16 destination > 2022-07-30 02:49:16 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:49:16 destination > 2022-07-30 02:49:16 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:49:16 destination > 2022-07-30 02:49:16 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:49:16 destination > 2022-07-30 02:49:16 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_term_acceptances, tmpTable=_airbyte_tmp_leg_term_acceptances, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:49:16 destination > 2022-07-30 02:49:16 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_omie_accounts, tmpTable=_airbyte_tmp_zcc_omie_accounts, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:49:17 destination > 2022-07-30 02:49:17 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=b3d417d4-16e3-4e63-9f40-3925cd0c633b, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149356738, endTime=null, startTime=1659149357041, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=QQk5rtFErhhGCzrnj10XWw==, generatedId=dwcasa:US.b3d417d4-16e3-4e63-9f40-3925cd0c633b, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/b3d417d4-16e3-4e63-9f40-3925cd0c633b?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_zcc_omie_accounts}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:49:19 destination > 2022-07-30 02:49:19 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=b3d417d4-16e3-4e63-9f40-3925cd0c633b, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149356738, endTime=null, startTime=1659149357041, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=QQk5rtFErhhGCzrnj10XWw==, generatedId=dwcasa:US.b3d417d4-16e3-4e63-9f40-3925cd0c633b, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/b3d417d4-16e3-4e63-9f40-3925cd0c633b?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_zcc_omie_accounts}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:49:19 destination > 2022-07-30 02:49:19 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_zcc_omie_accounts to the source table _airbyte_raw_omie_accounts. 2022-07-30 02:49:19 destination > 2022-07-30 02:49:19 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:49:23 destination > 2022-07-30 02:49:23 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_zcc_omie_accounts}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_omie_accounts}} 2022-07-30 02:49:23 destination > 2022-07-30 02:49:23 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_omie_accounts! 2022-07-30 02:49:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@2b50a4e0[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@41102779[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:49:23 destination > 2022-07-30 02:49:23 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:49:23 destination > 2022-07-30 02:49:23 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:49:23 destination > 2022-07-30 02:49:23 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:49:23 destination > 2022-07-30 02:49:23 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_omie_accounts, tmpTable=_airbyte_tmp_zcc_omie_accounts, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:49:23 destination > 2022-07-30 02:49:23 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_requested_products, tmpTable=_airbyte_tmp_mcs_requested_products, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:49:24 destination > 2022-07-30 02:49:24 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=e438bd80-ca88-47d1-b2d9-78026551d0af, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149363960, endTime=null, startTime=1659149364268, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=HYd1gMovlxxWCCOIiPLqGw==, generatedId=dwcasa:US.e438bd80-ca88-47d1-b2d9-78026551d0af, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/e438bd80-ca88-47d1-b2d9-78026551d0af?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_mcs_requested_products}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:49:28 destination > 2022-07-30 02:49:28 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=e438bd80-ca88-47d1-b2d9-78026551d0af, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149363960, endTime=null, startTime=1659149364268, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=HYd1gMovlxxWCCOIiPLqGw==, generatedId=dwcasa:US.e438bd80-ca88-47d1-b2d9-78026551d0af, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/e438bd80-ca88-47d1-b2d9-78026551d0af?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_mcs_requested_products}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:49:28 destination > 2022-07-30 02:49:28 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_mcs_requested_products to the source table _airbyte_raw_requested_products. 2022-07-30 02:49:28 destination > 2022-07-30 02:49:28 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:49:31 destination > 2022-07-30 02:49:31 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_mcs_requested_products}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_requested_products}} 2022-07-30 02:49:31 destination > 2022-07-30 02:49:31 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_requested_products! 2022-07-30 02:49:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@186ab9bf[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@3c8ae884[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:49:31 destination > 2022-07-30 02:49:31 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:49:31 destination > 2022-07-30 02:49:31 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:49:31 destination > 2022-07-30 02:49:31 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:49:31 destination > 2022-07-30 02:49:31 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_requested_products, tmpTable=_airbyte_tmp_mcs_requested_products, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:49:31 destination > 2022-07-30 02:49:31 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_product_orders, tmpTable=_airbyte_tmp_rul_product_orders, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:49:32 destination > 2022-07-30 02:49:32 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=eadcf5fd-dfc3-4b07-a1a8-262b5fd5bed3, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149372051, endTime=null, startTime=1659149372424, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=xG1UMX95eC8hQRtDr6C54A==, generatedId=dwcasa:US.eadcf5fd-dfc3-4b07-a1a8-262b5fd5bed3, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/eadcf5fd-dfc3-4b07-a1a8-262b5fd5bed3?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_rul_product_orders}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:49:40 destination > 2022-07-30 02:49:40 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=eadcf5fd-dfc3-4b07-a1a8-262b5fd5bed3, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149372051, endTime=null, startTime=1659149372424, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=xG1UMX95eC8hQRtDr6C54A==, generatedId=dwcasa:US.eadcf5fd-dfc3-4b07-a1a8-262b5fd5bed3, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/eadcf5fd-dfc3-4b07-a1a8-262b5fd5bed3?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_rul_product_orders}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:49:40 destination > 2022-07-30 02:49:40 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_rul_product_orders to the source table _airbyte_raw_product_orders. 2022-07-30 02:49:40 destination > 2022-07-30 02:49:40 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:49:43 destination > 2022-07-30 02:49:43 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_rul_product_orders}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_product_orders}} 2022-07-30 02:49:43 destination > 2022-07-30 02:49:43 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_product_orders! 2022-07-30 02:49:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@12d32c51[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@52b8fa9d[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:49:43 destination > 2022-07-30 02:49:43 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:49:43 destination > 2022-07-30 02:49:43 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:49:43 destination > 2022-07-30 02:49:43 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:49:43 destination > 2022-07-30 02:49:43 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_product_orders, tmpTable=_airbyte_tmp_rul_product_orders, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:49:43 destination > 2022-07-30 02:49:43 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_sidekiq_sequence_records, tmpTable=_airbyte_tmp_shj_sidekiq_sequence_records, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:49:44 destination > 2022-07-30 02:49:44 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=a1d588a4-1039-4244-9c61-fb87edf687e0, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149384054, endTime=null, startTime=1659149384288, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=oAeuiJncRVPFWP61YOk3kA==, generatedId=dwcasa:US.a1d588a4-1039-4244-9c61-fb87edf687e0, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/a1d588a4-1039-4244-9c61-fb87edf687e0?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_shj_sidekiq_sequence_records}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:49:49 destination > 2022-07-30 02:49:49 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=a1d588a4-1039-4244-9c61-fb87edf687e0, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149384054, endTime=null, startTime=1659149384288, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=oAeuiJncRVPFWP61YOk3kA==, generatedId=dwcasa:US.a1d588a4-1039-4244-9c61-fb87edf687e0, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/a1d588a4-1039-4244-9c61-fb87edf687e0?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_shj_sidekiq_sequence_records}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:49:49 destination > 2022-07-30 02:49:49 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_shj_sidekiq_sequence_records to the source table _airbyte_raw_sidekiq_sequence_records. 2022-07-30 02:49:49 destination > 2022-07-30 02:49:49 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:49:53 destination > 2022-07-30 02:49:53 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_shj_sidekiq_sequence_records}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_sidekiq_sequence_records}} 2022-07-30 02:49:53 destination > 2022-07-30 02:49:53 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_sidekiq_sequence_records! 2022-07-30 02:49:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@1fd20634[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@74f70382[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:49:53 destination > 2022-07-30 02:49:53 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:49:53 destination > 2022-07-30 02:49:53 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:49:53 destination > 2022-07-30 02:49:53 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:49:53 destination > 2022-07-30 02:49:53 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_sidekiq_sequence_records, tmpTable=_airbyte_tmp_shj_sidekiq_sequence_records, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:49:53 destination > 2022-07-30 02:49:53 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_store_orders, tmpTable=_airbyte_tmp_agt_store_orders, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:49:54 destination > 2022-07-30 02:49:54 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=d690af2d-531c-476f-83de-1c244116b3d0, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149393912, endTime=null, startTime=1659149394205, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=hoFaN4/URr4OwZ95qip3JA==, generatedId=dwcasa:US.d690af2d-531c-476f-83de-1c244116b3d0, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/d690af2d-531c-476f-83de-1c244116b3d0?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_agt_store_orders}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:49:57 destination > 2022-07-30 02:49:57 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=d690af2d-531c-476f-83de-1c244116b3d0, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149393912, endTime=null, startTime=1659149394205, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=hoFaN4/URr4OwZ95qip3JA==, generatedId=dwcasa:US.d690af2d-531c-476f-83de-1c244116b3d0, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/d690af2d-531c-476f-83de-1c244116b3d0?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_agt_store_orders}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:49:57 destination > 2022-07-30 02:49:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_agt_store_orders to the source table _airbyte_raw_store_orders. 2022-07-30 02:49:57 destination > 2022-07-30 02:49:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:49:59 destination > 2022-07-30 02:49:59 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_agt_store_orders}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_store_orders}} 2022-07-30 02:49:59 destination > 2022-07-30 02:49:59 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_store_orders! 2022-07-30 02:49:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@7f4d08e9[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@6a34698f[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:49:59 destination > 2022-07-30 02:49:59 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:49:59 destination > 2022-07-30 02:49:59 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:50:00 destination > 2022-07-30 02:50:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:50:00 destination > 2022-07-30 02:50:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_store_orders, tmpTable=_airbyte_tmp_agt_store_orders, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:50:00 destination > 2022-07-30 02:50:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_buyer_contacts, tmpTable=_airbyte_tmp_yoo_buyer_contacts, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:50:00 destination > 2022-07-30 02:50:00 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=ab6917dc-8572-4f4f-ad7a-680f142659d5, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149400417, endTime=null, startTime=1659149400687, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=ilWOqbNTujFpar8EPyQGEw==, generatedId=dwcasa:US.ab6917dc-8572-4f4f-ad7a-680f142659d5, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/ab6917dc-8572-4f4f-ad7a-680f142659d5?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_yoo_buyer_contacts}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:50:03 destination > 2022-07-30 02:50:03 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=ab6917dc-8572-4f4f-ad7a-680f142659d5, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149400417, endTime=null, startTime=1659149400687, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=ilWOqbNTujFpar8EPyQGEw==, generatedId=dwcasa:US.ab6917dc-8572-4f4f-ad7a-680f142659d5, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/ab6917dc-8572-4f4f-ad7a-680f142659d5?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_yoo_buyer_contacts}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:50:03 destination > 2022-07-30 02:50:03 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_yoo_buyer_contacts to the source table _airbyte_raw_buyer_contacts. 2022-07-30 02:50:03 destination > 2022-07-30 02:50:03 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:50:06 destination > 2022-07-30 02:50:06 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_yoo_buyer_contacts}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_buyer_contacts}} 2022-07-30 02:50:06 destination > 2022-07-30 02:50:06 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_buyer_contacts! 2022-07-30 02:50:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@6558315b[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@29ffc561[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:50:06 destination > 2022-07-30 02:50:06 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:50:06 destination > 2022-07-30 02:50:06 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:50:06 destination > 2022-07-30 02:50:06 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:50:06 destination > 2022-07-30 02:50:06 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_buyer_contacts, tmpTable=_airbyte_tmp_yoo_buyer_contacts, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:50:06 destination > 2022-07-30 02:50:06 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_buyer_locations, tmpTable=_airbyte_tmp_hwt_buyer_locations, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:50:07 destination > 2022-07-30 02:50:07 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=d601679e-2ad5-4bb8-bce1-c006318cb0ff, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149407364, endTime=null, startTime=1659149407596, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=QXTs2jSkdUyLwCtaOPY+rw==, generatedId=dwcasa:US.d601679e-2ad5-4bb8-bce1-c006318cb0ff, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/d601679e-2ad5-4bb8-bce1-c006318cb0ff?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_hwt_buyer_locations}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:50:10 destination > 2022-07-30 02:50:10 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=d601679e-2ad5-4bb8-bce1-c006318cb0ff, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149407364, endTime=null, startTime=1659149407596, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=QXTs2jSkdUyLwCtaOPY+rw==, generatedId=dwcasa:US.d601679e-2ad5-4bb8-bce1-c006318cb0ff, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/d601679e-2ad5-4bb8-bce1-c006318cb0ff?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_hwt_buyer_locations}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:50:10 destination > 2022-07-30 02:50:10 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_hwt_buyer_locations to the source table _airbyte_raw_buyer_locations. 2022-07-30 02:50:10 destination > 2022-07-30 02:50:10 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:50:14 destination > 2022-07-30 02:50:14 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_hwt_buyer_locations}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_buyer_locations}} 2022-07-30 02:50:14 destination > 2022-07-30 02:50:14 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_buyer_locations! 2022-07-30 02:50:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@3e628af7[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@7753f4a5[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:50:14 destination > 2022-07-30 02:50:14 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:50:14 destination > 2022-07-30 02:50:14 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:50:15 destination > 2022-07-30 02:50:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:50:15 destination > 2022-07-30 02:50:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_buyer_locations, tmpTable=_airbyte_tmp_hwt_buyer_locations, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:50:15 destination > 2022-07-30 02:50:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_stores, tmpTable=_airbyte_tmp_tfl_stores, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:50:15 destination > 2022-07-30 02:50:15 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=c8b99d2b-5d0d-4b00-b7bd-609782802e4f, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149415522, endTime=null, startTime=1659149415823, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=jXO35PTIAH3Y8tYdo6I44g==, generatedId=dwcasa:US.c8b99d2b-5d0d-4b00-b7bd-609782802e4f, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/c8b99d2b-5d0d-4b00-b7bd-609782802e4f?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_tfl_stores}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:50:18 destination > 2022-07-30 02:50:18 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=c8b99d2b-5d0d-4b00-b7bd-609782802e4f, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149415522, endTime=null, startTime=1659149415823, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=jXO35PTIAH3Y8tYdo6I44g==, generatedId=dwcasa:US.c8b99d2b-5d0d-4b00-b7bd-609782802e4f, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/c8b99d2b-5d0d-4b00-b7bd-609782802e4f?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_tfl_stores}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:50:18 destination > 2022-07-30 02:50:18 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_tfl_stores to the source table _airbyte_raw_stores. 2022-07-30 02:50:18 destination > 2022-07-30 02:50:18 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:50:22 destination > 2022-07-30 02:50:22 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_tfl_stores}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_stores}} 2022-07-30 02:50:22 destination > 2022-07-30 02:50:22 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_stores! 2022-07-30 02:50:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@5325d1fd[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@426c235[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:50:22 destination > 2022-07-30 02:50:22 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:50:22 destination > 2022-07-30 02:50:22 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:50:22 destination > 2022-07-30 02:50:22 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:50:22 destination > 2022-07-30 02:50:22 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_stores, tmpTable=_airbyte_tmp_tfl_stores, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:50:22 destination > 2022-07-30 02:50:22 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_payments, tmpTable=_airbyte_tmp_mqe_payments, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:50:23 destination > 2022-07-30 02:50:23 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=6bd2a263-2b5f-4dc4-8331-ec9bf91db38d, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149423294, endTime=null, startTime=1659149423648, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=HlKdTggSmjSsDdD5fnU9JQ==, generatedId=dwcasa:US.6bd2a263-2b5f-4dc4-8331-ec9bf91db38d, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/6bd2a263-2b5f-4dc4-8331-ec9bf91db38d?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_mqe_payments}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:50:29 destination > 2022-07-30 02:50:29 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=6bd2a263-2b5f-4dc4-8331-ec9bf91db38d, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149423294, endTime=null, startTime=1659149423648, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=HlKdTggSmjSsDdD5fnU9JQ==, generatedId=dwcasa:US.6bd2a263-2b5f-4dc4-8331-ec9bf91db38d, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/6bd2a263-2b5f-4dc4-8331-ec9bf91db38d?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_mqe_payments}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:50:29 destination > 2022-07-30 02:50:29 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_mqe_payments to the source table _airbyte_raw_payments. 2022-07-30 02:50:29 destination > 2022-07-30 02:50:29 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:50:32 destination > 2022-07-30 02:50:32 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_mqe_payments}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_payments}} 2022-07-30 02:50:32 destination > 2022-07-30 02:50:32 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_payments! 2022-07-30 02:50:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@2eb9d574[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@4627fada[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:50:32 destination > 2022-07-30 02:50:32 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:50:32 destination > 2022-07-30 02:50:32 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:50:32 destination > 2022-07-30 02:50:32 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:50:32 destination > 2022-07-30 02:50:32 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_payments, tmpTable=_airbyte_tmp_mqe_payments, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:50:32 destination > 2022-07-30 02:50:32 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_payer_buyer_locations, tmpTable=_airbyte_tmp_lpt_payer_buyer_locations, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:50:33 destination > 2022-07-30 02:50:33 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=8ffe3544-926d-4163-b6f9-ba3bbaeead7f, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149432927, endTime=null, startTime=1659149433151, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=MfgwGZ6RQtworl3lnrbcPg==, generatedId=dwcasa:US.8ffe3544-926d-4163-b6f9-ba3bbaeead7f, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/8ffe3544-926d-4163-b6f9-ba3bbaeead7f?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_lpt_payer_buyer_locations}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:50:36 destination > 2022-07-30 02:50:36 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=8ffe3544-926d-4163-b6f9-ba3bbaeead7f, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149432927, endTime=null, startTime=1659149433151, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=MfgwGZ6RQtworl3lnrbcPg==, generatedId=dwcasa:US.8ffe3544-926d-4163-b6f9-ba3bbaeead7f, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/8ffe3544-926d-4163-b6f9-ba3bbaeead7f?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_lpt_payer_buyer_locations}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:50:36 destination > 2022-07-30 02:50:36 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_lpt_payer_buyer_locations to the source table _airbyte_raw_payer_buyer_locations. 2022-07-30 02:50:36 destination > 2022-07-30 02:50:36 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:50:39 destination > 2022-07-30 02:50:39 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_lpt_payer_buyer_locations}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_payer_buyer_locations}} 2022-07-30 02:50:39 destination > 2022-07-30 02:50:39 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_payer_buyer_locations! 2022-07-30 02:50:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@3bf061da[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@9753bfb[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:50:39 destination > 2022-07-30 02:50:39 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:50:39 destination > 2022-07-30 02:50:39 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:50:39 destination > 2022-07-30 02:50:39 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:50:39 destination > 2022-07-30 02:50:39 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_payer_buyer_locations, tmpTable=_airbyte_tmp_lpt_payer_buyer_locations, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:50:39 destination > 2022-07-30 02:50:39 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_store_users, tmpTable=_airbyte_tmp_yvh_store_users, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:50:40 destination > 2022-07-30 02:50:40 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=4d4200fc-aa22-4d48-92ee-7286a79e4a3a, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149439779, endTime=null, startTime=1659149439990, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=OSyuJ52edMKssdFGOxc3Sw==, generatedId=dwcasa:US.4d4200fc-aa22-4d48-92ee-7286a79e4a3a, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/4d4200fc-aa22-4d48-92ee-7286a79e4a3a?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_yvh_store_users}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:50:43 destination > 2022-07-30 02:50:43 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=4d4200fc-aa22-4d48-92ee-7286a79e4a3a, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149439779, endTime=null, startTime=1659149439990, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=OSyuJ52edMKssdFGOxc3Sw==, generatedId=dwcasa:US.4d4200fc-aa22-4d48-92ee-7286a79e4a3a, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/4d4200fc-aa22-4d48-92ee-7286a79e4a3a?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_yvh_store_users}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:50:43 destination > 2022-07-30 02:50:43 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_yvh_store_users to the source table _airbyte_raw_store_users. 2022-07-30 02:50:43 destination > 2022-07-30 02:50:43 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:50:45 destination > 2022-07-30 02:50:45 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_yvh_store_users}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_store_users}} 2022-07-30 02:50:45 destination > 2022-07-30 02:50:45 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_store_users! 2022-07-30 02:50:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@69874dd4[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@100f9b14[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:50:45 destination > 2022-07-30 02:50:45 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:50:45 destination > 2022-07-30 02:50:45 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:50:45 destination > 2022-07-30 02:50:45 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:50:45 destination > 2022-07-30 02:50:45 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_store_users, tmpTable=_airbyte_tmp_yvh_store_users, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:50:45 destination > 2022-07-30 02:50:45 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_freight_partner_vehicles, tmpTable=_airbyte_tmp_tmw_freight_partner_vehicles, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:50:46 destination > 2022-07-30 02:50:46 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=f11a8c78-e578-454b-ae3a-9c33d918d1b4, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149446306, endTime=null, startTime=1659149446593, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=2IAotGkL0T6qS6U3fXmpKQ==, generatedId=dwcasa:US.f11a8c78-e578-454b-ae3a-9c33d918d1b4, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/f11a8c78-e578-454b-ae3a-9c33d918d1b4?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_tmw_freight_partner_vehicles}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:50:50 destination > 2022-07-30 02:50:50 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=f11a8c78-e578-454b-ae3a-9c33d918d1b4, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149446306, endTime=null, startTime=1659149446593, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=2IAotGkL0T6qS6U3fXmpKQ==, generatedId=dwcasa:US.f11a8c78-e578-454b-ae3a-9c33d918d1b4, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/f11a8c78-e578-454b-ae3a-9c33d918d1b4?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_tmw_freight_partner_vehicles}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:50:50 destination > 2022-07-30 02:50:50 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_tmw_freight_partner_vehicles to the source table _airbyte_raw_freight_partner_vehicles. 2022-07-30 02:50:50 destination > 2022-07-30 02:50:50 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:50:56 destination > 2022-07-30 02:50:56 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_tmw_freight_partner_vehicles}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_freight_partner_vehicles}} 2022-07-30 02:50:56 destination > 2022-07-30 02:50:56 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_freight_partner_vehicles! 2022-07-30 02:50:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@2849d67e[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@8c38a6f[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:50:56 destination > 2022-07-30 02:50:56 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:50:56 destination > 2022-07-30 02:50:56 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:50:57 destination > 2022-07-30 02:50:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:50:57 destination > 2022-07-30 02:50:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_freight_partner_vehicles, tmpTable=_airbyte_tmp_tmw_freight_partner_vehicles, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:50:57 destination > 2022-07-30 02:50:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_orders, tmpTable=_airbyte_tmp_uls_orders, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:50:57 destination > 2022-07-30 02:50:57 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=24e7088a-0f14-4c2d-a7eb-466a373af5d1, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149457587, endTime=null, startTime=1659149457858, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=RpMqjTTn3PM3FCiwq16Y0w==, generatedId=dwcasa:US.24e7088a-0f14-4c2d-a7eb-466a373af5d1, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/24e7088a-0f14-4c2d-a7eb-466a373af5d1?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_uls_orders}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:51:03 destination > 2022-07-30 02:51:03 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=24e7088a-0f14-4c2d-a7eb-466a373af5d1, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149457587, endTime=null, startTime=1659149457858, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=RpMqjTTn3PM3FCiwq16Y0w==, generatedId=dwcasa:US.24e7088a-0f14-4c2d-a7eb-466a373af5d1, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/24e7088a-0f14-4c2d-a7eb-466a373af5d1?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_uls_orders}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:51:03 destination > 2022-07-30 02:51:03 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_uls_orders to the source table _airbyte_raw_orders. 2022-07-30 02:51:03 destination > 2022-07-30 02:51:03 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:51:11 destination > 2022-07-30 02:51:11 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_uls_orders}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_orders}} 2022-07-30 02:51:11 destination > 2022-07-30 02:51:11 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_orders! 2022-07-30 02:51:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@5b799f4e[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@37c2680e[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:51:11 destination > 2022-07-30 02:51:11 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:51:11 destination > 2022-07-30 02:51:11 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:51:11 destination > 2022-07-30 02:51:11 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:51:11 destination > 2022-07-30 02:51:11 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_orders, tmpTable=_airbyte_tmp_uls_orders, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:51:11 destination > 2022-07-30 02:51:11 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_spatial_ref_sys, tmpTable=_airbyte_tmp_zvw_spatial_ref_sys, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:51:11 destination > 2022-07-30 02:51:11 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_zvw_spatial_ref_sys to the source table _airbyte_raw_spatial_ref_sys. 2022-07-30 02:51:11 destination > 2022-07-30 02:51:11 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:51:13 destination > 2022-07-30 02:51:13 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_zvw_spatial_ref_sys}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_spatial_ref_sys}} 2022-07-30 02:51:13 destination > 2022-07-30 02:51:13 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_spatial_ref_sys! 2022-07-30 02:51:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@51dea2ae[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@45daca08[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:51:13 destination > 2022-07-30 02:51:13 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:51:13 destination > 2022-07-30 02:51:13 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:51:13 destination > 2022-07-30 02:51:13 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:51:13 destination > 2022-07-30 02:51:13 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_spatial_ref_sys, tmpTable=_airbyte_tmp_zvw_spatial_ref_sys, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:51:13 destination > 2022-07-30 02:51:13 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_store_locations, tmpTable=_airbyte_tmp_iac_store_locations, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:51:14 destination > 2022-07-30 02:51:14 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=aa66d5d7-ba07-4956-8863-3d420e17e59d, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149473806, endTime=null, startTime=1659149474028, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=LCfVarUplv2IYydoVxwtIQ==, generatedId=dwcasa:US.aa66d5d7-ba07-4956-8863-3d420e17e59d, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/aa66d5d7-ba07-4956-8863-3d420e17e59d?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_iac_store_locations}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:51:16 destination > 2022-07-30 02:51:16 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=aa66d5d7-ba07-4956-8863-3d420e17e59d, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149473806, endTime=null, startTime=1659149474028, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=LCfVarUplv2IYydoVxwtIQ==, generatedId=dwcasa:US.aa66d5d7-ba07-4956-8863-3d420e17e59d, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/aa66d5d7-ba07-4956-8863-3d420e17e59d?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_iac_store_locations}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:51:16 destination > 2022-07-30 02:51:16 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_iac_store_locations to the source table _airbyte_raw_store_locations. 2022-07-30 02:51:16 destination > 2022-07-30 02:51:16 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:51:20 destination > 2022-07-30 02:51:20 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_iac_store_locations}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_store_locations}} 2022-07-30 02:51:20 destination > 2022-07-30 02:51:20 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_store_locations! 2022-07-30 02:51:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@524ebe12[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@76683e4d[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:51:20 destination > 2022-07-30 02:51:20 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:51:20 destination > 2022-07-30 02:51:20 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:51:20 destination > 2022-07-30 02:51:20 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:51:20 destination > 2022-07-30 02:51:20 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_store_locations, tmpTable=_airbyte_tmp_iac_store_locations, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:51:20 destination > 2022-07-30 02:51:20 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_freights, tmpTable=_airbyte_tmp_dsp_freights, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:51:21 destination > 2022-07-30 02:51:21 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=f719d2cd-9b92-4cb8-a013-ee8be880754b, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149481076, endTime=null, startTime=1659149481331, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=KnhiwOr6HWSykW2imlDyJg==, generatedId=dwcasa:US.f719d2cd-9b92-4cb8-a013-ee8be880754b, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/f719d2cd-9b92-4cb8-a013-ee8be880754b?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_dsp_freights}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:51:25 destination > 2022-07-30 02:51:25 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=f719d2cd-9b92-4cb8-a013-ee8be880754b, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149481076, endTime=null, startTime=1659149481331, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=KnhiwOr6HWSykW2imlDyJg==, generatedId=dwcasa:US.f719d2cd-9b92-4cb8-a013-ee8be880754b, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/f719d2cd-9b92-4cb8-a013-ee8be880754b?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_dsp_freights}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:51:25 destination > 2022-07-30 02:51:25 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_dsp_freights to the source table _airbyte_raw_freights. 2022-07-30 02:51:25 destination > 2022-07-30 02:51:25 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:51:29 destination > 2022-07-30 02:51:29 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_dsp_freights}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_freights}} 2022-07-30 02:51:29 destination > 2022-07-30 02:51:29 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_freights! 2022-07-30 02:51:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@520729fc[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@419e333e[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:51:29 destination > 2022-07-30 02:51:29 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:51:29 destination > 2022-07-30 02:51:29 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:51:29 destination > 2022-07-30 02:51:29 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:51:29 destination > 2022-07-30 02:51:29 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_freights, tmpTable=_airbyte_tmp_dsp_freights, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:51:29 destination > 2022-07-30 02:51:29 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_active_storage_attachments, tmpTable=_airbyte_tmp_tis_active_storage_attachments, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:51:30 destination > 2022-07-30 02:51:30 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=404e0c6d-2000-40a7-b125-1c2066735e5b, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149489658, endTime=null, startTime=1659149489929, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=gCFapY1q3SKsFsju87GVbw==, generatedId=dwcasa:US.404e0c6d-2000-40a7-b125-1c2066735e5b, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/404e0c6d-2000-40a7-b125-1c2066735e5b?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_tis_active_storage_attachments}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:51:51 destination > 2022-07-30 02:51:51 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=404e0c6d-2000-40a7-b125-1c2066735e5b, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149489658, endTime=null, startTime=1659149489929, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=gCFapY1q3SKsFsju87GVbw==, generatedId=dwcasa:US.404e0c6d-2000-40a7-b125-1c2066735e5b, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/404e0c6d-2000-40a7-b125-1c2066735e5b?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_tis_active_storage_attachments}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:51:51 destination > 2022-07-30 02:51:51 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_tis_active_storage_attachments to the source table _airbyte_raw_active_storage_attachments. 2022-07-30 02:51:51 destination > 2022-07-30 02:51:51 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:51:55 destination > 2022-07-30 02:51:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_tis_active_storage_attachments}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_active_storage_attachments}} 2022-07-30 02:51:55 destination > 2022-07-30 02:51:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_active_storage_attachments! 2022-07-30 02:51:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@6687bb31[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@512a7bfa[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:51:55 destination > 2022-07-30 02:51:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:51:55 destination > 2022-07-30 02:51:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:51:55 destination > 2022-07-30 02:51:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:51:55 destination > 2022-07-30 02:51:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_active_storage_attachments, tmpTable=_airbyte_tmp_tis_active_storage_attachments, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:51:55 destination > 2022-07-30 02:51:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_ar_internal_metadata, tmpTable=_airbyte_tmp_lnb_ar_internal_metadata, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:51:55 destination > 2022-07-30 02:51:55 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=86e7fb3d-3159-4e56-990c-e33c153bb604, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149515554, endTime=null, startTime=1659149515827, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=WavEMZpFSrJax3zZyfRsyw==, generatedId=dwcasa:US.86e7fb3d-3159-4e56-990c-e33c153bb604, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/86e7fb3d-3159-4e56-990c-e33c153bb604?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_lnb_ar_internal_metadata}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:51:57 destination > 2022-07-30 02:51:57 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=86e7fb3d-3159-4e56-990c-e33c153bb604, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149515554, endTime=null, startTime=1659149515827, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=WavEMZpFSrJax3zZyfRsyw==, generatedId=dwcasa:US.86e7fb3d-3159-4e56-990c-e33c153bb604, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/86e7fb3d-3159-4e56-990c-e33c153bb604?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_lnb_ar_internal_metadata}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:51:57 destination > 2022-07-30 02:51:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_lnb_ar_internal_metadata to the source table _airbyte_raw_ar_internal_metadata. 2022-07-30 02:51:57 destination > 2022-07-30 02:51:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:52:00 destination > 2022-07-30 02:52:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_lnb_ar_internal_metadata}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_ar_internal_metadata}} 2022-07-30 02:52:00 destination > 2022-07-30 02:52:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_ar_internal_metadata! 2022-07-30 02:52:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@3a89f0ea[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@abe2346[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:52:00 destination > 2022-07-30 02:52:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:52:00 destination > 2022-07-30 02:52:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:52:00 destination > 2022-07-30 02:52:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:52:00 destination > 2022-07-30 02:52:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_ar_internal_metadata, tmpTable=_airbyte_tmp_lnb_ar_internal_metadata, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:52:00 destination > 2022-07-30 02:52:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_freight_route_groupings, tmpTable=_airbyte_tmp_opu_freight_route_groupings, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:52:01 destination > 2022-07-30 02:52:01 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=1884fe11-7cb8-445b-a0c4-b783ce13c9b3, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149521328, endTime=null, startTime=1659149521641, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=IDMhL9n5IURy3xWY5PDXig==, generatedId=dwcasa:US.1884fe11-7cb8-445b-a0c4-b783ce13c9b3, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/1884fe11-7cb8-445b-a0c4-b783ce13c9b3?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_opu_freight_route_groupings}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:52:04 destination > 2022-07-30 02:52:04 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=1884fe11-7cb8-445b-a0c4-b783ce13c9b3, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149521328, endTime=null, startTime=1659149521641, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=IDMhL9n5IURy3xWY5PDXig==, generatedId=dwcasa:US.1884fe11-7cb8-445b-a0c4-b783ce13c9b3, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/1884fe11-7cb8-445b-a0c4-b783ce13c9b3?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_opu_freight_route_groupings}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:52:04 destination > 2022-07-30 02:52:04 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_opu_freight_route_groupings to the source table _airbyte_raw_freight_route_groupings. 2022-07-30 02:52:04 destination > 2022-07-30 02:52:04 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:52:08 destination > 2022-07-30 02:52:08 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_opu_freight_route_groupings}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_freight_route_groupings}} 2022-07-30 02:52:08 destination > 2022-07-30 02:52:08 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_freight_route_groupings! 2022-07-30 02:52:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@51bb5f13[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@534c1b75[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:52:08 destination > 2022-07-30 02:52:08 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:52:08 destination > 2022-07-30 02:52:08 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:52:08 destination > 2022-07-30 02:52:08 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:52:08 destination > 2022-07-30 02:52:08 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_freight_route_groupings, tmpTable=_airbyte_tmp_opu_freight_route_groupings, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:52:08 destination > 2022-07-30 02:52:08 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_buyers, tmpTable=_airbyte_tmp_mpz_buyers, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:52:09 destination > 2022-07-30 02:52:09 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=24bc2ef5-c0e9-4eda-b6cb-2e3138e6c42f, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149528668, endTime=null, startTime=1659149528927, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=4FAfBSp/HBEUxarWJwYO+w==, generatedId=dwcasa:US.24bc2ef5-c0e9-4eda-b6cb-2e3138e6c42f, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/24bc2ef5-c0e9-4eda-b6cb-2e3138e6c42f?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_mpz_buyers}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:52:12 destination > 2022-07-30 02:52:12 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=24bc2ef5-c0e9-4eda-b6cb-2e3138e6c42f, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149528668, endTime=null, startTime=1659149528927, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=4FAfBSp/HBEUxarWJwYO+w==, generatedId=dwcasa:US.24bc2ef5-c0e9-4eda-b6cb-2e3138e6c42f, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/24bc2ef5-c0e9-4eda-b6cb-2e3138e6c42f?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_mpz_buyers}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:52:12 destination > 2022-07-30 02:52:12 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_mpz_buyers to the source table _airbyte_raw_buyers. 2022-07-30 02:52:12 destination > 2022-07-30 02:52:12 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:52:15 destination > 2022-07-30 02:52:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_mpz_buyers}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_buyers}} 2022-07-30 02:52:15 destination > 2022-07-30 02:52:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_buyers! 2022-07-30 02:52:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@26b7af56[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@5d681cd5[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:52:15 destination > 2022-07-30 02:52:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:52:15 destination > 2022-07-30 02:52:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:52:15 destination > 2022-07-30 02:52:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:52:15 destination > 2022-07-30 02:52:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_buyers, tmpTable=_airbyte_tmp_mpz_buyers, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:52:15 destination > 2022-07-30 02:52:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_memento_sessions, tmpTable=_airbyte_tmp_dqm_memento_sessions, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:52:16 destination > 2022-07-30 02:52:16 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=613e3798-4c37-4915-857a-d3cb6b9a1ea1, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149535830, endTime=null, startTime=1659149536068, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=iUTR9s7muIVzpbYHxRRLvw==, generatedId=dwcasa:US.613e3798-4c37-4915-857a-d3cb6b9a1ea1, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/613e3798-4c37-4915-857a-d3cb6b9a1ea1?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_dqm_memento_sessions}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:52:19 destination > 2022-07-30 02:52:19 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=613e3798-4c37-4915-857a-d3cb6b9a1ea1, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149535830, endTime=null, startTime=1659149536068, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=iUTR9s7muIVzpbYHxRRLvw==, generatedId=dwcasa:US.613e3798-4c37-4915-857a-d3cb6b9a1ea1, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/613e3798-4c37-4915-857a-d3cb6b9a1ea1?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_dqm_memento_sessions}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:52:19 destination > 2022-07-30 02:52:19 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_dqm_memento_sessions to the source table _airbyte_raw_memento_sessions. 2022-07-30 02:52:19 destination > 2022-07-30 02:52:19 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:52:24 destination > 2022-07-30 02:52:24 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_dqm_memento_sessions}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_memento_sessions}} 2022-07-30 02:52:24 destination > 2022-07-30 02:52:24 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_memento_sessions! 2022-07-30 02:52:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@562093ac[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@6504bdae[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:52:24 destination > 2022-07-30 02:52:24 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:52:24 destination > 2022-07-30 02:52:24 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:52:24 destination > 2022-07-30 02:52:24 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:52:24 destination > 2022-07-30 02:52:24 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_memento_sessions, tmpTable=_airbyte_tmp_dqm_memento_sessions, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:52:24 destination > 2022-07-30 02:52:24 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_freight_routes, tmpTable=_airbyte_tmp_vpa_freight_routes, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:52:25 destination > 2022-07-30 02:52:25 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=db2f2020-2665-4c13-8498-457d003a3164, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149544643, endTime=null, startTime=1659149544905, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=jZO7BDQYhL2MoWHUVqxikQ==, generatedId=dwcasa:US.db2f2020-2665-4c13-8498-457d003a3164, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/db2f2020-2665-4c13-8498-457d003a3164?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_vpa_freight_routes}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:52:47 destination > 2022-07-30 02:52:47 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=db2f2020-2665-4c13-8498-457d003a3164, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149544643, endTime=null, startTime=1659149544905, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=jZO7BDQYhL2MoWHUVqxikQ==, generatedId=dwcasa:US.db2f2020-2665-4c13-8498-457d003a3164, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/db2f2020-2665-4c13-8498-457d003a3164?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_vpa_freight_routes}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:52:47 destination > 2022-07-30 02:52:47 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_vpa_freight_routes to the source table _airbyte_raw_freight_routes. 2022-07-30 02:52:47 destination > 2022-07-30 02:52:47 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:52:52 destination > 2022-07-30 02:52:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_vpa_freight_routes}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_freight_routes}} 2022-07-30 02:52:52 destination > 2022-07-30 02:52:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_freight_routes! 2022-07-30 02:52:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@7e527347[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@63c146ec[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:52:52 destination > 2022-07-30 02:52:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:52:52 destination > 2022-07-30 02:52:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:52:52 destination > 2022-07-30 02:52:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:52:52 destination > 2022-07-30 02:52:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_freight_routes, tmpTable=_airbyte_tmp_vpa_freight_routes, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:52:52 destination > 2022-07-30 02:52:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_order_categories, tmpTable=_airbyte_tmp_vsj_order_categories, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:52:52 destination > 2022-07-30 02:52:52 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=e7b3c37b-4bf8-40f2-979a-6cb33b3272e3, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149572502, endTime=null, startTime=1659149572759, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=/P7ILGMA0yxqvIOnN4U6FQ==, generatedId=dwcasa:US.e7b3c37b-4bf8-40f2-979a-6cb33b3272e3, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/e7b3c37b-4bf8-40f2-979a-6cb33b3272e3?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_vsj_order_categories}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:52:56 destination > 2022-07-30 02:52:56 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=e7b3c37b-4bf8-40f2-979a-6cb33b3272e3, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149572502, endTime=null, startTime=1659149572759, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=/P7ILGMA0yxqvIOnN4U6FQ==, generatedId=dwcasa:US.e7b3c37b-4bf8-40f2-979a-6cb33b3272e3, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/e7b3c37b-4bf8-40f2-979a-6cb33b3272e3?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_vsj_order_categories}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:52:56 destination > 2022-07-30 02:52:56 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_vsj_order_categories to the source table _airbyte_raw_order_categories. 2022-07-30 02:52:56 destination > 2022-07-30 02:52:56 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:53:00 destination > 2022-07-30 02:53:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_vsj_order_categories}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_order_categories}} 2022-07-30 02:53:00 destination > 2022-07-30 02:53:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_order_categories! 2022-07-30 02:53:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@312e04cb[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@7107268d[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:53:00 destination > 2022-07-30 02:53:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:53:00 destination > 2022-07-30 02:53:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:53:00 destination > 2022-07-30 02:53:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:53:00 destination > 2022-07-30 02:53:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_order_categories, tmpTable=_airbyte_tmp_vsj_order_categories, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:53:00 destination > 2022-07-30 02:53:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_order_feedbacks, tmpTable=_airbyte_tmp_rqq_order_feedbacks, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:53:01 destination > 2022-07-30 02:53:01 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=160031a6-23a0-44d0-9d25-e998aa9dd1b7, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149581173, endTime=null, startTime=1659149581468, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=xh6iCp9Bjy61Fr8VPxe2+w==, generatedId=dwcasa:US.160031a6-23a0-44d0-9d25-e998aa9dd1b7, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/160031a6-23a0-44d0-9d25-e998aa9dd1b7?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_rqq_order_feedbacks}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:53:03 destination > 2022-07-30 02:53:03 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=160031a6-23a0-44d0-9d25-e998aa9dd1b7, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149581173, endTime=null, startTime=1659149581468, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=xh6iCp9Bjy61Fr8VPxe2+w==, generatedId=dwcasa:US.160031a6-23a0-44d0-9d25-e998aa9dd1b7, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/160031a6-23a0-44d0-9d25-e998aa9dd1b7?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_rqq_order_feedbacks}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:53:03 destination > 2022-07-30 02:53:03 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_rqq_order_feedbacks to the source table _airbyte_raw_order_feedbacks. 2022-07-30 02:53:03 destination > 2022-07-30 02:53:03 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:53:07 destination > 2022-07-30 02:53:07 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_rqq_order_feedbacks}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_order_feedbacks}} 2022-07-30 02:53:07 destination > 2022-07-30 02:53:07 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_order_feedbacks! 2022-07-30 02:53:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@1c22bba1[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@75bd68ef[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:53:07 destination > 2022-07-30 02:53:07 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:53:07 destination > 2022-07-30 02:53:07 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:53:07 destination > 2022-07-30 02:53:07 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:53:07 destination > 2022-07-30 02:53:07 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_order_feedbacks, tmpTable=_airbyte_tmp_rqq_order_feedbacks, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:53:07 destination > 2022-07-30 02:53:07 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_buyer_public_informations, tmpTable=_airbyte_tmp_ilc_buyer_public_informations, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:53:08 destination > 2022-07-30 02:53:08 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=9448778f-f82f-454b-b6cb-08d136b4bf4a, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149587962, endTime=null, startTime=1659149588229, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=BR4Hx6suVYnQ4RKIJ++LgQ==, generatedId=dwcasa:US.9448778f-f82f-454b-b6cb-08d136b4bf4a, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/9448778f-f82f-454b-b6cb-08d136b4bf4a?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_ilc_buyer_public_informations}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:53:11 destination > 2022-07-30 02:53:11 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=9448778f-f82f-454b-b6cb-08d136b4bf4a, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149587962, endTime=null, startTime=1659149588229, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=BR4Hx6suVYnQ4RKIJ++LgQ==, generatedId=dwcasa:US.9448778f-f82f-454b-b6cb-08d136b4bf4a, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/9448778f-f82f-454b-b6cb-08d136b4bf4a?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_ilc_buyer_public_informations}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:53:11 destination > 2022-07-30 02:53:11 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_ilc_buyer_public_informations to the source table _airbyte_raw_buyer_public_informations. 2022-07-30 02:53:11 destination > 2022-07-30 02:53:11 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:53:15 destination > 2022-07-30 02:53:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_ilc_buyer_public_informations}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_buyer_public_informations}} 2022-07-30 02:53:15 destination > 2022-07-30 02:53:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_buyer_public_informations! 2022-07-30 02:53:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@34f432cf[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@7c0f4992[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:53:15 destination > 2022-07-30 02:53:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:53:15 destination > 2022-07-30 02:53:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:53:15 destination > 2022-07-30 02:53:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:53:15 destination > 2022-07-30 02:53:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_buyer_public_informations, tmpTable=_airbyte_tmp_ilc_buyer_public_informations, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:53:15 destination > 2022-07-30 02:53:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_product_reports, tmpTable=_airbyte_tmp_sll_product_reports, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:53:16 destination > 2022-07-30 02:53:16 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=b655d51c-0f64-48f9-825d-89b520a491b7, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149595666, endTime=null, startTime=1659149595916, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=tqyb1B0T2dv+Yuy+6iIunQ==, generatedId=dwcasa:US.b655d51c-0f64-48f9-825d-89b520a491b7, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/b655d51c-0f64-48f9-825d-89b520a491b7?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_sll_product_reports}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:53:19 destination > 2022-07-30 02:53:19 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=b655d51c-0f64-48f9-825d-89b520a491b7, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149595666, endTime=null, startTime=1659149595916, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=tqyb1B0T2dv+Yuy+6iIunQ==, generatedId=dwcasa:US.b655d51c-0f64-48f9-825d-89b520a491b7, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/b655d51c-0f64-48f9-825d-89b520a491b7?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_sll_product_reports}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:53:19 destination > 2022-07-30 02:53:19 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_sll_product_reports to the source table _airbyte_raw_product_reports. 2022-07-30 02:53:19 destination > 2022-07-30 02:53:19 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:53:23 destination > 2022-07-30 02:53:23 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_sll_product_reports}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_product_reports}} 2022-07-30 02:53:23 destination > 2022-07-30 02:53:23 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_product_reports! 2022-07-30 02:53:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@75f91a01[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@6b9dee41[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:53:23 destination > 2022-07-30 02:53:23 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:53:23 destination > 2022-07-30 02:53:23 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:53:23 destination > 2022-07-30 02:53:23 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:53:23 destination > 2022-07-30 02:53:23 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_product_reports, tmpTable=_airbyte_tmp_sll_product_reports, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:53:23 destination > 2022-07-30 02:53:23 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_flipper_features, tmpTable=_airbyte_tmp_xjv_flipper_features, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:53:24 destination > 2022-07-30 02:53:24 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=29fb949a-ae0d-4e0a-9aa2-e608143c456a, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149604136, endTime=null, startTime=1659149604356, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=V2ayOp6IwsoS9bog+7f9NA==, generatedId=dwcasa:US.29fb949a-ae0d-4e0a-9aa2-e608143c456a, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/29fb949a-ae0d-4e0a-9aa2-e608143c456a?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_xjv_flipper_features}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:53:27 destination > 2022-07-30 02:53:27 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=29fb949a-ae0d-4e0a-9aa2-e608143c456a, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149604136, endTime=null, startTime=1659149604356, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=V2ayOp6IwsoS9bog+7f9NA==, generatedId=dwcasa:US.29fb949a-ae0d-4e0a-9aa2-e608143c456a, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/29fb949a-ae0d-4e0a-9aa2-e608143c456a?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_xjv_flipper_features}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:53:27 destination > 2022-07-30 02:53:27 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_xjv_flipper_features to the source table _airbyte_raw_flipper_features. 2022-07-30 02:53:27 destination > 2022-07-30 02:53:27 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:53:30 destination > 2022-07-30 02:53:30 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_xjv_flipper_features}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_flipper_features}} 2022-07-30 02:53:30 destination > 2022-07-30 02:53:30 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_flipper_features! 2022-07-30 02:53:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@7e6acbb7[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@78af4e31[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:53:30 destination > 2022-07-30 02:53:30 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:53:30 destination > 2022-07-30 02:53:30 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:53:30 destination > 2022-07-30 02:53:30 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:53:30 destination > 2022-07-30 02:53:30 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_flipper_features, tmpTable=_airbyte_tmp_xjv_flipper_features, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:53:30 destination > 2022-07-30 02:53:30 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_categories, tmpTable=_airbyte_tmp_qnf_categories, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:53:31 destination > 2022-07-30 02:53:31 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=374ef5fc-f24b-45bc-9380-946c229c222d, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149610905, endTime=null, startTime=1659149611173, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=8nT/6U8ti93u0XtkwIHfzg==, generatedId=dwcasa:US.374ef5fc-f24b-45bc-9380-946c229c222d, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/374ef5fc-f24b-45bc-9380-946c229c222d?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_qnf_categories}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:53:34 destination > 2022-07-30 02:53:34 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=374ef5fc-f24b-45bc-9380-946c229c222d, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149610905, endTime=null, startTime=1659149611173, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=8nT/6U8ti93u0XtkwIHfzg==, generatedId=dwcasa:US.374ef5fc-f24b-45bc-9380-946c229c222d, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/374ef5fc-f24b-45bc-9380-946c229c222d?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_qnf_categories}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:53:34 destination > 2022-07-30 02:53:34 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_qnf_categories to the source table _airbyte_raw_categories. 2022-07-30 02:53:34 destination > 2022-07-30 02:53:34 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:53:37 destination > 2022-07-30 02:53:37 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_qnf_categories}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_categories}} 2022-07-30 02:53:37 destination > 2022-07-30 02:53:37 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_categories! 2022-07-30 02:53:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@45bb7a37[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@41d07b27[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:53:37 destination > 2022-07-30 02:53:37 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:53:37 destination > 2022-07-30 02:53:37 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:53:37 destination > 2022-07-30 02:53:37 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:53:37 destination > 2022-07-30 02:53:37 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_categories, tmpTable=_airbyte_tmp_qnf_categories, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:53:37 destination > 2022-07-30 02:53:37 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_products, tmpTable=_airbyte_tmp_xpe_products, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:53:38 destination > 2022-07-30 02:53:38 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=ef527fd1-4cfa-4a7f-9285-afb5b08c2831, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149617745, endTime=null, startTime=1659149618032, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=EK1/SswH5FSdD8eVVyVELQ==, generatedId=dwcasa:US.ef527fd1-4cfa-4a7f-9285-afb5b08c2831, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/ef527fd1-4cfa-4a7f-9285-afb5b08c2831?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_xpe_products}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:53:48 destination > 2022-07-30 02:53:48 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=ef527fd1-4cfa-4a7f-9285-afb5b08c2831, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149617745, endTime=null, startTime=1659149618032, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=EK1/SswH5FSdD8eVVyVELQ==, generatedId=dwcasa:US.ef527fd1-4cfa-4a7f-9285-afb5b08c2831, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/ef527fd1-4cfa-4a7f-9285-afb5b08c2831?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_xpe_products}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:53:48 destination > 2022-07-30 02:53:48 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_xpe_products to the source table _airbyte_raw_products. 2022-07-30 02:53:48 destination > 2022-07-30 02:53:48 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:53:50 destination > 2022-07-30 02:53:50 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_xpe_products}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_products}} 2022-07-30 02:53:50 destination > 2022-07-30 02:53:50 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_products! 2022-07-30 02:53:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@694f27d9[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@6b933207[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:53:50 destination > 2022-07-30 02:53:50 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:53:50 destination > 2022-07-30 02:53:50 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:53:50 destination > 2022-07-30 02:53:50 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:53:50 destination > 2022-07-30 02:53:50 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_products, tmpTable=_airbyte_tmp_xpe_products, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:53:50 destination > 2022-07-30 02:53:50 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_oico_radars, tmpTable=_airbyte_tmp_dhl_oico_radars, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:53:51 destination > 2022-07-30 02:53:51 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=3bab17f8-efeb-48b4-8bd5-b233bb1571b9, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149631412, endTime=null, startTime=1659149631643, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=rZVOzPX/L2TeGQj8ujl1IQ==, generatedId=dwcasa:US.3bab17f8-efeb-48b4-8bd5-b233bb1571b9, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/3bab17f8-efeb-48b4-8bd5-b233bb1571b9?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_dhl_oico_radars}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:53:53 destination > 2022-07-30 02:53:53 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=3bab17f8-efeb-48b4-8bd5-b233bb1571b9, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149631412, endTime=null, startTime=1659149631643, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=rZVOzPX/L2TeGQj8ujl1IQ==, generatedId=dwcasa:US.3bab17f8-efeb-48b4-8bd5-b233bb1571b9, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/3bab17f8-efeb-48b4-8bd5-b233bb1571b9?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_dhl_oico_radars}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:53:53 destination > 2022-07-30 02:53:53 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_dhl_oico_radars to the source table _airbyte_raw_oico_radars. 2022-07-30 02:53:53 destination > 2022-07-30 02:53:53 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:53:57 destination > 2022-07-30 02:53:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_dhl_oico_radars}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_oico_radars}} 2022-07-30 02:53:57 destination > 2022-07-30 02:53:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_oico_radars! 2022-07-30 02:53:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@75679780[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@372cc348[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:53:57 destination > 2022-07-30 02:53:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:53:57 destination > 2022-07-30 02:53:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:53:57 destination > 2022-07-30 02:53:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:53:57 destination > 2022-07-30 02:53:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_oico_radars, tmpTable=_airbyte_tmp_dhl_oico_radars, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:53:57 destination > 2022-07-30 02:53:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_flipper_gates, tmpTable=_airbyte_tmp_udj_flipper_gates, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:53:58 destination > 2022-07-30 02:53:58 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=e82a7dc6-7b9d-42b3-a64c-c19d5a87d06f, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149638219, endTime=null, startTime=1659149638480, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=NzhVjdKCd5RvvmG1G58tvg==, generatedId=dwcasa:US.e82a7dc6-7b9d-42b3-a64c-c19d5a87d06f, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/e82a7dc6-7b9d-42b3-a64c-c19d5a87d06f?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_udj_flipper_gates}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:54:00 destination > 2022-07-30 02:54:00 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=e82a7dc6-7b9d-42b3-a64c-c19d5a87d06f, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149638219, endTime=null, startTime=1659149638480, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=NzhVjdKCd5RvvmG1G58tvg==, generatedId=dwcasa:US.e82a7dc6-7b9d-42b3-a64c-c19d5a87d06f, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/e82a7dc6-7b9d-42b3-a64c-c19d5a87d06f?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_udj_flipper_gates}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:54:00 destination > 2022-07-30 02:54:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_udj_flipper_gates to the source table _airbyte_raw_flipper_gates. 2022-07-30 02:54:00 destination > 2022-07-30 02:54:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:54:03 destination > 2022-07-30 02:54:03 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_udj_flipper_gates}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_flipper_gates}} 2022-07-30 02:54:03 destination > 2022-07-30 02:54:03 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_flipper_gates! 2022-07-30 02:54:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@274d4b9b[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@55bc567f[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:54:03 destination > 2022-07-30 02:54:03 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:54:03 destination > 2022-07-30 02:54:03 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:54:03 destination > 2022-07-30 02:54:03 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:54:03 destination > 2022-07-30 02:54:03 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_flipper_gates, tmpTable=_airbyte_tmp_udj_flipper_gates, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:54:03 destination > 2022-07-30 02:54:03 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_memento_states, tmpTable=_airbyte_tmp_pfq_memento_states, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:54:04 destination > 2022-07-30 02:54:04 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=0b0e6ebb-616c-46e9-a878-1c0d42d3f78e, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149644374, endTime=null, startTime=1659149644614, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=O1wBuSR4eZMwRkvXygR0xA==, generatedId=dwcasa:US.0b0e6ebb-616c-46e9-a878-1c0d42d3f78e, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/0b0e6ebb-616c-46e9-a878-1c0d42d3f78e?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_pfq_memento_states}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:54:07 destination > 2022-07-30 02:54:07 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=0b0e6ebb-616c-46e9-a878-1c0d42d3f78e, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149644374, endTime=null, startTime=1659149644614, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=O1wBuSR4eZMwRkvXygR0xA==, generatedId=dwcasa:US.0b0e6ebb-616c-46e9-a878-1c0d42d3f78e, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/0b0e6ebb-616c-46e9-a878-1c0d42d3f78e?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_pfq_memento_states}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:54:07 destination > 2022-07-30 02:54:07 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_pfq_memento_states to the source table _airbyte_raw_memento_states. 2022-07-30 02:54:07 destination > 2022-07-30 02:54:07 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:54:10 destination > 2022-07-30 02:54:10 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_pfq_memento_states}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_memento_states}} 2022-07-30 02:54:10 destination > 2022-07-30 02:54:10 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_memento_states! 2022-07-30 02:54:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@1cae10df[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@4d49b681[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:54:10 destination > 2022-07-30 02:54:10 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:54:10 destination > 2022-07-30 02:54:10 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:54:10 destination > 2022-07-30 02:54:10 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:54:10 destination > 2022-07-30 02:54:10 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_memento_states, tmpTable=_airbyte_tmp_pfq_memento_states, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:54:10 destination > 2022-07-30 02:54:10 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_store_order_quotes, tmpTable=_airbyte_tmp_caf_store_order_quotes, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:54:11 destination > 2022-07-30 02:54:11 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=c4c793ad-965b-4242-9879-fccb7cc25f6b, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149651516, endTime=null, startTime=1659149651799, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=jwLvlMGO99UueY7r1deg7A==, generatedId=dwcasa:US.c4c793ad-965b-4242-9879-fccb7cc25f6b, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/c4c793ad-965b-4242-9879-fccb7cc25f6b?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_caf_store_order_quotes}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:54:15 destination > 2022-07-30 02:54:15 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=c4c793ad-965b-4242-9879-fccb7cc25f6b, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149651516, endTime=null, startTime=1659149651799, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=jwLvlMGO99UueY7r1deg7A==, generatedId=dwcasa:US.c4c793ad-965b-4242-9879-fccb7cc25f6b, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/c4c793ad-965b-4242-9879-fccb7cc25f6b?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_caf_store_order_quotes}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:54:15 destination > 2022-07-30 02:54:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_caf_store_order_quotes to the source table _airbyte_raw_store_order_quotes. 2022-07-30 02:54:15 destination > 2022-07-30 02:54:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:54:18 destination > 2022-07-30 02:54:18 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_caf_store_order_quotes}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_store_order_quotes}} 2022-07-30 02:54:18 destination > 2022-07-30 02:54:18 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_store_order_quotes! 2022-07-30 02:54:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@953d20[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@372d8ce3[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:54:18 destination > 2022-07-30 02:54:18 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:54:18 destination > 2022-07-30 02:54:18 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:54:18 destination > 2022-07-30 02:54:18 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:54:18 destination > 2022-07-30 02:54:18 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_store_order_quotes, tmpTable=_airbyte_tmp_caf_store_order_quotes, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:54:18 destination > 2022-07-30 02:54:18 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_order_issues, tmpTable=_airbyte_tmp_daf_order_issues, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:54:19 destination > 2022-07-30 02:54:19 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=034c52d4-01d0-486e-9d49-3506f59824ec, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149658696, endTime=null, startTime=1659149658962, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=Girc4B5bxfTUMLrlIOnMlg==, generatedId=dwcasa:US.034c52d4-01d0-486e-9d49-3506f59824ec, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/034c52d4-01d0-486e-9d49-3506f59824ec?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_daf_order_issues}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:54:21 destination > 2022-07-30 02:54:21 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=034c52d4-01d0-486e-9d49-3506f59824ec, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149658696, endTime=null, startTime=1659149658962, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=Girc4B5bxfTUMLrlIOnMlg==, generatedId=dwcasa:US.034c52d4-01d0-486e-9d49-3506f59824ec, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/034c52d4-01d0-486e-9d49-3506f59824ec?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_daf_order_issues}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:54:21 destination > 2022-07-30 02:54:21 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_daf_order_issues to the source table _airbyte_raw_order_issues. 2022-07-30 02:54:21 destination > 2022-07-30 02:54:21 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:54:25 destination > 2022-07-30 02:54:25 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_daf_order_issues}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_order_issues}} 2022-07-30 02:54:25 destination > 2022-07-30 02:54:25 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_order_issues! 2022-07-30 02:54:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@5be94a31[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@5b141273[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:54:25 destination > 2022-07-30 02:54:25 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:54:25 destination > 2022-07-30 02:54:25 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:54:25 destination > 2022-07-30 02:54:25 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:54:25 destination > 2022-07-30 02:54:25 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_order_issues, tmpTable=_airbyte_tmp_daf_order_issues, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:54:25 destination > 2022-07-30 02:54:25 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_terms, tmpTable=_airbyte_tmp_xsz_terms, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:54:26 destination > 2022-07-30 02:54:26 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=50675bfa-17e7-40c4-a345-823b1e609b9d, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149665918, endTime=null, startTime=1659149666195, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=a1kAAtd+DDZm5eb9p8H6HQ==, generatedId=dwcasa:US.50675bfa-17e7-40c4-a345-823b1e609b9d, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/50675bfa-17e7-40c4-a345-823b1e609b9d?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_xsz_terms}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:54:30 destination > 2022-07-30 02:54:30 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=50675bfa-17e7-40c4-a345-823b1e609b9d, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149665918, endTime=null, startTime=1659149666195, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=a1kAAtd+DDZm5eb9p8H6HQ==, generatedId=dwcasa:US.50675bfa-17e7-40c4-a345-823b1e609b9d, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/50675bfa-17e7-40c4-a345-823b1e609b9d?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_xsz_terms}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:54:30 destination > 2022-07-30 02:54:30 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_xsz_terms to the source table _airbyte_raw_terms. 2022-07-30 02:54:30 destination > 2022-07-30 02:54:30 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:54:33 destination > 2022-07-30 02:54:33 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_xsz_terms}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_terms}} 2022-07-30 02:54:33 destination > 2022-07-30 02:54:33 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_terms! 2022-07-30 02:54:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@7241480c[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@29508833[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:54:33 destination > 2022-07-30 02:54:33 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:54:33 destination > 2022-07-30 02:54:33 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:54:33 destination > 2022-07-30 02:54:33 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:54:33 destination > 2022-07-30 02:54:33 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_terms, tmpTable=_airbyte_tmp_xsz_terms, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:54:33 destination > 2022-07-30 02:54:33 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_buyer_users, tmpTable=_airbyte_tmp_sap_buyer_users, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:54:34 destination > 2022-07-30 02:54:34 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=b3431d24-b913-4951-baa1-d260df9be25c, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149673768, endTime=null, startTime=1659149674067, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=vT5RRE6S4Le3CFqQsVtMSw==, generatedId=dwcasa:US.b3431d24-b913-4951-baa1-d260df9be25c, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/b3431d24-b913-4951-baa1-d260df9be25c?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_sap_buyer_users}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:54:36 destination > 2022-07-30 02:54:36 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=b3431d24-b913-4951-baa1-d260df9be25c, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149673768, endTime=null, startTime=1659149674067, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=vT5RRE6S4Le3CFqQsVtMSw==, generatedId=dwcasa:US.b3431d24-b913-4951-baa1-d260df9be25c, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/b3431d24-b913-4951-baa1-d260df9be25c?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_sap_buyer_users}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:54:36 destination > 2022-07-30 02:54:36 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_sap_buyer_users to the source table _airbyte_raw_buyer_users. 2022-07-30 02:54:36 destination > 2022-07-30 02:54:36 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:54:39 destination > 2022-07-30 02:54:39 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_sap_buyer_users}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_buyer_users}} 2022-07-30 02:54:39 destination > 2022-07-30 02:54:39 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_buyer_users! 2022-07-30 02:54:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@3879e7ea[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@4385ed1c[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:54:39 destination > 2022-07-30 02:54:39 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:54:39 destination > 2022-07-30 02:54:39 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:54:40 destination > 2022-07-30 02:54:40 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:54:40 destination > 2022-07-30 02:54:40 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_buyer_users, tmpTable=_airbyte_tmp_sap_buyer_users, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:54:40 destination > 2022-07-30 02:54:40 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_reports, tmpTable=_airbyte_tmp_ezl_reports, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:54:40 destination > 2022-07-30 02:54:40 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_ezl_reports to the source table _airbyte_raw_reports. 2022-07-30 02:54:40 destination > 2022-07-30 02:54:40 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:54:43 destination > 2022-07-30 02:54:43 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_ezl_reports}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_reports}} 2022-07-30 02:54:43 destination > 2022-07-30 02:54:43 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_reports! 2022-07-30 02:54:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@3b7ccc48[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@1640da04[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:54:43 destination > 2022-07-30 02:54:43 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:54:43 destination > 2022-07-30 02:54:43 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:54:43 destination > 2022-07-30 02:54:43 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:54:43 destination > 2022-07-30 02:54:43 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_reports, tmpTable=_airbyte_tmp_ezl_reports, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:54:43 destination > 2022-07-30 02:54:43 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_active_storage_variant_records, tmpTable=_airbyte_tmp_ddd_active_storage_variant_records, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:54:43 destination > 2022-07-30 02:54:43 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_ddd_active_storage_variant_records to the source table _airbyte_raw_active_storage_variant_records. 2022-07-30 02:54:43 destination > 2022-07-30 02:54:43 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:54:47 destination > 2022-07-30 02:54:47 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_ddd_active_storage_variant_records}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_active_storage_variant_records}} 2022-07-30 02:54:47 destination > 2022-07-30 02:54:47 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_active_storage_variant_records! 2022-07-30 02:54:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@61f13991[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@d70d5be[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:54:47 destination > 2022-07-30 02:54:47 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:54:47 destination > 2022-07-30 02:54:47 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:54:47 destination > 2022-07-30 02:54:47 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:54:47 destination > 2022-07-30 02:54:47 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_active_storage_variant_records, tmpTable=_airbyte_tmp_ddd_active_storage_variant_records, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:54:47 destination > 2022-07-30 02:54:47 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_heya_campaign_receipts, tmpTable=_airbyte_tmp_ebq_heya_campaign_receipts, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:54:49 destination > 2022-07-30 02:54:49 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=34dd8fdc-bca6-4699-b078-d5fbf6e179ce, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149689338, endTime=null, startTime=1659149689682, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=jLzRi4Mz/4RAiz61O0z7lg==, generatedId=dwcasa:US.34dd8fdc-bca6-4699-b078-d5fbf6e179ce, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/34dd8fdc-bca6-4699-b078-d5fbf6e179ce?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_ebq_heya_campaign_receipts}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:54:54 destination > 2022-07-30 02:54:54 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=34dd8fdc-bca6-4699-b078-d5fbf6e179ce, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149689338, endTime=null, startTime=1659149689682, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=jLzRi4Mz/4RAiz61O0z7lg==, generatedId=dwcasa:US.34dd8fdc-bca6-4699-b078-d5fbf6e179ce, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/34dd8fdc-bca6-4699-b078-d5fbf6e179ce?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_ebq_heya_campaign_receipts}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:54:54 destination > 2022-07-30 02:54:54 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_ebq_heya_campaign_receipts to the source table _airbyte_raw_heya_campaign_receipts. 2022-07-30 02:54:54 destination > 2022-07-30 02:54:54 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:54:57 destination > 2022-07-30 02:54:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_ebq_heya_campaign_receipts}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_heya_campaign_receipts}} 2022-07-30 02:54:57 destination > 2022-07-30 02:54:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_heya_campaign_receipts! 2022-07-30 02:54:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@503346d4[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@4033262c[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:54:57 destination > 2022-07-30 02:54:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:54:57 destination > 2022-07-30 02:54:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:54:57 destination > 2022-07-30 02:54:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:54:57 destination > 2022-07-30 02:54:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_heya_campaign_receipts, tmpTable=_airbyte_tmp_ebq_heya_campaign_receipts, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:54:57 destination > 2022-07-30 02:54:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_schema_migrations, tmpTable=_airbyte_tmp_nrn_schema_migrations, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:54:58 destination > 2022-07-30 02:54:58 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=3c35f9ff-b831-455b-886c-4317eb35a95d, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149698294, endTime=null, startTime=1659149698546, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=9eoeNDMLk9dKHhVLcThiFg==, generatedId=dwcasa:US.3c35f9ff-b831-455b-886c-4317eb35a95d, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/3c35f9ff-b831-455b-886c-4317eb35a95d?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_nrn_schema_migrations}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:55:02 destination > 2022-07-30 02:55:02 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=3c35f9ff-b831-455b-886c-4317eb35a95d, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149698294, endTime=null, startTime=1659149698546, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=9eoeNDMLk9dKHhVLcThiFg==, generatedId=dwcasa:US.3c35f9ff-b831-455b-886c-4317eb35a95d, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/3c35f9ff-b831-455b-886c-4317eb35a95d?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_nrn_schema_migrations}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:55:02 destination > 2022-07-30 02:55:02 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_nrn_schema_migrations to the source table _airbyte_raw_schema_migrations. 2022-07-30 02:55:02 destination > 2022-07-30 02:55:02 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:55:06 destination > 2022-07-30 02:55:06 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_nrn_schema_migrations}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_schema_migrations}} 2022-07-30 02:55:06 destination > 2022-07-30 02:55:06 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_schema_migrations! 2022-07-30 02:55:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@28e6b20a[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@23b04f8d[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:55:06 destination > 2022-07-30 02:55:06 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:55:06 destination > 2022-07-30 02:55:06 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:55:07 destination > 2022-07-30 02:55:07 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:55:07 destination > 2022-07-30 02:55:07 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_schema_migrations, tmpTable=_airbyte_tmp_nrn_schema_migrations, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:55:07 destination > 2022-07-30 02:55:07 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_active_storage_blobs, tmpTable=_airbyte_tmp_gle_active_storage_blobs, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:55:07 destination > 2022-07-30 02:55:07 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=b6a0cf1f-8fe0-4a1c-b367-59965079bbeb, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149707498, endTime=null, startTime=1659149707769, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=OcOqcUppAlbJFZk49zIvEg==, generatedId=dwcasa:US.b6a0cf1f-8fe0-4a1c-b367-59965079bbeb, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/b6a0cf1f-8fe0-4a1c-b367-59965079bbeb?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_gle_active_storage_blobs}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:55:13 destination > 2022-07-30 02:55:13 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=b6a0cf1f-8fe0-4a1c-b367-59965079bbeb, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149707498, endTime=null, startTime=1659149707769, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=OcOqcUppAlbJFZk49zIvEg==, generatedId=dwcasa:US.b6a0cf1f-8fe0-4a1c-b367-59965079bbeb, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/b6a0cf1f-8fe0-4a1c-b367-59965079bbeb?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_gle_active_storage_blobs}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:55:13 destination > 2022-07-30 02:55:13 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_gle_active_storage_blobs to the source table _airbyte_raw_active_storage_blobs. 2022-07-30 02:55:13 destination > 2022-07-30 02:55:13 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:55:15 destination > 2022-07-30 02:55:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_gle_active_storage_blobs}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_active_storage_blobs}} 2022-07-30 02:55:15 destination > 2022-07-30 02:55:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_active_storage_blobs! 2022-07-30 02:55:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@697fb8c9[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@3024f18c[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:55:15 destination > 2022-07-30 02:55:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:55:15 destination > 2022-07-30 02:55:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:55:15 destination > 2022-07-30 02:55:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:55:15 destination > 2022-07-30 02:55:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_active_storage_blobs, tmpTable=_airbyte_tmp_gle_active_storage_blobs, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:55:15 destination > 2022-07-30 02:55:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_roi_products, tmpTable=_airbyte_tmp_eip_roi_products, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:55:16 destination > 2022-07-30 02:55:16 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=a5baf846-864e-45ed-9248-1b24d1c8a131, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149716094, endTime=null, startTime=1659149716360, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=1kMGkIirGN44V2/dXsx/WQ==, generatedId=dwcasa:US.a5baf846-864e-45ed-9248-1b24d1c8a131, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/a5baf846-864e-45ed-9248-1b24d1c8a131?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_eip_roi_products}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:55:18 destination > 2022-07-30 02:55:18 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=a5baf846-864e-45ed-9248-1b24d1c8a131, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149716094, endTime=null, startTime=1659149716360, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=1kMGkIirGN44V2/dXsx/WQ==, generatedId=dwcasa:US.a5baf846-864e-45ed-9248-1b24d1c8a131, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/a5baf846-864e-45ed-9248-1b24d1c8a131?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_eip_roi_products}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:55:18 destination > 2022-07-30 02:55:18 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_eip_roi_products to the source table _airbyte_raw_roi_products. 2022-07-30 02:55:18 destination > 2022-07-30 02:55:18 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:55:21 destination > 2022-07-30 02:55:21 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_eip_roi_products}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_roi_products}} 2022-07-30 02:55:21 destination > 2022-07-30 02:55:21 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_roi_products! 2022-07-30 02:55:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@2d4f6360[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@ca28d63[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:55:21 destination > 2022-07-30 02:55:21 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:55:21 destination > 2022-07-30 02:55:21 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:55:22 destination > 2022-07-30 02:55:22 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:55:22 destination > 2022-07-30 02:55:22 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_roi_products, tmpTable=_airbyte_tmp_eip_roi_products, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:55:22 destination > 2022-07-30 02:55:22 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_buyer_contact_rules, tmpTable=_airbyte_tmp_tbm_buyer_contact_rules, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:55:22 destination > 2022-07-30 02:55:22 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=c0c088b2-e37d-4bfb-abaf-5e5f5f79b533, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149722546, endTime=null, startTime=1659149722844, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=Jo03JjFTizsw5VKtmoulqA==, generatedId=dwcasa:US.c0c088b2-e37d-4bfb-abaf-5e5f5f79b533, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/c0c088b2-e37d-4bfb-abaf-5e5f5f79b533?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_tbm_buyer_contact_rules}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:55:26 destination > 2022-07-30 02:55:26 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=c0c088b2-e37d-4bfb-abaf-5e5f5f79b533, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149722546, endTime=null, startTime=1659149722844, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=Jo03JjFTizsw5VKtmoulqA==, generatedId=dwcasa:US.c0c088b2-e37d-4bfb-abaf-5e5f5f79b533, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/c0c088b2-e37d-4bfb-abaf-5e5f5f79b533?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_tbm_buyer_contact_rules}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:55:26 destination > 2022-07-30 02:55:26 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_tbm_buyer_contact_rules to the source table _airbyte_raw_buyer_contact_rules. 2022-07-30 02:55:26 destination > 2022-07-30 02:55:26 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:55:29 destination > 2022-07-30 02:55:29 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_tbm_buyer_contact_rules}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_buyer_contact_rules}} 2022-07-30 02:55:29 destination > 2022-07-30 02:55:29 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_buyer_contact_rules! 2022-07-30 02:55:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@188fc5ce[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@f30efc2[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:55:29 destination > 2022-07-30 02:55:29 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:55:29 destination > 2022-07-30 02:55:29 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:55:29 destination > 2022-07-30 02:55:29 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:55:29 destination > 2022-07-30 02:55:29 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_buyer_contact_rules, tmpTable=_airbyte_tmp_tbm_buyer_contact_rules, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:55:29 destination > 2022-07-30 02:55:29 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_buyer_uploads, tmpTable=_airbyte_tmp_uxi_buyer_uploads, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:55:30 destination > 2022-07-30 02:55:30 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=c0e2fcf4-86b5-4b73-92b1-cfe1b76ed708, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149730366, endTime=null, startTime=1659149730584, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=KWFeMBi3MdAKg+7cZw4KSA==, generatedId=dwcasa:US.c0e2fcf4-86b5-4b73-92b1-cfe1b76ed708, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/c0e2fcf4-86b5-4b73-92b1-cfe1b76ed708?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_uxi_buyer_uploads}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:55:34 destination > 2022-07-30 02:55:34 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=c0e2fcf4-86b5-4b73-92b1-cfe1b76ed708, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149730366, endTime=null, startTime=1659149730584, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=KWFeMBi3MdAKg+7cZw4KSA==, generatedId=dwcasa:US.c0e2fcf4-86b5-4b73-92b1-cfe1b76ed708, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/c0e2fcf4-86b5-4b73-92b1-cfe1b76ed708?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_uxi_buyer_uploads}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:55:34 destination > 2022-07-30 02:55:34 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_uxi_buyer_uploads to the source table _airbyte_raw_buyer_uploads. 2022-07-30 02:55:34 destination > 2022-07-30 02:55:34 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:55:38 destination > 2022-07-30 02:55:38 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_uxi_buyer_uploads}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_buyer_uploads}} 2022-07-30 02:55:38 destination > 2022-07-30 02:55:38 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_buyer_uploads! 2022-07-30 02:55:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@5932c927[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@41e38ef7[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:55:38 destination > 2022-07-30 02:55:38 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:55:38 destination > 2022-07-30 02:55:38 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:55:39 destination > 2022-07-30 02:55:39 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:55:39 destination > 2022-07-30 02:55:39 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_buyer_uploads, tmpTable=_airbyte_tmp_uxi_buyer_uploads, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:55:39 destination > 2022-07-30 02:55:39 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_responsible_deliveries, tmpTable=_airbyte_tmp_npv_responsible_deliveries, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:55:39 destination > 2022-07-30 02:55:39 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=279f2a22-2db9-45e9-87bd-6d73a7f8b2c8, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149739549, endTime=null, startTime=1659149739818, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=htaD73zXUtRMQm/EOs43eA==, generatedId=dwcasa:US.279f2a22-2db9-45e9-87bd-6d73a7f8b2c8, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/279f2a22-2db9-45e9-87bd-6d73a7f8b2c8?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_npv_responsible_deliveries}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:55:42 destination > 2022-07-30 02:55:42 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=279f2a22-2db9-45e9-87bd-6d73a7f8b2c8, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149739549, endTime=null, startTime=1659149739818, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=htaD73zXUtRMQm/EOs43eA==, generatedId=dwcasa:US.279f2a22-2db9-45e9-87bd-6d73a7f8b2c8, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/279f2a22-2db9-45e9-87bd-6d73a7f8b2c8?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_npv_responsible_deliveries}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:55:42 destination > 2022-07-30 02:55:42 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_npv_responsible_deliveries to the source table _airbyte_raw_responsible_deliveries. 2022-07-30 02:55:42 destination > 2022-07-30 02:55:42 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:55:45 destination > 2022-07-30 02:55:45 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_npv_responsible_deliveries}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_responsible_deliveries}} 2022-07-30 02:55:45 destination > 2022-07-30 02:55:45 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_responsible_deliveries! 2022-07-30 02:55:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@4a03ca[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@558b27b0[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:55:45 destination > 2022-07-30 02:55:45 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:55:45 destination > 2022-07-30 02:55:45 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:55:46 destination > 2022-07-30 02:55:46 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:55:46 destination > 2022-07-30 02:55:46 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_responsible_deliveries, tmpTable=_airbyte_tmp_npv_responsible_deliveries, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:55:46 destination > 2022-07-30 02:55:46 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_freight_partners, tmpTable=_airbyte_tmp_uva_freight_partners, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:55:46 destination > 2022-07-30 02:55:46 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=0fdf60ee-5886-4f2e-90f7-a28a5a21bbab, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149746653, endTime=null, startTime=1659149746892, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=mKlIKiR8Ozf6LP5k46cmRQ==, generatedId=dwcasa:US.0fdf60ee-5886-4f2e-90f7-a28a5a21bbab, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/0fdf60ee-5886-4f2e-90f7-a28a5a21bbab?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_uva_freight_partners}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:55:49 destination > 2022-07-30 02:55:49 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=0fdf60ee-5886-4f2e-90f7-a28a5a21bbab, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149746653, endTime=null, startTime=1659149746892, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=mKlIKiR8Ozf6LP5k46cmRQ==, generatedId=dwcasa:US.0fdf60ee-5886-4f2e-90f7-a28a5a21bbab, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/0fdf60ee-5886-4f2e-90f7-a28a5a21bbab?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_uva_freight_partners}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:55:49 destination > 2022-07-30 02:55:49 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_uva_freight_partners to the source table _airbyte_raw_freight_partners. 2022-07-30 02:55:49 destination > 2022-07-30 02:55:49 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:55:53 destination > 2022-07-30 02:55:53 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_uva_freight_partners}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_freight_partners}} 2022-07-30 02:55:53 destination > 2022-07-30 02:55:53 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_freight_partners! 2022-07-30 02:55:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@10e550df[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@438f11b0[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:55:53 destination > 2022-07-30 02:55:53 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:55:53 destination > 2022-07-30 02:55:53 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:55:53 destination > 2022-07-30 02:55:53 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:55:53 destination > 2022-07-30 02:55:53 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_freight_partners, tmpTable=_airbyte_tmp_uva_freight_partners, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:55:53 destination > 2022-07-30 02:55:53 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_payers, tmpTable=_airbyte_tmp_qci_payers, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:55:54 destination > 2022-07-30 02:55:54 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=586e121a-527f-471d-b25e-fc33bd7ee546, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149754295, endTime=null, startTime=1659149754594, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=mnl0PKrFEWCXy7nyT9IvNQ==, generatedId=dwcasa:US.586e121a-527f-471d-b25e-fc33bd7ee546, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/586e121a-527f-471d-b25e-fc33bd7ee546?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_qci_payers}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:55:58 destination > 2022-07-30 02:55:58 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=586e121a-527f-471d-b25e-fc33bd7ee546, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149754295, endTime=null, startTime=1659149754594, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=mnl0PKrFEWCXy7nyT9IvNQ==, generatedId=dwcasa:US.586e121a-527f-471d-b25e-fc33bd7ee546, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/586e121a-527f-471d-b25e-fc33bd7ee546?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_qci_payers}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:55:58 destination > 2022-07-30 02:55:58 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_qci_payers to the source table _airbyte_raw_payers. 2022-07-30 02:55:58 destination > 2022-07-30 02:55:58 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:56:02 destination > 2022-07-30 02:56:02 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_qci_payers}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_payers}} 2022-07-30 02:56:02 destination > 2022-07-30 02:56:02 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_payers! 2022-07-30 02:56:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@130b0e58[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@1fb11d2e[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:56:02 destination > 2022-07-30 02:56:02 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:56:02 destination > 2022-07-30 02:56:02 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:56:02 destination > 2022-07-30 02:56:02 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:56:02 destination > 2022-07-30 02:56:02 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_payers, tmpTable=_airbyte_tmp_qci_payers, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:56:02 destination > 2022-07-30 02:56:02 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_oico_users, tmpTable=_airbyte_tmp_foi_oico_users, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:56:02 destination > 2022-07-30 02:56:02 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=b4defb0a-cb2c-4a42-a6fe-fda179f68740, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149762505, endTime=null, startTime=1659149762724, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=RtEnruiu1C5rTdwzqXyJxw==, generatedId=dwcasa:US.b4defb0a-cb2c-4a42-a6fe-fda179f68740, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/b4defb0a-cb2c-4a42-a6fe-fda179f68740?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_foi_oico_users}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:56:05 destination > 2022-07-30 02:56:05 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=b4defb0a-cb2c-4a42-a6fe-fda179f68740, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149762505, endTime=null, startTime=1659149762724, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=RtEnruiu1C5rTdwzqXyJxw==, generatedId=dwcasa:US.b4defb0a-cb2c-4a42-a6fe-fda179f68740, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/b4defb0a-cb2c-4a42-a6fe-fda179f68740?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_foi_oico_users}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:56:05 destination > 2022-07-30 02:56:05 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_foi_oico_users to the source table _airbyte_raw_oico_users. 2022-07-30 02:56:05 destination > 2022-07-30 02:56:05 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:56:08 destination > 2022-07-30 02:56:08 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_foi_oico_users}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_oico_users}} 2022-07-30 02:56:08 destination > 2022-07-30 02:56:08 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_oico_users! 2022-07-30 02:56:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@25e8d5af[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@1e514233[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:56:08 destination > 2022-07-30 02:56:08 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:56:08 destination > 2022-07-30 02:56:08 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:56:08 destination > 2022-07-30 02:56:08 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:56:08 destination > 2022-07-30 02:56:08 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_oico_users, tmpTable=_airbyte_tmp_foi_oico_users, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:56:08 destination > 2022-07-30 02:56:08 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_popular_searches, tmpTable=_airbyte_tmp_jea_popular_searches, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:56:09 destination > 2022-07-30 02:56:09 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=ced16069-3191-4579-afa3-27f86c936828, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149768988, endTime=null, startTime=1659149769205, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=CvD3xDuDcArmC/Qr7k/BGQ==, generatedId=dwcasa:US.ced16069-3191-4579-afa3-27f86c936828, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/ced16069-3191-4579-afa3-27f86c936828?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_jea_popular_searches}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:56:12 destination > 2022-07-30 02:56:12 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=ced16069-3191-4579-afa3-27f86c936828, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149768988, endTime=null, startTime=1659149769205, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=CvD3xDuDcArmC/Qr7k/BGQ==, generatedId=dwcasa:US.ced16069-3191-4579-afa3-27f86c936828, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/ced16069-3191-4579-afa3-27f86c936828?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_jea_popular_searches}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:56:12 destination > 2022-07-30 02:56:12 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_jea_popular_searches to the source table _airbyte_raw_popular_searches. 2022-07-30 02:56:12 destination > 2022-07-30 02:56:12 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:56:14 destination > 2022-07-30 02:56:14 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_jea_popular_searches}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_popular_searches}} 2022-07-30 02:56:14 destination > 2022-07-30 02:56:14 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_popular_searches! 2022-07-30 02:56:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@5563e66f[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@42acc980[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:56:14 destination > 2022-07-30 02:56:14 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:56:14 destination > 2022-07-30 02:56:14 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:56:15 destination > 2022-07-30 02:56:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:56:15 destination > 2022-07-30 02:56:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_popular_searches, tmpTable=_airbyte_tmp_jea_popular_searches, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:56:15 destination > 2022-07-30 02:56:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_transfeera_batches, tmpTable=_airbyte_tmp_scd_transfeera_batches, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:56:15 destination > 2022-07-30 02:56:15 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=72c4a8bc-4296-4b26-a773-cdee7b71594d, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149775493, endTime=null, startTime=1659149775736, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=AC1N/91QdGUbpp+WudiFpw==, generatedId=dwcasa:US.72c4a8bc-4296-4b26-a773-cdee7b71594d, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/72c4a8bc-4296-4b26-a773-cdee7b71594d?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_scd_transfeera_batches}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:56:19 destination > 2022-07-30 02:56:19 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=72c4a8bc-4296-4b26-a773-cdee7b71594d, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149775493, endTime=null, startTime=1659149775736, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=AC1N/91QdGUbpp+WudiFpw==, generatedId=dwcasa:US.72c4a8bc-4296-4b26-a773-cdee7b71594d, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/72c4a8bc-4296-4b26-a773-cdee7b71594d?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_scd_transfeera_batches}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:56:19 destination > 2022-07-30 02:56:19 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_scd_transfeera_batches to the source table _airbyte_raw_transfeera_batches. 2022-07-30 02:56:19 destination > 2022-07-30 02:56:19 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:56:24 destination > 2022-07-30 02:56:24 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_scd_transfeera_batches}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_transfeera_batches}} 2022-07-30 02:56:24 destination > 2022-07-30 02:56:24 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_transfeera_batches! 2022-07-30 02:56:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@218a29d7[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@35deb70f[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:56:24 destination > 2022-07-30 02:56:24 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:56:24 destination > 2022-07-30 02:56:24 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:56:24 destination > 2022-07-30 02:56:24 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:56:24 destination > 2022-07-30 02:56:24 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_transfeera_batches, tmpTable=_airbyte_tmp_scd_transfeera_batches, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:56:24 destination > 2022-07-30 02:56:24 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_changebase_metadata, tmpTable=_airbyte_tmp_lxh_changebase_metadata, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:56:24 destination > 2022-07-30 02:56:24 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_lxh_changebase_metadata to the source table _airbyte_raw_changebase_metadata. 2022-07-30 02:56:24 destination > 2022-07-30 02:56:24 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:56:28 destination > 2022-07-30 02:56:28 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_lxh_changebase_metadata}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_changebase_metadata}} 2022-07-30 02:56:28 destination > 2022-07-30 02:56:28 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_changebase_metadata! 2022-07-30 02:56:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@7f447f45[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@5b8049e4[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:56:28 destination > 2022-07-30 02:56:28 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:56:28 destination > 2022-07-30 02:56:28 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:56:28 destination > 2022-07-30 02:56:28 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:56:28 destination > 2022-07-30 02:56:28 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_changebase_metadata, tmpTable=_airbyte_tmp_lxh_changebase_metadata, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:56:28 destination > 2022-07-30 02:56:28 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_product_canonical_categories, tmpTable=_airbyte_tmp_zby_product_canonical_categories, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:56:29 destination > 2022-07-30 02:56:29 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=26c1c9e4-baaf-493a-aca1-fe7daa540998, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149788636, endTime=null, startTime=1659149788976, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=ozjqEivivlXJdClzzlga4g==, generatedId=dwcasa:US.26c1c9e4-baaf-493a-aca1-fe7daa540998, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/26c1c9e4-baaf-493a-aca1-fe7daa540998?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_zby_product_canonical_categories}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:56:33 destination > 2022-07-30 02:56:33 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=26c1c9e4-baaf-493a-aca1-fe7daa540998, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149788636, endTime=null, startTime=1659149788976, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=ozjqEivivlXJdClzzlga4g==, generatedId=dwcasa:US.26c1c9e4-baaf-493a-aca1-fe7daa540998, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/26c1c9e4-baaf-493a-aca1-fe7daa540998?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_zby_product_canonical_categories}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:56:33 destination > 2022-07-30 02:56:33 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_zby_product_canonical_categories to the source table _airbyte_raw_product_canonical_categories. 2022-07-30 02:56:33 destination > 2022-07-30 02:56:33 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:56:37 destination > 2022-07-30 02:56:37 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_zby_product_canonical_categories}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_product_canonical_categories}} 2022-07-30 02:56:37 destination > 2022-07-30 02:56:37 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_product_canonical_categories! 2022-07-30 02:56:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@2b3407d2[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@6b92bb74[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:56:37 destination > 2022-07-30 02:56:37 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:56:37 destination > 2022-07-30 02:56:37 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:56:37 destination > 2022-07-30 02:56:37 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:56:37 destination > 2022-07-30 02:56:37 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_product_canonical_categories, tmpTable=_airbyte_tmp_zby_product_canonical_categories, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:56:37 destination > 2022-07-30 02:56:37 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_oico_radar_products, tmpTable=_airbyte_tmp_xwy_oico_radar_products, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:56:38 destination > 2022-07-30 02:56:38 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=f655d5dc-2c15-4ae7-a442-0cfe05b4bc4c, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149798000, endTime=null, startTime=1659149798322, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=TJCeDKwWpOy/1cJWhsIvew==, generatedId=dwcasa:US.f655d5dc-2c15-4ae7-a442-0cfe05b4bc4c, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/f655d5dc-2c15-4ae7-a442-0cfe05b4bc4c?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_xwy_oico_radar_products}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:56:41 destination > 2022-07-30 02:56:41 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=f655d5dc-2c15-4ae7-a442-0cfe05b4bc4c, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149798000, endTime=null, startTime=1659149798322, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=TJCeDKwWpOy/1cJWhsIvew==, generatedId=dwcasa:US.f655d5dc-2c15-4ae7-a442-0cfe05b4bc4c, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/f655d5dc-2c15-4ae7-a442-0cfe05b4bc4c?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_xwy_oico_radar_products}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:56:41 destination > 2022-07-30 02:56:41 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_xwy_oico_radar_products to the source table _airbyte_raw_oico_radar_products. 2022-07-30 02:56:41 destination > 2022-07-30 02:56:41 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:56:45 destination > 2022-07-30 02:56:45 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_xwy_oico_radar_products}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_oico_radar_products}} 2022-07-30 02:56:45 destination > 2022-07-30 02:56:45 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_oico_radar_products! 2022-07-30 02:56:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@37f05f14[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@6ee6ef67[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:56:45 destination > 2022-07-30 02:56:45 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:56:45 destination > 2022-07-30 02:56:45 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:56:45 destination > 2022-07-30 02:56:45 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:56:45 destination > 2022-07-30 02:56:45 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_oico_radar_products, tmpTable=_airbyte_tmp_xwy_oico_radar_products, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:56:45 destination > 2022-07-30 02:56:45 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_faq_categories, tmpTable=_airbyte_tmp_ecf_faq_categories, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:56:45 destination > 2022-07-30 02:56:45 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=d0c23519-0a8c-43bb-b86b-fa109db6eb62, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149805627, endTime=null, startTime=1659149805882, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=LwlZ+s5P9S4tf591uSY78g==, generatedId=dwcasa:US.d0c23519-0a8c-43bb-b86b-fa109db6eb62, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/d0c23519-0a8c-43bb-b86b-fa109db6eb62?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_ecf_faq_categories}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:56:48 destination > 2022-07-30 02:56:48 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=d0c23519-0a8c-43bb-b86b-fa109db6eb62, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149805627, endTime=null, startTime=1659149805882, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=LwlZ+s5P9S4tf591uSY78g==, generatedId=dwcasa:US.d0c23519-0a8c-43bb-b86b-fa109db6eb62, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/d0c23519-0a8c-43bb-b86b-fa109db6eb62?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_ecf_faq_categories}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:56:48 destination > 2022-07-30 02:56:48 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_ecf_faq_categories to the source table _airbyte_raw_faq_categories. 2022-07-30 02:56:48 destination > 2022-07-30 02:56:48 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:56:52 destination > 2022-07-30 02:56:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_ecf_faq_categories}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_faq_categories}} 2022-07-30 02:56:52 destination > 2022-07-30 02:56:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_faq_categories! 2022-07-30 02:56:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@65e77ffe[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@1b50212d[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:56:52 destination > 2022-07-30 02:56:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:56:52 destination > 2022-07-30 02:56:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:56:52 destination > 2022-07-30 02:56:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:56:52 destination > 2022-07-30 02:56:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_faq_categories, tmpTable=_airbyte_tmp_ecf_faq_categories, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:56:52 destination > 2022-07-30 02:56:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_store_categories, tmpTable=_airbyte_tmp_paf_store_categories, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:56:53 destination > 2022-07-30 02:56:53 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=196ad32f-59da-4ff6-bc1e-890e57889e52, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149813166, endTime=null, startTime=1659149813416, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=f709j6ywO1MBnG2cgx2lPA==, generatedId=dwcasa:US.196ad32f-59da-4ff6-bc1e-890e57889e52, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/196ad32f-59da-4ff6-bc1e-890e57889e52?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_paf_store_categories}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:56:56 destination > 2022-07-30 02:56:56 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=196ad32f-59da-4ff6-bc1e-890e57889e52, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149813166, endTime=null, startTime=1659149813416, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=f709j6ywO1MBnG2cgx2lPA==, generatedId=dwcasa:US.196ad32f-59da-4ff6-bc1e-890e57889e52, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/196ad32f-59da-4ff6-bc1e-890e57889e52?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_paf_store_categories}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:56:56 destination > 2022-07-30 02:56:56 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_paf_store_categories to the source table _airbyte_raw_store_categories. 2022-07-30 02:56:56 destination > 2022-07-30 02:56:56 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:56:58 destination > 2022-07-30 02:56:58 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_paf_store_categories}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_store_categories}} 2022-07-30 02:56:58 destination > 2022-07-30 02:56:58 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_store_categories! 2022-07-30 02:56:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@2e6dc5ac[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@77a99ad1[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:56:58 destination > 2022-07-30 02:56:58 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:56:58 destination > 2022-07-30 02:56:58 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:56:59 destination > 2022-07-30 02:56:59 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:56:59 destination > 2022-07-30 02:56:59 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_store_categories, tmpTable=_airbyte_tmp_paf_store_categories, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:56:59 destination > 2022-07-30 02:56:59 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_product_canonicals, tmpTable=_airbyte_tmp_kup_product_canonicals, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:57:00 destination > 2022-07-30 02:57:00 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=e59dffcb-ae46-45f9-982e-c8ab54855532, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149819791, endTime=null, startTime=1659149820081, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=PbqWYdm5n7GveaCqzNF7Yw==, generatedId=dwcasa:US.e59dffcb-ae46-45f9-982e-c8ab54855532, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/e59dffcb-ae46-45f9-982e-c8ab54855532?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_kup_product_canonicals}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:57:05 destination > 2022-07-30 02:57:05 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=e59dffcb-ae46-45f9-982e-c8ab54855532, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149819791, endTime=null, startTime=1659149820081, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=PbqWYdm5n7GveaCqzNF7Yw==, generatedId=dwcasa:US.e59dffcb-ae46-45f9-982e-c8ab54855532, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/e59dffcb-ae46-45f9-982e-c8ab54855532?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_kup_product_canonicals}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:57:05 destination > 2022-07-30 02:57:05 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_kup_product_canonicals to the source table _airbyte_raw_product_canonicals. 2022-07-30 02:57:05 destination > 2022-07-30 02:57:05 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:57:09 destination > 2022-07-30 02:57:09 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_kup_product_canonicals}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_product_canonicals}} 2022-07-30 02:57:09 destination > 2022-07-30 02:57:09 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_product_canonicals! 2022-07-30 02:57:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@29ef1355[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@33ac160c[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:57:09 destination > 2022-07-30 02:57:09 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:57:09 destination > 2022-07-30 02:57:09 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:57:09 destination > 2022-07-30 02:57:09 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:57:09 destination > 2022-07-30 02:57:09 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_product_canonicals, tmpTable=_airbyte_tmp_kup_product_canonicals, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:57:09 destination > 2022-07-30 02:57:09 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_freight_route_partner_costs, tmpTable=_airbyte_tmp_hkh_freight_route_partner_costs, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:57:10 destination > 2022-07-30 02:57:10 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=dwcasa, job=e76af916-10b2-42d1-81f3-ea723a3f385a, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149830207, endTime=null, startTime=1659149830462, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=guaUej6j+kDah4NgKOX3xQ==, generatedId=dwcasa:US.e76af916-10b2-42d1-81f3-ea723a3f385a, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/e76af916-10b2-42d1-81f3-ea723a3f385a?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_hkh_freight_route_partner_costs}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:57:13 destination > 2022-07-30 02:57:13 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=dwcasa, job=e76af916-10b2-42d1-81f3-ea723a3f385a, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659149830207, endTime=null, startTime=1659149830462, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@dwcasa.iam.gserviceaccount.com, etag=guaUej6j+kDah4NgKOX3xQ==, generatedId=dwcasa:US.e76af916-10b2-42d1-81f3-ea723a3f385a, selfLink=https://www.googleapis.com/bigquery/v2/projects/dwcasa/jobs/e76af916-10b2-42d1-81f3-ea723a3f385a?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, projectId=dwcasa, tableId=_airbyte_tmp_hkh_freight_route_partner_costs}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-30 02:57:13 destination > 2022-07-30 02:57:13 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_hkh_freight_route_partner_costs to the source table _airbyte_raw_freight_route_partner_costs. 2022-07-30 02:57:13 destination > 2022-07-30 02:57:13 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-30 02:57:17 destination > 2022-07-30 02:57:17 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_tmp_hkh_freight_route_partner_costs}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_cdc, tableId=_airbyte_raw_freight_route_partner_costs}} 2022-07-30 02:57:17 destination > 2022-07-30 02:57:17 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_freight_route_partner_costs! 2022-07-30 02:57:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):416 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@732ce570[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@48e886d6[type=LEGACY,stream=,global=,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]},additionalProperties={}],trace=,additionalProperties={}] 2022-07-30 02:57:17 destination > 2022-07-30 02:57:17 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-07-30 02:57:17 destination > 2022-07-30 02:57:17 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-07-30 02:57:17 destination > 2022-07-30 02:57:17 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-07-30 02:57:17 destination > 2022-07-30 02:57:17 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_freight_route_partner_costs, tmpTable=_airbyte_tmp_hkh_freight_route_partner_costs, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-30 02:57:17 destination > 2022-07-30 02:57:17 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-07-30 02:57:17 INFO i.a.w.g.DefaultReplicationWorker(run):177 - Source and destination threads complete. 2022-07-30 02:57:17 INFO i.a.w.g.DefaultReplicationWorker(run):240 - sync summary: io.airbyte.config.ReplicationAttemptSummary@29a911c5[status=completed,recordsSynced=867256,bytesSynced=545675794,startTime=1659148895115,endTime=1659149837711,totalStats=io.airbyte.config.SyncStats@39ea4471[recordsEmitted=867256,bytesEmitted=545675794,stateMessagesEmitted=1,recordsCommitted=867256],streamStats=[io.airbyte.config.StreamSyncStats@20a4263b[streamName=roi_products,stats=io.airbyte.config.SyncStats@2d201b52[recordsEmitted=5,bytesEmitted=803,stateMessagesEmitted=,recordsCommitted=5]], io.airbyte.config.StreamSyncStats@4c66100a[streamName=freight_route_groupings,stats=io.airbyte.config.SyncStats@27c40c3b[recordsEmitted=24000,bytesEmitted=14854887,stateMessagesEmitted=,recordsCommitted=24000]], io.airbyte.config.StreamSyncStats@26d07306[streamName=stockout_events,stats=io.airbyte.config.SyncStats@b870605[recordsEmitted=1134,bytesEmitted=343360,stateMessagesEmitted=,recordsCommitted=1134]], io.airbyte.config.StreamSyncStats@779db13f[streamName=store_categories,stats=io.airbyte.config.SyncStats@70bfce23[recordsEmitted=2427,bytesEmitted=561170,stateMessagesEmitted=,recordsCommitted=2427]], io.airbyte.config.StreamSyncStats@5552db71[streamName=freight_routes,stats=io.airbyte.config.SyncStats@665648f0[recordsEmitted=9577,bytesEmitted=15255019,stateMessagesEmitted=,recordsCommitted=9577]], io.airbyte.config.StreamSyncStats@7cd8094c[streamName=payers,stats=io.airbyte.config.SyncStats@72181e22[recordsEmitted=1936,bytesEmitted=2035316,stateMessagesEmitted=,recordsCommitted=1936]], io.airbyte.config.StreamSyncStats@3152ca43[streamName=shortened_urls,stats=io.airbyte.config.SyncStats@65170551[recordsEmitted=19386,bytesEmitted=8484297,stateMessagesEmitted=,recordsCommitted=19386]], io.airbyte.config.StreamSyncStats@5939e2d6[streamName=buyer_store_recommendations,stats=io.airbyte.config.SyncStats@6b620edd[recordsEmitted=1,bytesEmitted=362,stateMessagesEmitted=,recordsCommitted=1]], io.airbyte.config.StreamSyncStats@4c45c120[streamName=heya_campaign_memberships,stats=io.airbyte.config.SyncStats@11256874[recordsEmitted=14,bytesEmitted=6770,stateMessagesEmitted=,recordsCommitted=14]], io.airbyte.config.StreamSyncStats@79c07d4[streamName=payment_installments,stats=io.airbyte.config.SyncStats@7c73f51c[recordsEmitted=29117,bytesEmitted=22866369,stateMessagesEmitted=,recordsCommitted=29117]], io.airbyte.config.StreamSyncStats@1edd6773[streamName=terms,stats=io.airbyte.config.SyncStats@2401ca14[recordsEmitted=2,bytesEmitted=622,stateMessagesEmitted=,recordsCommitted=2]], io.airbyte.config.StreamSyncStats@4344dbe7[streamName=faq,stats=io.airbyte.config.SyncStats@20fc1d86[recordsEmitted=23,bytesEmitted=14934,stateMessagesEmitted=,recordsCommitted=23]], io.airbyte.config.StreamSyncStats@55ef0015[streamName=product_canonical_categories,stats=io.airbyte.config.SyncStats@7f1421d6[recordsEmitted=65857,bytesEmitted=16183350,stateMessagesEmitted=,recordsCommitted=65857]], io.airbyte.config.StreamSyncStats@1aea5630[streamName=store_locations,stats=io.airbyte.config.SyncStats@5a3a68c6[recordsEmitted=1334,bytesEmitted=759236,stateMessagesEmitted=,recordsCommitted=1334]], io.airbyte.config.StreamSyncStats@7778343c[streamName=term_acceptances,stats=io.airbyte.config.SyncStats@29bcb194[recordsEmitted=1164,bytesEmitted=301825,stateMessagesEmitted=,recordsCommitted=1164]], io.airbyte.config.StreamSyncStats@61af2945[streamName=ar_internal_metadata,stats=io.airbyte.config.SyncStats@68da11ee[recordsEmitted=1,bytesEmitted=229,stateMessagesEmitted=,recordsCommitted=1]], io.airbyte.config.StreamSyncStats@5eb5011d[streamName=heya_campaign_receipts,stats=io.airbyte.config.SyncStats@12c92b4e[recordsEmitted=30676,bytesEmitted=11660574,stateMessagesEmitted=,recordsCommitted=30676]], io.airbyte.config.StreamSyncStats@ab4cd53[streamName=buyer_contacts,stats=io.airbyte.config.SyncStats@32d9e88a[recordsEmitted=5,bytesEmitted=1459,stateMessagesEmitted=,recordsCommitted=5]], io.airbyte.config.StreamSyncStats@4492aa25[streamName=freights,stats=io.airbyte.config.SyncStats@1f5a6aa2[recordsEmitted=25242,bytesEmitted=21931474,stateMessagesEmitted=,recordsCommitted=25242]], io.airbyte.config.StreamSyncStats@33a8e24f[streamName=schema_migrations,stats=io.airbyte.config.SyncStats@4e48c108[recordsEmitted=385,bytesEmitted=49665,stateMessagesEmitted=,recordsCommitted=385]], io.airbyte.config.StreamSyncStats@1f5a8966[streamName=freight_partner_vehicles,stats=io.airbyte.config.SyncStats@5399ef55[recordsEmitted=113,bytesEmitted=38641,stateMessagesEmitted=,recordsCommitted=113]], io.airbyte.config.StreamSyncStats@2757c5f3[streamName=oico_radars,stats=io.airbyte.config.SyncStats@2f1f0090[recordsEmitted=3,bytesEmitted=1200,stateMessagesEmitted=,recordsCommitted=3]], io.airbyte.config.StreamSyncStats@6445adac[streamName=memento_states,stats=io.airbyte.config.SyncStats@783a0536[recordsEmitted=9238,bytesEmitted=5087476,stateMessagesEmitted=,recordsCommitted=9238]], io.airbyte.config.StreamSyncStats@61db3f9f[streamName=order_categories,stats=io.airbyte.config.SyncStats@3617a8b4[recordsEmitted=13725,bytesEmitted=3191385,stateMessagesEmitted=,recordsCommitted=13725]], io.airbyte.config.StreamSyncStats@7f765b17[streamName=store_users,stats=io.airbyte.config.SyncStats@574de27a[recordsEmitted=226,bytesEmitted=134110,stateMessagesEmitted=,recordsCommitted=226]], io.airbyte.config.StreamSyncStats@6fd218cb[streamName=product_canonicals,stats=io.airbyte.config.SyncStats@648b4f8d[recordsEmitted=67652,bytesEmitted=32829192,stateMessagesEmitted=,recordsCommitted=67652]], io.airbyte.config.StreamSyncStats@29680ee8[streamName=product_orders,stats=io.airbyte.config.SyncStats@118e678d[recordsEmitted=84773,bytesEmitted=66581531,stateMessagesEmitted=,recordsCommitted=84773]], io.airbyte.config.StreamSyncStats@6e652137[streamName=order_issues,stats=io.airbyte.config.SyncStats@50acfc51[recordsEmitted=6547,bytesEmitted=2915036,stateMessagesEmitted=,recordsCommitted=6547]], io.airbyte.config.StreamSyncStats@39daa7e2[streamName=omie_accounts,stats=io.airbyte.config.SyncStats@5b8a1d5b[recordsEmitted=1,bytesEmitted=309,stateMessagesEmitted=,recordsCommitted=1]], io.airbyte.config.StreamSyncStats@1ca1f384[streamName=order_feedbacks,stats=io.airbyte.config.SyncStats@2bd8da35[recordsEmitted=324,bytesEmitted=76401,stateMessagesEmitted=,recordsCommitted=324]], io.airbyte.config.StreamSyncStats@47d19d1b[streamName=orders,stats=io.airbyte.config.SyncStats@4c3a307f[recordsEmitted=17858,bytesEmitted=56314150,stateMessagesEmitted=,recordsCommitted=17858]], io.airbyte.config.StreamSyncStats@5f94c7af[streamName=responsible_deliveries,stats=io.airbyte.config.SyncStats@32f0b71a[recordsEmitted=2729,bytesEmitted=838641,stateMessagesEmitted=,recordsCommitted=2729]], io.airbyte.config.StreamSyncStats@7902cd1a[streamName=flipper_features,stats=io.airbyte.config.SyncStats@64a6a38d[recordsEmitted=10,bytesEmitted=2167,stateMessagesEmitted=,recordsCommitted=10]], io.airbyte.config.StreamSyncStats@1df6a909[streamName=flipper_gates,stats=io.airbyte.config.SyncStats@2a0985ca[recordsEmitted=11,bytesEmitted=2818,stateMessagesEmitted=,recordsCommitted=11]], io.airbyte.config.StreamSyncStats@458ce78c[streamName=buyers,stats=io.airbyte.config.SyncStats@14e79e7b[recordsEmitted=1201,bytesEmitted=2461519,stateMessagesEmitted=,recordsCommitted=1201]], io.airbyte.config.StreamSyncStats@3cf1d30f[streamName=freight_product_orders,stats=io.airbyte.config.SyncStats@5a30268e[recordsEmitted=35042,bytesEmitted=10654925,stateMessagesEmitted=,recordsCommitted=35042]], io.airbyte.config.StreamSyncStats@78a20ac3[streamName=freight_vehicle_types,stats=io.airbyte.config.SyncStats@501e47ea[recordsEmitted=22,bytesEmitted=6747,stateMessagesEmitted=,recordsCommitted=22]], io.airbyte.config.StreamSyncStats@62c58f4d[streamName=payments,stats=io.airbyte.config.SyncStats@399ac1cd[recordsEmitted=28660,bytesEmitted=27206140,stateMessagesEmitted=,recordsCommitted=28660]], io.airbyte.config.StreamSyncStats@5186302f[streamName=sidekiq_sequence_records,stats=io.airbyte.config.SyncStats@73050ce2[recordsEmitted=2,bytesEmitted=655,stateMessagesEmitted=,recordsCommitted=2]], io.airbyte.config.StreamSyncStats@3d744a28[streamName=buyer_locations,stats=io.airbyte.config.SyncStats@528f70e2[recordsEmitted=4168,bytesEmitted=2183384,stateMessagesEmitted=,recordsCommitted=4168]], io.airbyte.config.StreamSyncStats@32e835d4[streamName=products,stats=io.airbyte.config.SyncStats@69514d77[recordsEmitted=142407,bytesEmitted=121983333,stateMessagesEmitted=,recordsCommitted=142407]], io.airbyte.config.StreamSyncStats@76eb7f7f[streamName=freight_partners,stats=io.airbyte.config.SyncStats@5fca1920[recordsEmitted=99,bytesEmitted=47342,stateMessagesEmitted=,recordsCommitted=99]], io.airbyte.config.StreamSyncStats@2cffc198[streamName=active_storage_blobs,stats=io.airbyte.config.SyncStats@4fa60b85[recordsEmitted=56461,bytesEmitted=24591183,stateMessagesEmitted=,recordsCommitted=56461]], io.airbyte.config.StreamSyncStats@629b9589[streamName=location_store_products,stats=io.airbyte.config.SyncStats@6d9783e3[recordsEmitted=1244,bytesEmitted=394212,stateMessagesEmitted=,recordsCommitted=1244]], io.airbyte.config.StreamSyncStats@3fb67cc8[streamName=categories,stats=io.airbyte.config.SyncStats@4033b298[recordsEmitted=43,bytesEmitted=12055,stateMessagesEmitted=,recordsCommitted=43]], io.airbyte.config.StreamSyncStats@7eba40ca[streamName=oico_radar_products,stats=io.airbyte.config.SyncStats@2fe35c65[recordsEmitted=7,bytesEmitted=1814,stateMessagesEmitted=,recordsCommitted=7]], io.airbyte.config.StreamSyncStats@23bf256d[streamName=oico_users,stats=io.airbyte.config.SyncStats@7e45e4f0[recordsEmitted=13,bytesEmitted=5449,stateMessagesEmitted=,recordsCommitted=13]], io.airbyte.config.StreamSyncStats@525557e2[streamName=memento_sessions,stats=io.airbyte.config.SyncStats@67e029b9[recordsEmitted=3370,bytesEmitted=715898,stateMessagesEmitted=,recordsCommitted=3370]], io.airbyte.config.StreamSyncStats@3d2eec65[streamName=product_reports,stats=io.airbyte.config.SyncStats@6c9dfd54[recordsEmitted=211,bytesEmitted=63392,stateMessagesEmitted=,recordsCommitted=211]], io.airbyte.config.StreamSyncStats@148f5d62[streamName=payer_buyer_locations,stats=io.airbyte.config.SyncStats@72c403ab[recordsEmitted=4868,bytesEmitted=1238361,stateMessagesEmitted=,recordsCommitted=4868]], io.airbyte.config.StreamSyncStats@38438452[streamName=buyer_contact_rules,stats=io.airbyte.config.SyncStats@3bb7b953[recordsEmitted=5,bytesEmitted=1362,stateMessagesEmitted=,recordsCommitted=5]], io.airbyte.config.StreamSyncStats@553d970a[streamName=store_orders,stats=io.airbyte.config.SyncStats@7b60f5d[recordsEmitted=13115,bytesEmitted=3428152,stateMessagesEmitted=,recordsCommitted=13115]], io.airbyte.config.StreamSyncStats@23736aed[streamName=stores,stats=io.airbyte.config.SyncStats@258832f1[recordsEmitted=1208,bytesEmitted=1090625,stateMessagesEmitted=,recordsCommitted=1208]], io.airbyte.config.StreamSyncStats@1c34648d[streamName=buyer_public_informations,stats=io.airbyte.config.SyncStats@2bcf5cb1[recordsEmitted=2011,bytesEmitted=5193810,stateMessagesEmitted=,recordsCommitted=2011]], io.airbyte.config.StreamSyncStats@13536f27[streamName=buyer_users,stats=io.airbyte.config.SyncStats@77a8c806[recordsEmitted=1833,bytesEmitted=1568052,stateMessagesEmitted=,recordsCommitted=1833]], io.airbyte.config.StreamSyncStats@4887ca72[streamName=requested_products,stats=io.airbyte.config.SyncStats@197c2d07[recordsEmitted=38716,bytesEmitted=20704805,stateMessagesEmitted=,recordsCommitted=38716]], io.airbyte.config.StreamSyncStats@11de5358[streamName=transfeera_batches,stats=io.airbyte.config.SyncStats@2087519d[recordsEmitted=1820,bytesEmitted=460472,stateMessagesEmitted=,recordsCommitted=1820]], io.airbyte.config.StreamSyncStats@56a5dba5[streamName=freight_route_partner_costs,stats=io.airbyte.config.SyncStats@2e49c063[recordsEmitted=73,bytesEmitted=32996,stateMessagesEmitted=,recordsCommitted=73]], io.airbyte.config.StreamSyncStats@4d6e1261[streamName=store_order_quotes,stats=io.airbyte.config.SyncStats@577fa9e8[recordsEmitted=58933,bytesEmitted=24058342,stateMessagesEmitted=,recordsCommitted=58933]], io.airbyte.config.StreamSyncStats@2fff2851[streamName=popular_searches,stats=io.airbyte.config.SyncStats@4fd5af15[recordsEmitted=6,bytesEmitted=1272,stateMessagesEmitted=,recordsCommitted=6]], io.airbyte.config.StreamSyncStats@72155194[streamName=faq_categories,stats=io.airbyte.config.SyncStats@588f96d7[recordsEmitted=8,bytesEmitted=1811,stateMessagesEmitted=,recordsCommitted=8]], io.airbyte.config.StreamSyncStats@e648037[streamName=buyer_uploads,stats=io.airbyte.config.SyncStats@6cab2be9[recordsEmitted=14,bytesEmitted=8551,stateMessagesEmitted=,recordsCommitted=14]], io.airbyte.config.StreamSyncStats@346a4e19[streamName=active_storage_attachments,stats=io.airbyte.config.SyncStats@10775f6d[recordsEmitted=56200,bytesEmitted=14234357,stateMessagesEmitted=,recordsCommitted=56200]]]] 2022-07-30 02:57:17 INFO i.a.w.g.DefaultReplicationWorker(run):267 - Source output at least one state message 2022-07-30 02:57:17 INFO i.a.w.g.DefaultReplicationWorker(run):273 - State capture: Updated state to: Optional[io.airbyte.config.State@3a38006c[state={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]}]] 2022-07-30 02:57:17 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-07-30 02:57:17 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):161 - sync summary: io.airbyte.config.StandardSyncOutput@7ccded20[standardSyncSummary=io.airbyte.config.StandardSyncSummary@5de751c3[status=completed,recordsSynced=867256,bytesSynced=545675794,startTime=1659148895115,endTime=1659149837711,totalStats=io.airbyte.config.SyncStats@39ea4471[recordsEmitted=867256,bytesEmitted=545675794,stateMessagesEmitted=1,recordsCommitted=867256],streamStats=[io.airbyte.config.StreamSyncStats@20a4263b[streamName=roi_products,stats=io.airbyte.config.SyncStats@2d201b52[recordsEmitted=5,bytesEmitted=803,stateMessagesEmitted=,recordsCommitted=5]], io.airbyte.config.StreamSyncStats@4c66100a[streamName=freight_route_groupings,stats=io.airbyte.config.SyncStats@27c40c3b[recordsEmitted=24000,bytesEmitted=14854887,stateMessagesEmitted=,recordsCommitted=24000]], io.airbyte.config.StreamSyncStats@26d07306[streamName=stockout_events,stats=io.airbyte.config.SyncStats@b870605[recordsEmitted=1134,bytesEmitted=343360,stateMessagesEmitted=,recordsCommitted=1134]], io.airbyte.config.StreamSyncStats@779db13f[streamName=store_categories,stats=io.airbyte.config.SyncStats@70bfce23[recordsEmitted=2427,bytesEmitted=561170,stateMessagesEmitted=,recordsCommitted=2427]], io.airbyte.config.StreamSyncStats@5552db71[streamName=freight_routes,stats=io.airbyte.config.SyncStats@665648f0[recordsEmitted=9577,bytesEmitted=15255019,stateMessagesEmitted=,recordsCommitted=9577]], io.airbyte.config.StreamSyncStats@7cd8094c[streamName=payers,stats=io.airbyte.config.SyncStats@72181e22[recordsEmitted=1936,bytesEmitted=2035316,stateMessagesEmitted=,recordsCommitted=1936]], io.airbyte.config.StreamSyncStats@3152ca43[streamName=shortened_urls,stats=io.airbyte.config.SyncStats@65170551[recordsEmitted=19386,bytesEmitted=8484297,stateMessagesEmitted=,recordsCommitted=19386]], io.airbyte.config.StreamSyncStats@5939e2d6[streamName=buyer_store_recommendations,stats=io.airbyte.config.SyncStats@6b620edd[recordsEmitted=1,bytesEmitted=362,stateMessagesEmitted=,recordsCommitted=1]], io.airbyte.config.StreamSyncStats@4c45c120[streamName=heya_campaign_memberships,stats=io.airbyte.config.SyncStats@11256874[recordsEmitted=14,bytesEmitted=6770,stateMessagesEmitted=,recordsCommitted=14]], io.airbyte.config.StreamSyncStats@79c07d4[streamName=payment_installments,stats=io.airbyte.config.SyncStats@7c73f51c[recordsEmitted=29117,bytesEmitted=22866369,stateMessagesEmitted=,recordsCommitted=29117]], io.airbyte.config.StreamSyncStats@1edd6773[streamName=terms,stats=io.airbyte.config.SyncStats@2401ca14[recordsEmitted=2,bytesEmitted=622,stateMessagesEmitted=,recordsCommitted=2]], io.airbyte.config.StreamSyncStats@4344dbe7[streamName=faq,stats=io.airbyte.config.SyncStats@20fc1d86[recordsEmitted=23,bytesEmitted=14934,stateMessagesEmitted=,recordsCommitted=23]], io.airbyte.config.StreamSyncStats@55ef0015[streamName=product_canonical_categories,stats=io.airbyte.config.SyncStats@7f1421d6[recordsEmitted=65857,bytesEmitted=16183350,stateMessagesEmitted=,recordsCommitted=65857]], io.airbyte.config.StreamSyncStats@1aea5630[streamName=store_locations,stats=io.airbyte.config.SyncStats@5a3a68c6[recordsEmitted=1334,bytesEmitted=759236,stateMessagesEmitted=,recordsCommitted=1334]], io.airbyte.config.StreamSyncStats@7778343c[streamName=term_acceptances,stats=io.airbyte.config.SyncStats@29bcb194[recordsEmitted=1164,bytesEmitted=301825,stateMessagesEmitted=,recordsCommitted=1164]], io.airbyte.config.StreamSyncStats@61af2945[streamName=ar_internal_metadata,stats=io.airbyte.config.SyncStats@68da11ee[recordsEmitted=1,bytesEmitted=229,stateMessagesEmitted=,recordsCommitted=1]], io.airbyte.config.StreamSyncStats@5eb5011d[streamName=heya_campaign_receipts,stats=io.airbyte.config.SyncStats@12c92b4e[recordsEmitted=30676,bytesEmitted=11660574,stateMessagesEmitted=,recordsCommitted=30676]], io.airbyte.config.StreamSyncStats@ab4cd53[streamName=buyer_contacts,stats=io.airbyte.config.SyncStats@32d9e88a[recordsEmitted=5,bytesEmitted=1459,stateMessagesEmitted=,recordsCommitted=5]], io.airbyte.config.StreamSyncStats@4492aa25[streamName=freights,stats=io.airbyte.config.SyncStats@1f5a6aa2[recordsEmitted=25242,bytesEmitted=21931474,stateMessagesEmitted=,recordsCommitted=25242]], io.airbyte.config.StreamSyncStats@33a8e24f[streamName=schema_migrations,stats=io.airbyte.config.SyncStats@4e48c108[recordsEmitted=385,bytesEmitted=49665,stateMessagesEmitted=,recordsCommitted=385]], io.airbyte.config.StreamSyncStats@1f5a8966[streamName=freight_partner_vehicles,stats=io.airbyte.config.SyncStats@5399ef55[recordsEmitted=113,bytesEmitted=38641,stateMessagesEmitted=,recordsCommitted=113]], io.airbyte.config.StreamSyncStats@2757c5f3[streamName=oico_radars,stats=io.airbyte.config.SyncStats@2f1f0090[recordsEmitted=3,bytesEmitted=1200,stateMessagesEmitted=,recordsCommitted=3]], io.airbyte.config.StreamSyncStats@6445adac[streamName=memento_states,stats=io.airbyte.config.SyncStats@783a0536[recordsEmitted=9238,bytesEmitted=5087476,stateMessagesEmitted=,recordsCommitted=9238]], io.airbyte.config.StreamSyncStats@61db3f9f[streamName=order_categories,stats=io.airbyte.config.SyncStats@3617a8b4[recordsEmitted=13725,bytesEmitted=3191385,stateMessagesEmitted=,recordsCommitted=13725]], io.airbyte.config.StreamSyncStats@7f765b17[streamName=store_users,stats=io.airbyte.config.SyncStats@574de27a[recordsEmitted=226,bytesEmitted=134110,stateMessagesEmitted=,recordsCommitted=226]], io.airbyte.config.StreamSyncStats@6fd218cb[streamName=product_canonicals,stats=io.airbyte.config.SyncStats@648b4f8d[recordsEmitted=67652,bytesEmitted=32829192,stateMessagesEmitted=,recordsCommitted=67652]], io.airbyte.config.StreamSyncStats@29680ee8[streamName=product_orders,stats=io.airbyte.config.SyncStats@118e678d[recordsEmitted=84773,bytesEmitted=66581531,stateMessagesEmitted=,recordsCommitted=84773]], io.airbyte.config.StreamSyncStats@6e652137[streamName=order_issues,stats=io.airbyte.config.SyncStats@50acfc51[recordsEmitted=6547,bytesEmitted=2915036,stateMessagesEmitted=,recordsCommitted=6547]], io.airbyte.config.StreamSyncStats@39daa7e2[streamName=omie_accounts,stats=io.airbyte.config.SyncStats@5b8a1d5b[recordsEmitted=1,bytesEmitted=309,stateMessagesEmitted=,recordsCommitted=1]], io.airbyte.config.StreamSyncStats@1ca1f384[streamName=order_feedbacks,stats=io.airbyte.config.SyncStats@2bd8da35[recordsEmitted=324,bytesEmitted=76401,stateMessagesEmitted=,recordsCommitted=324]], io.airbyte.config.StreamSyncStats@47d19d1b[streamName=orders,stats=io.airbyte.config.SyncStats@4c3a307f[recordsEmitted=17858,bytesEmitted=56314150,stateMessagesEmitted=,recordsCommitted=17858]], io.airbyte.config.StreamSyncStats@5f94c7af[streamName=responsible_deliveries,stats=io.airbyte.config.SyncStats@32f0b71a[recordsEmitted=2729,bytesEmitted=838641,stateMessagesEmitted=,recordsCommitted=2729]], io.airbyte.config.StreamSyncStats@7902cd1a[streamName=flipper_features,stats=io.airbyte.config.SyncStats@64a6a38d[recordsEmitted=10,bytesEmitted=2167,stateMessagesEmitted=,recordsCommitted=10]], io.airbyte.config.StreamSyncStats@1df6a909[streamName=flipper_gates,stats=io.airbyte.config.SyncStats@2a0985ca[recordsEmitted=11,bytesEmitted=2818,stateMessagesEmitted=,recordsCommitted=11]], io.airbyte.config.StreamSyncStats@458ce78c[streamName=buyers,stats=io.airbyte.config.SyncStats@14e79e7b[recordsEmitted=1201,bytesEmitted=2461519,stateMessagesEmitted=,recordsCommitted=1201]], io.airbyte.config.StreamSyncStats@3cf1d30f[streamName=freight_product_orders,stats=io.airbyte.config.SyncStats@5a30268e[recordsEmitted=35042,bytesEmitted=10654925,stateMessagesEmitted=,recordsCommitted=35042]], io.airbyte.config.StreamSyncStats@78a20ac3[streamName=freight_vehicle_types,stats=io.airbyte.config.SyncStats@501e47ea[recordsEmitted=22,bytesEmitted=6747,stateMessagesEmitted=,recordsCommitted=22]], io.airbyte.config.StreamSyncStats@62c58f4d[streamName=payments,stats=io.airbyte.config.SyncStats@399ac1cd[recordsEmitted=28660,bytesEmitted=27206140,stateMessagesEmitted=,recordsCommitted=28660]], io.airbyte.config.StreamSyncStats@5186302f[streamName=sidekiq_sequence_records,stats=io.airbyte.config.SyncStats@73050ce2[recordsEmitted=2,bytesEmitted=655,stateMessagesEmitted=,recordsCommitted=2]], io.airbyte.config.StreamSyncStats@3d744a28[streamName=buyer_locations,stats=io.airbyte.config.SyncStats@528f70e2[recordsEmitted=4168,bytesEmitted=2183384,stateMessagesEmitted=,recordsCommitted=4168]], io.airbyte.config.StreamSyncStats@32e835d4[streamName=products,stats=io.airbyte.config.SyncStats@69514d77[recordsEmitted=142407,bytesEmitted=121983333,stateMessagesEmitted=,recordsCommitted=142407]], io.airbyte.config.StreamSyncStats@76eb7f7f[streamName=freight_partners,stats=io.airbyte.config.SyncStats@5fca1920[recordsEmitted=99,bytesEmitted=47342,stateMessagesEmitted=,recordsCommitted=99]], io.airbyte.config.StreamSyncStats@2cffc198[streamName=active_storage_blobs,stats=io.airbyte.config.SyncStats@4fa60b85[recordsEmitted=56461,bytesEmitted=24591183,stateMessagesEmitted=,recordsCommitted=56461]], io.airbyte.config.StreamSyncStats@629b9589[streamName=location_store_products,stats=io.airbyte.config.SyncStats@6d9783e3[recordsEmitted=1244,bytesEmitted=394212,stateMessagesEmitted=,recordsCommitted=1244]], io.airbyte.config.StreamSyncStats@3fb67cc8[streamName=categories,stats=io.airbyte.config.SyncStats@4033b298[recordsEmitted=43,bytesEmitted=12055,stateMessagesEmitted=,recordsCommitted=43]], io.airbyte.config.StreamSyncStats@7eba40ca[streamName=oico_radar_products,stats=io.airbyte.config.SyncStats@2fe35c65[recordsEmitted=7,bytesEmitted=1814,stateMessagesEmitted=,recordsCommitted=7]], io.airbyte.config.StreamSyncStats@23bf256d[streamName=oico_users,stats=io.airbyte.config.SyncStats@7e45e4f0[recordsEmitted=13,bytesEmitted=5449,stateMessagesEmitted=,recordsCommitted=13]], io.airbyte.config.StreamSyncStats@525557e2[streamName=memento_sessions,stats=io.airbyte.config.SyncStats@67e029b9[recordsEmitted=3370,bytesEmitted=715898,stateMessagesEmitted=,recordsCommitted=3370]], io.airbyte.config.StreamSyncStats@3d2eec65[streamName=product_reports,stats=io.airbyte.config.SyncStats@6c9dfd54[recordsEmitted=211,bytesEmitted=63392,stateMessagesEmitted=,recordsCommitted=211]], io.airbyte.config.StreamSyncStats@148f5d62[streamName=payer_buyer_locations,stats=io.airbyte.config.SyncStats@72c403ab[recordsEmitted=4868,bytesEmitted=1238361,stateMessagesEmitted=,recordsCommitted=4868]], io.airbyte.config.StreamSyncStats@38438452[streamName=buyer_contact_rules,stats=io.airbyte.config.SyncStats@3bb7b953[recordsEmitted=5,bytesEmitted=1362,stateMessagesEmitted=,recordsCommitted=5]], io.airbyte.config.StreamSyncStats@553d970a[streamName=store_orders,stats=io.airbyte.config.SyncStats@7b60f5d[recordsEmitted=13115,bytesEmitted=3428152,stateMessagesEmitted=,recordsCommitted=13115]], io.airbyte.config.StreamSyncStats@23736aed[streamName=stores,stats=io.airbyte.config.SyncStats@258832f1[recordsEmitted=1208,bytesEmitted=1090625,stateMessagesEmitted=,recordsCommitted=1208]], io.airbyte.config.StreamSyncStats@1c34648d[streamName=buyer_public_informations,stats=io.airbyte.config.SyncStats@2bcf5cb1[recordsEmitted=2011,bytesEmitted=5193810,stateMessagesEmitted=,recordsCommitted=2011]], io.airbyte.config.StreamSyncStats@13536f27[streamName=buyer_users,stats=io.airbyte.config.SyncStats@77a8c806[recordsEmitted=1833,bytesEmitted=1568052,stateMessagesEmitted=,recordsCommitted=1833]], io.airbyte.config.StreamSyncStats@4887ca72[streamName=requested_products,stats=io.airbyte.config.SyncStats@197c2d07[recordsEmitted=38716,bytesEmitted=20704805,stateMessagesEmitted=,recordsCommitted=38716]], io.airbyte.config.StreamSyncStats@11de5358[streamName=transfeera_batches,stats=io.airbyte.config.SyncStats@2087519d[recordsEmitted=1820,bytesEmitted=460472,stateMessagesEmitted=,recordsCommitted=1820]], io.airbyte.config.StreamSyncStats@56a5dba5[streamName=freight_route_partner_costs,stats=io.airbyte.config.SyncStats@2e49c063[recordsEmitted=73,bytesEmitted=32996,stateMessagesEmitted=,recordsCommitted=73]], io.airbyte.config.StreamSyncStats@4d6e1261[streamName=store_order_quotes,stats=io.airbyte.config.SyncStats@577fa9e8[recordsEmitted=58933,bytesEmitted=24058342,stateMessagesEmitted=,recordsCommitted=58933]], io.airbyte.config.StreamSyncStats@2fff2851[streamName=popular_searches,stats=io.airbyte.config.SyncStats@4fd5af15[recordsEmitted=6,bytesEmitted=1272,stateMessagesEmitted=,recordsCommitted=6]], io.airbyte.config.StreamSyncStats@72155194[streamName=faq_categories,stats=io.airbyte.config.SyncStats@588f96d7[recordsEmitted=8,bytesEmitted=1811,stateMessagesEmitted=,recordsCommitted=8]], io.airbyte.config.StreamSyncStats@e648037[streamName=buyer_uploads,stats=io.airbyte.config.SyncStats@6cab2be9[recordsEmitted=14,bytesEmitted=8551,stateMessagesEmitted=,recordsCommitted=14]], io.airbyte.config.StreamSyncStats@346a4e19[streamName=active_storage_attachments,stats=io.airbyte.config.SyncStats@10775f6d[recordsEmitted=56200,bytesEmitted=14234357,stateMessagesEmitted=,recordsCommitted=56200]]]],normalizationSummary=,state=io.airbyte.config.State@3a38006c[state={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"d6g4nour99s742\",{\"server\":\"d6g4nour99s742\"}]}":"{\"last_snapshot_record\":true,\"lsn\":175422614568,\"txId\":70657,\"ts_usec\":1659149264973000,\"snapshot\":true}"}},"streams":[{"stream_name":"active_storage_attachments","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_blobs","stream_namespace":"public","cursor_field":[]},{"stream_name":"active_storage_variant_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"ar_internal_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contact_rules","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_contacts","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_public_informations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_store_recommendations","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_uploads","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyer_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"buyers","stream_namespace":"public","cursor_field":[]},{"stream_name":"categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"changebase_metadata","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq","stream_namespace":"public","cursor_field":[]},{"stream_name":"faq_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_features","stream_namespace":"public","cursor_field":[]},{"stream_name":"flipper_gates","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partner_vehicles","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_partners","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_groupings","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_route_partner_costs","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_routes","stream_namespace":"public","cursor_field":[]},{"stream_name":"freight_vehicle_types","stream_namespace":"public","cursor_field":[]},{"stream_name":"freights","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_memberships","stream_namespace":"public","cursor_field":[]},{"stream_name":"heya_campaign_receipts","stream_namespace":"public","cursor_field":[]},{"stream_name":"location_store_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_sessions","stream_namespace":"public","cursor_field":[]},{"stream_name":"memento_states","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radar_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_radars","stream_namespace":"public","cursor_field":[]},{"stream_name":"oico_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"omie_accounts","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_feedbacks","stream_namespace":"public","cursor_field":[]},{"stream_name":"order_issues","stream_namespace":"public","cursor_field":[]},{"stream_name":"orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"payer_buyer_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"payers","stream_namespace":"public","cursor_field":[]},{"stream_name":"payment_installments","stream_namespace":"public","cursor_field":[]},{"stream_name":"payments","stream_namespace":"public","cursor_field":[]},{"stream_name":"popular_searches","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonical_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_canonicals","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"product_reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"products","stream_namespace":"public","cursor_field":[]},{"stream_name":"reports","stream_namespace":"public","cursor_field":[]},{"stream_name":"requested_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"responsible_deliveries","stream_namespace":"public","cursor_field":[]},{"stream_name":"roi_products","stream_namespace":"public","cursor_field":[]},{"stream_name":"schema_migrations","stream_namespace":"public","cursor_field":[]},{"stream_name":"shortened_urls","stream_namespace":"public","cursor_field":[]},{"stream_name":"sidekiq_sequence_records","stream_namespace":"public","cursor_field":[]},{"stream_name":"spatial_ref_sys","stream_namespace":"public","cursor_field":[]},{"stream_name":"stockout_events","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_categories","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_locations","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_order_quotes","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_orders","stream_namespace":"public","cursor_field":[]},{"stream_name":"store_users","stream_namespace":"public","cursor_field":[]},{"stream_name":"stores","stream_namespace":"public","cursor_field":[]},{"stream_name":"term_acceptances","stream_namespace":"public","cursor_field":[]},{"stream_name":"terms","stream_namespace":"public","cursor_field":[]},{"stream_name":"transfeera_batches","stream_namespace":"public","cursor_field":[]}]}],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@50e544e5[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@65d6642a[stream=io.airbyte.protocol.models.AirbyteStream@7661315d[name=active_storage_attachments,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"name":{"type":"string"},"blob_id":{"type":"number"},"record_id":{"type":"string"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"record_type":{"type":"string"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@116f0f1b[stream=io.airbyte.protocol.models.AirbyteStream@6bd7b3bf[name=active_storage_blobs,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"key":{"type":"string"},"checksum":{"type":"string"},"filename":{"type":"string"},"metadata":{"type":"string"},"byte_size":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"content_type":{"type":"string"},"service_name":{"type":"string"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@3d766ddb[stream=io.airbyte.protocol.models.AirbyteStream@426248f1[name=active_storage_variant_records,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"blob_id":{"type":"number"},"_ab_cdc_lsn":{"type":"number"},"variation_digest":{"type":"string"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@2b9c8071[stream=io.airbyte.protocol.models.AirbyteStream@7d8094f6[name=ar_internal_metadata,jsonSchema={"type":"object","properties":{"key":{"type":"string"},"value":{"type":"string"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[key]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[key]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@73962628[stream=io.airbyte.protocol.models.AirbyteStream@23e3dd6b[name=buyer_contact_rules,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"order_id":{"type":"number"},"categories":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"buyer_contact_id":{"type":"number"},"buyer_location_id":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@6c335e6e[stream=io.airbyte.protocol.models.AirbyteStream@15ed403a[name=buyer_contacts,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"name":{"type":"string"},"email":{"type":"string"},"buyer_id":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"phone_number":{"type":"string"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@570883c9[stream=io.airbyte.protocol.models.AirbyteStream@6abd04c6[name=buyer_locations,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"lat":{"type":"number"},"lng":{"type":"number"},"city":{"type":"string"},"name":{"type":"string"},"state":{"type":"string"},"street":{"type":"string"},"zipcode":{"type":"string"},"buyer_id":{"type":"number"},"location":{"type":"string"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"address_details":{"type":"string"},"google_place_id":{"type":"string"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@1c0bf7d1[stream=io.airbyte.protocol.models.AirbyteStream@639898fa[name=buyer_public_informations,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"type":{"type":"number"},"score":{"type":"number"},"buyer_id":{"type":"number"},"response":{"type":"string"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"recommended_term_limit":{"type":"string"},"recommended_spend_limit":{"type":"number"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@709d598b[stream=io.airbyte.protocol.models.AirbyteStream@7204e86a[name=buyer_store_recommendations,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"buyer_id":{"type":"number"},"store_id":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"store_name":{"type":"string"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"store_email":{"type":"string"},"store_phone":{"type":"string"},"contact_name":{"type":"string"},"buyer_user_id":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@31723c84[stream=io.airbyte.protocol.models.AirbyteStream@160a2d18[name=buyer_uploads,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"done":{"type":"boolean"},"buyer_id":{"type":"number"},"file_url":{"type":"string"},"filename":{"type":"string"},"file_type":{"type":"number"},"_ab_cdc_lsn":{"type":"number"},"buyer_user_id":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@c417f53[stream=io.airbyte.protocol.models.AirbyteStream@59d38109[name=buyer_users,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"name":{"type":"string"},"email":{"type":"string"},"active":{"type":"boolean"},"profile":{"type":"number"},"buyer_id":{"type":"number"},"whatsapp":{"type":"string"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"spend_limit":{"type":"number"},"confirmed_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"referral_code":{"type":"string"},"stytch_user_id":{"type":"string"},"own_referral_code":{"type":"string"},"unconfirmed_email":{"type":"string"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"confirmation_token":{"type":"string"},"encrypted_password":{"type":"string"},"remember_created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"confirmation_sent_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"reset_password_token":{"type":"string"},"reset_password_sent_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@79e510ab[stream=io.airbyte.protocol.models.AirbyteStream@3ec09062[name=buyers,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"cnpj":{"type":"string"},"wholesale":{"type":"boolean"},"conta_azul":{"type":"string"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"spend_limit":{"type":"number"},"truora_size":{"type":"string"},"trading_name":{"type":"string"},"type_company":{"type":"number"},"business_name":{"type":"string"},"financing_fee":{"type":"number"},"location_city":{"type":"string"},"max_term_days":{"type":"number"},"location_state":{"type":"string"},"truora_address":{"type":"string"},"truora_check_id":{"type":"string"},"default_payer_id":{"type":"number"},"truora_legal_type":{"type":"string"},"truora_started_on":{"type":"string","format":"date"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"new_orders_blocked":{"type":"boolean"},"state_registration":{"type":"string"},"truora_trading_name":{"type":"string"},"truora_business_name":{"type":"string"},"average_monthly_spend":{"type":"number"},"municipal_registration":{"type":"string"},"truora_main_activities":{"type":"string"},"truora_unfiltered_data":{"type":"string"},"truora_current_irs_status":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@397ccb0e[stream=io.airbyte.protocol.models.AirbyteStream@7ce2dee1[name=categories,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"name":{"type":"string"},"level":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"category_id":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"visible_on_store_sign_up":{"type":"boolean"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@2dd3f99e[stream=io.airbyte.protocol.models.AirbyteStream@17aa3fc6[name=changebase_metadata,jsonSchema={"type":"object","properties":{"data":{"type":"string"},"version":{"type":"number"},"_ab_cdc_lsn":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[version]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[version]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@4851a286[stream=io.airbyte.protocol.models.AirbyteStream@222e78bb[name=faq,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"title":{"type":"string"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"description":{"type":"string"},"faq_category_id":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@10837a69[stream=io.airbyte.protocol.models.AirbyteStream@569123b0[name=faq_categories,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"name":{"type":"string"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@1391fe76[stream=io.airbyte.protocol.models.AirbyteStream@42abb71f[name=flipper_features,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"key":{"type":"string"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@49f0cd11[stream=io.airbyte.protocol.models.AirbyteStream@16a3fb3c[name=flipper_gates,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"key":{"type":"string"},"value":{"type":"string"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"feature_key":{"type":"string"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@a5dd5d0[stream=io.airbyte.protocol.models.AirbyteStream@15d198cb[name=freight_partner_vehicles,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"plate":{"type":"string"},"start_lat":{"type":"number"},"start_lng":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"start_location":{"type":"string"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"freight_partner_id":{"type":"number"},"freight_vehicle_type_id":{"type":"number"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@5a064725[stream=io.airbyte.protocol.models.AirbyteStream@53752d42[name=freight_partners,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"cpf":{"type":"string"},"cnpj":{"type":"string"},"email":{"type":"string"},"active":{"type":"boolean"},"website":{"type":"string"},"whatsapp":{"type":"string"},"daily_fee":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"is_dedicated":{"type":"boolean"},"payment_type":{"type":"number"},"trading_name":{"type":"string"},"business_name":{"type":"string"},"point_of_contact":{"type":"string"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@37e281a9[stream=io.airbyte.protocol.models.AirbyteStream@2e6c505e[name=freight_product_orders,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"freight_id":{"type":"number"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"product_order_id":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"quantity_in_freight":{"type":"number"},"internal_product_freight_note":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@463b15d9[stream=io.airbyte.protocol.models.AirbyteStream@3cde2f61[name=freight_route_groupings,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"freight_id":{"type":"number"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"freight_route_id":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"delivery_note_link":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@1f120e9a[stream=io.airbyte.protocol.models.AirbyteStream@53304386[name=freight_route_partner_costs,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"cost":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"extra_cost":{"type":"number"},"total_cost":{"type":"number"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"is_dedicated":{"type":"boolean"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"extra_cost_details":{"type":"string"},"freight_partner_id":{"type":"number"},"delivery_work_end_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"delivery_work_start_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@4dbb11e4[stream=io.airbyte.protocol.models.AirbyteStream@d38a15[name=freight_routes,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"sequence":{"type":"string"},"pipefy_id":{"type":"string"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"freight_price":{"type":"number"},"total_distance":{"type":"number"},"product_problems":{"type":"string"},"delivery_problems":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"shareable_link_hash":{"type":"string"},"client_delivery_notes":{"type":"string"},"freight_tracking_link":{"type":"string"},"freight_delivery_poc_phone":{"type":"string"},"freight_partner_vehicle_id":{"type":"number"},"freight_partner_external_id":{"type":"string"},"freight_route_partner_cost_id":{"type":"number"},"freight_actual_delivery_datetime":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"freight_delivery_point_of_contact":{"type":"string"},"freight_scheduled_delivery_datetime":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"freight_partner_dedicated_when_associated":{"type":"boolean"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@f3a324b[stream=io.airbyte.protocol.models.AirbyteStream@5e477c59[name=freight_vehicle_types,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"name":{"type":"string"},"max_width":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"max_height":{"type":"number"},"max_lenght":{"type":"number"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"description":{"type":"string"},"capacity_in_kg":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@4b666244[stream=io.airbyte.protocol.models.AirbyteStream@5779da1f[name=freights,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"distance":{"type":"number"},"order_id":{"type":"number"},"delivered":{"type":"boolean"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"notified_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"received_by":{"type":"string"},"picked_up_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"freight_weight":{"type":"number"},"store_quote_id":{"type":"string"},"reverse_freight":{"type":"boolean"},"buyer_location_id":{"type":"number"},"store_location_id":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"client_delivery_notes":{"type":"string"},"internal_delivery_notes":{"type":"string"},"actual_delivery_datetime":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"target_delivery_datetime":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"freight_actual_pickup_time":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"freight_scheduled_pickup_time":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"arrived_at_pick_up_location_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"arrived_at_drop_off_location_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"estimated_arrival_delivery_datetime":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@98f12d1[stream=io.airbyte.protocol.models.AirbyteStream@6ccf020d[name=heya_campaign_memberships,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"user_id":{"type":"number"},"step_gid":{"type":"string"},"user_type":{"type":"string"},"concurrent":{"type":"boolean"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"campaign_gid":{"type":"string"},"last_sent_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@14432992[stream=io.airbyte.protocol.models.AirbyteStream@d73a027[name=heya_campaign_receipts,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"sent_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"user_id":{"type":"number"},"step_gid":{"type":"string"},"user_type":{"type":"string"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@7c1b32c2[stream=io.airbyte.protocol.models.AirbyteStream@68509826[name=location_store_products,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"pipefy_id":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"product_id":{"type":"number"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"store_location_id":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"pipefy_product_store_id":{"type":"number"},"pipefy_store_location_id":{"type":"number"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@65522307[stream=io.airbyte.protocol.models.AirbyteStream@7530c512[name=memento_sessions,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"user_id":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@50986454[stream=io.airbyte.protocol.models.AirbyteStream@3ce557c9[name=memento_states,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"record_id":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"session_id":{"type":"number"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"action_type":{"type":"string"},"record_data":{"type":"string"},"record_type":{"type":"string"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@485b1149[stream=io.airbyte.protocol.models.AirbyteStream@3bb05505[name=oico_radar_products,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"price":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"oico_radar_id":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"product_canonical_id":{"type":"number"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@28993ce3[stream=io.airbyte.protocol.models.AirbyteStream@3e547d26[name=oico_radars,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"name":{"type":"string"},"email":{"type":"string"},"document":{"type":"string"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"notify_terms":{"type":"boolean"},"phone_number":{"type":"string"},"buyer_user_id":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"shareable_link_hash":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@2e15e2fc[stream=io.airbyte.protocol.models.AirbyteStream@17348246[name=oico_users,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"email":{"type":"string"},"active":{"type":"boolean"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"encrypted_password":{"type":"string"},"remember_created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"reset_password_token":{"type":"string"},"reset_password_sent_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@76abda67[stream=io.airbyte.protocol.models.AirbyteStream@6b0b34d9[name=omie_accounts,jsonSchema={"type":"object","properties":{"id":{"type":"string"},"name":{"type":"string"},"document":{"type":"string"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"credential":{"type":"string"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@6a882946[stream=io.airbyte.protocol.models.AirbyteStream@591db0e3[name=order_categories,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"order_id":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"category_id":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@71cd3145[stream=io.airbyte.protocol.models.AirbyteStream@43d26e59[name=order_feedbacks,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"type":{"type":"number"},"liked":{"type":"boolean"},"order_id":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@683bad7c[stream=io.airbyte.protocol.models.AirbyteStream@5c958230[name=order_issues,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"type":{"type":"number"},"status":{"type":"number"},"order_id":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"canceled_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"description":{"type":"string"},"confirmed_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"buyer_user_id":{"type":"number"},"product_problems":{"type":"string"},"delivery_problems":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@44cac7fe[stream=io.airbyte.protocol.models.AirbyteStream@143ad998[name=orders,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"type":{"type":"number"},"quote":{"type":"boolean"},"value":{"type":"number"},"events":{"type":"string"},"origin":{"type":"number"},"status":{"type":"number"},"comment":{"type":"string"},"buyer_id":{"type":"number"},"discount":{"type":"number"},"identify":{"type":"string"},"payer_id":{"type":"number"},"po_value":{"type":"number"},"pipefy_id":{"type":"number"},"conta_azul":{"type":"string"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"last_quote":{"type":"string"},"order_form":{"type":"string"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"approved_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"canceled_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"final_value":{"type":"number"},"po_file_url":{"type":"string"},"client_notes":{"type":"string"},"freight_code":{"type":"string"},"freight_link":{"type":"string"},"money_saving":{"type":"number"},"oico_invoice":{"type":"boolean"},"buyer_user_id":{"type":"number"},"expected_date":{"type":"string","format":"date"},"expected_time":{"type":"string","format":"time","airbyte_type":"time_without_timezone"},"fast_delivery":{"type":"boolean"},"freight_value":{"type":"number"},"internal_notes":{"type":"string"},"payment_method":{"type":"number"},"quote_estimate":{"type":"number"},"automatic_quote":{"type":"boolean"},"expected_period":{"type":"number"},"financing_value":{"type":"number"},"parent_order_id":{"type":"number"},"user_preference":{"type":"number"},"quote_expires_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"buyer_location_id":{"type":"number"},"client_order_form":{"type":"string"},"flexible_delivery":{"type":"boolean"},"shopping_list_url":{"type":"string"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"cancelation_reason":{"type":"number"},"client_internal_id":{"type":"string"},"more_payment_terms":{"type":"boolean"},"cancelation_comment":{"type":"string"},"first_quote_sent_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"shareable_link_hash":{"type":"string"},"internal_delivery_notes":{"type":"string"},"expected_billing_due_date":{"type":"string","format":"date"},"last_rdo_scheduling_message_sent_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@215fd62e[stream=io.airbyte.protocol.models.AirbyteStream@51ab4437[name=payer_buyer_locations,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"buyer_id":{"type":"number"},"payer_id":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"buyer_location_id":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@43cc9ccb[stream=io.airbyte.protocol.models.AirbyteStream@1787b33[name=payers,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"cpf":{"type":"string"},"cnae":{"type":"string"},"cnpj":{"type":"string"},"name":{"type":"string"},"email":{"type":"string"},"omie_id":{"type":"string"},"activity":{"type":"number"},"bank_code":{"type":"string"},"conta_azul":{"type":"string"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"bank_branch":{"type":"string"},"bank_account":{"type":"string"},"credit_limit":{"type":"number"},"phone_number":{"type":"string"},"final_consumer":{"type":"boolean"},"internal_notes":{"type":"string"},"billing_address":{"type":"string"},"national_simple":{"type":"boolean"},"payer_confirmed":{"type":"boolean"},"tax_mode_simples":{"type":"boolean"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"payer_confirmed_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"payment_terms_days":{"type":"number"},"state_registration":{"type":"string"},"billing_address_city":{"type":"string"},"billing_address_state":{"type":"string"},"billing_address_street":{"type":"string"},"billing_address_zipcode":{"type":"string"},"bank_account_check_digit":{"type":"string"},"bank_account_holder_name":{"type":"string"},"billing_address_district":{"type":"string"},"bank_account_holder_document":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@5ec93394[stream=io.airbyte.protocol.models.AirbyteStream@55c84e86[name=payment_installments,jsonSchema={"type":"object","properties":{"id":{"type":"string"},"link":{"type":"string"},"type":{"type":"number"},"status":{"type":"number"},"paid_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"due_date":{"type":"string","format":"date"},"metadata":{"type":"string"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"paid_value":{"type":"number"},"payment_id":{"type":"string"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"canceled_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"receipt_url":{"type":"string"},"advance_payment":{"type":"boolean"},"bank_receipt_url":{"type":"string"},"external_identify":{"type":"string"},"installment_value":{"type":"number"},"original_due_date":{"type":"string","format":"date"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"installment_number":{"type":"number"},"transfeera_batch_id":{"type":"number"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@72c5ba30[stream=io.airbyte.protocol.models.AirbyteStream@30a6e6b8[name=payments,jsonSchema={"type":"object","properties":{"id":{"type":"string"},"type":{"type":"string"},"status":{"type":"number"},"omie_id":{"type":"string"},"discount":{"type":"number"},"order_id":{"type":"number"},"payer_id":{"type":"number"},"store_id":{"type":"number"},"xml_link":{"type":"string"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"created_by":{"type":"string"},"extra_fees":{"type":"number"},"paid_value":{"type":"number"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"canceled_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"payment_value":{"type":"number"},"omie_account_id":{"type":"string"},"postmark_read_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"purchase_order_id":{"type":"string"},"tax_document_link":{"type":"string"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"freight_partner_id":{"type":"number"},"tax_note_issued_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"postmark_message_id":{"type":"string"},"purchase_order_link":{"type":"string"},"tax_document_number":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@27e426ab[stream=io.airbyte.protocol.models.AirbyteStream@30cfe0af[name=popular_searches,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"name":{"type":"string"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@6f04d8bc[stream=io.airbyte.protocol.models.AirbyteStream@689060c2[name=product_canonical_categories,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"category_id":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"product_canonical_id":{"type":"number"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@6e47c205[stream=io.airbyte.protocol.models.AirbyteStream@21429dfa[name=product_canonicals,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"ean":{"type":"string"},"code":{"type":"string"},"gtin":{"type":"string"},"name":{"type":"string"},"brand":{"type":"string"},"image":{"type":"string"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"created_by":{"type":"number"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"width_per_unit":{"type":"number"},"height_per_unit":{"type":"number"},"lenght_per_unit":{"type":"number"},"reference_price":{"type":"number"},"weight_per_unit":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@68ca7056[stream=io.airbyte.protocol.models.AirbyteStream@3b78bfd[name=product_orders,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"order_id":{"type":"number"},"quantity":{"type":"number"},"low_stock":{"type":"boolean"},"oversized":{"type":"boolean"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"dispatched":{"type":"boolean"},"product_id":{"type":"number"},"quote_link":{"type":"string"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"returned_to":{"type":"number"},"confirmed_by":{"type":"number"},"under_review":{"type":"boolean"},"type_quantity":{"type":"number"},"custom_product":{"type":"boolean"},"store_quote_id":{"type":"string"},"pipefy_order_id":{"type":"number"},"canceled_by_store":{"type":"boolean"},"pipefy_product_id":{"type":"number"},"store_location_id":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"fits_in_motorcycle":{"type":"boolean"},"trusted_when_associated":{"type":"boolean"},"pipefy_location_store_id":{"type":"number"},"store_cancelation_reason":{"type":"number"},"location_store_product_id":{"type":"number"},"product_cost_when_associated":{"type":"number"},"product_price_when_associated":{"type":"number"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@53b03664[stream=io.airbyte.protocol.models.AirbyteStream@66a8dca5[name=product_reports,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"type":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"product_id":{"type":"number"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"buyer_user_id":{"type":"number"},"product_order_id":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"price_when_reported":{"type":"number"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@5d5b48e6[stream=io.airbyte.protocol.models.AirbyteStream@620cc8d3[name=products,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"ncm":{"type":"string"},"name":{"type":"string"},"price":{"type":"number"},"details":{"type":"string"},"omie_id":{"type":"string"},"trusted":{"type":"boolean"},"on_offer":{"type":"boolean"},"store_id":{"type":"number"},"available":{"type":"boolean"},"pipefy_id":{"type":"number"},"changed_by":{"type":"number"},"conta_azul":{"type":"string"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"description":{"type":"string"},"inserted_by":{"type":"number"},"type_quantity":{"type":"number"},"width_per_unit":{"type":"number"},"height_per_unit":{"type":"number"},"lenght_per_unit":{"type":"number"},"pipefy_store_id":{"type":"number"},"weight_per_unit":{"type":"number"},"minimum_quantity":{"type":"number"},"problem_reported":{"type":"number"},"external_identify":{"type":"string"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"oico_markup_retail":{"type":"number"},"available_to_stores":{"type":"boolean"},"product_canonical_id":{"type":"number"},"oico_markup_wholesale":{"type":"number"},"canonical_associated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@30ddc1e0[stream=io.airbyte.protocol.models.AirbyteStream@10307eaa[name=reports,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"sended":{"type":"boolean"},"message":{"type":"string"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"buyer_user_id":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@17ab0832[stream=io.airbyte.protocol.models.AirbyteStream@13651044[name=requested_products,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"comment":{"type":"string"},"order_id":{"type":"number"},"quantity":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"deleted_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"description":{"type":"string"},"unavailable":{"type":"boolean"},"done_by_client":{"type":"boolean"},"user_preference":{"type":"number"},"product_order_id":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"original_description":{"type":"string"},"product_canonical_id":{"type":"number"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@4d691109[stream=io.airbyte.protocol.models.AirbyteStream@5ebff320[name=responsible_deliveries,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"name":{"type":"string"},"email":{"type":"string"},"buyer_id":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"phone_number":{"type":"string"},"buyer_location_id":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@111a8a5d[stream=io.airbyte.protocol.models.AirbyteStream@2a465f0a[name=roi_products,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"name":{"type":"string"},"price":{"type":"number"},"_ab_cdc_lsn":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@2fa2f212[stream=io.airbyte.protocol.models.AirbyteStream@e253235[name=schema_migrations,jsonSchema={"type":"object","properties":{"version":{"type":"string"},"_ab_cdc_lsn":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[version]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[version]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@4ba819ce[stream=io.airbyte.protocol.models.AirbyteStream@538eb1be[name=shortened_urls,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"url":{"type":"string"},"category":{"type":"string"},"owner_id":{"type":"number"},"use_count":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"expires_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"owner_type":{"type":"string"},"unique_key":{"type":"string"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@6b04ebbf[stream=io.airbyte.protocol.models.AirbyteStream@4c97d870[name=sidekiq_sequence_records,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"data":{"type":"string"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"current_step":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@477ace45[stream=io.airbyte.protocol.models.AirbyteStream@615f8455[name=spatial_ref_sys,jsonSchema={"type":"object","properties":{"srid":{"type":"number"},"srtext":{"type":"string"},"auth_name":{"type":"string"},"auth_srid":{"type":"number"},"proj4text":{"type":"string"},"_ab_cdc_lsn":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[srid]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[srid]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@2dcac2d2[stream=io.airbyte.protocol.models.AirbyteStream@5fecdb43[name=stockout_events,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"order_id":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"created_by":{"type":"string"},"product_id":{"type":"number"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"price_when_deleted":{"type":"number"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@4e752e1d[stream=io.airbyte.protocol.models.AirbyteStream@539576aa[name=store_categories,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"store_id":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"category_id":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@28b2e258[stream=io.airbyte.protocol.models.AirbyteStream@113d12ce[name=store_locations,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"lat":{"type":"number"},"lng":{"type":"number"},"city":{"type":"string"},"name":{"type":"string"},"state":{"type":"string"},"street":{"type":"string"},"zipcode":{"type":"string"},"location":{"type":"string"},"store_id":{"type":"number"},"pipefy_id":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"address_details":{"type":"string"},"google_place_id":{"type":"string"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@76dfc332[stream=io.airbyte.protocol.models.AirbyteStream@e87cb65[name=store_order_quotes,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"sent_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"order_id":{"type":"number"},"store_id":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"product_id":{"type":"number"},"quote_link":{"type":"string"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@319848cf[stream=io.airbyte.protocol.models.AirbyteStream@484a9750[name=store_orders,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"order_id":{"type":"number"},"store_id":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"campaign_last_sent_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@40041b38[stream=io.airbyte.protocol.models.AirbyteStream@70e82cbe[name=store_users,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"name":{"type":"string"},"email":{"type":"string"},"active":{"type":"boolean"},"store_id":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"phone_number":{"type":"string"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"encrypted_password":{"type":"string"},"remember_created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"reset_password_token":{"type":"string"},"reset_password_sent_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@345cc5c[stream=io.airbyte.protocol.models.AirbyteStream@1f292b73[name=stores,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"cnae":{"type":"string"},"cnpj":{"type":"string"},"block":{"type":"boolean"},"omie_id":{"type":"string"},"pix_key":{"type":"string"},"website":{"type":"string"},"activity":{"type":"number"},"priority":{"type":"boolean"},"bank_code":{"type":"string"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"store_type":{"type":"number"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"bank_branch":{"type":"string"},"sales_email":{"type":"string"},"bank_account":{"type":"string"},"manufacturer":{"type":"boolean"},"oico_partner":{"type":"boolean"},"payment_type":{"type":"number"},"trading_name":{"type":"string"},"business_name":{"type":"string"},"sales_whatsapp":{"type":"string"},"national_simple":{"type":"boolean"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"state_registration":{"type":"string"},"minimum_response_time":{"type":"number"},"municipal_registration":{"type":"string"},"sales_point_of_contact":{"type":"string"},"payment_recommendations":{"type":"string"},"bank_account_check_digit":{"type":"string"},"bank_account_holder_name":{"type":"string"},"bank_account_holder_document":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@7f943e75[stream=io.airbyte.protocol.models.AirbyteStream@4e2870e5[name=term_acceptances,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"term_id":{"type":"number"},"buyer_id":{"type":"number"},"store_id":{"type":"number"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@63226250[stream=io.airbyte.protocol.models.AirbyteStream@3586bff4[name=terms,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"link":{"type":"string"},"type":{"type":"number"},"version":{"type":"string"},"mandatory":{"type":"boolean"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@6bbf48a7[stream=io.airbyte.protocol.models.AirbyteStream@669db26d[name=transfeera_batches,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"name":{"type":"string"},"created_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"updated_at":{"type":"string","format":"date-time","airbyte_type":"timestamp_without_timezone"},"_ab_cdc_lsn":{"type":"number"},"transfeera_id":{"type":"number"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=airbyte_cdc,additionalProperties={}],syncMode=incremental,cursorField=[],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[]] 2022-07-30 02:57:17 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):291 - Stopping temporal heartbeating... 2022-07-30 02:57:17 INFO i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/54/0/logs.log 2022-07-30 02:57:17 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.39.39-alpha 2022-07-30 02:57:17 INFO i.a.w.g.DefaultNormalizationWorker(run):50 - Running normalization. 2022-07-30 02:57:17 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):122 - Running with normalization version: airbyte/normalization:0.2.10 2022-07-30 02:57:17 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/normalization:0.2.10 exists... 2022-07-30 02:57:18 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/normalization:0.2.10 was found locally. 2022-07-30 02:57:18 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 54 2022-07-30 02:57:18 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/54/0/normalize --log-driver none --name normalization-normalize-54-0-fzorc --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.39.39-alpha airbyte/normalization:0.2.10 run --integration-type bigquery --config destination_config.json --catalog destination_catalog.json 2022-07-30 02:57:18 normalization > Running: transform-config --config destination_config.json --integration-type bigquery --out /data/54/0/normalize 2022-07-30 02:57:19 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/54/0/normalize') 2022-07-30 02:57:19 normalization > transform_bigquery 2022-07-30 02:57:19 normalization > Running: transform-catalog --integration-type bigquery --profile-config-dir /data/54/0/normalize --catalog destination_catalog.json --out /data/54/0/normalize/models/generated/ --json-column _airbyte_data 2022-07-30 02:57:20 normalization > Processing destination_catalog.json... 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/active_storage_attachments_ab1.sql from active_storage_attachments 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/active_storage_attachments_ab2.sql from active_storage_attachments 2022-07-30 02:57:20 normalization > Generating airbyte_views/airbyte_cdc/active_storage_attachments_stg.sql from active_storage_attachments 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/scd/airbyte_cdc/active_storage_attachments_scd.sql from active_storage_attachments 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/airbyte_cdc/active_storage_attachments.sql from active_storage_attachments 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/active_storage_blobs_ab1.sql from active_storage_blobs 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/active_storage_blobs_ab2.sql from active_storage_blobs 2022-07-30 02:57:20 normalization > Generating airbyte_views/airbyte_cdc/active_storage_blobs_stg.sql from active_storage_blobs 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/scd/airbyte_cdc/active_storage_blobs_scd.sql from active_storage_blobs 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/airbyte_cdc/active_storage_blobs.sql from active_storage_blobs 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/active_storage_variant_records_ab1.sql from active_storage_variant_records 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/active_storage_variant_records_ab2.sql from active_storage_variant_records 2022-07-30 02:57:20 normalization > Generating airbyte_views/airbyte_cdc/active_storage_variant_records_stg.sql from active_storage_variant_records 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/scd/airbyte_cdc/active_storage_variant_records_scd.sql from active_storage_variant_records 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/airbyte_cdc/active_storage_variant_records.sql from active_storage_variant_records 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/ar_internal_metadata_ab1.sql from ar_internal_metadata 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/ar_internal_metadata_ab2.sql from ar_internal_metadata 2022-07-30 02:57:20 normalization > Generating airbyte_views/airbyte_cdc/ar_internal_metadata_stg.sql from ar_internal_metadata 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/scd/airbyte_cdc/ar_internal_metadata_scd.sql from ar_internal_metadata 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/airbyte_cdc/ar_internal_metadata.sql from ar_internal_metadata 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/buyer_contact_rules_ab1.sql from buyer_contact_rules 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/buyer_contact_rules_ab2.sql from buyer_contact_rules 2022-07-30 02:57:20 normalization > Generating airbyte_views/airbyte_cdc/buyer_contact_rules_stg.sql from buyer_contact_rules 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/scd/airbyte_cdc/buyer_contact_rules_scd.sql from buyer_contact_rules 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/airbyte_cdc/buyer_contact_rules.sql from buyer_contact_rules 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/buyer_contacts_ab1.sql from buyer_contacts 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/buyer_contacts_ab2.sql from buyer_contacts 2022-07-30 02:57:20 normalization > Generating airbyte_views/airbyte_cdc/buyer_contacts_stg.sql from buyer_contacts 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/scd/airbyte_cdc/buyer_contacts_scd.sql from buyer_contacts 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/airbyte_cdc/buyer_contacts.sql from buyer_contacts 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/buyer_locations_ab1.sql from buyer_locations 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/buyer_locations_ab2.sql from buyer_locations 2022-07-30 02:57:20 normalization > Generating airbyte_views/airbyte_cdc/buyer_locations_stg.sql from buyer_locations 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/scd/airbyte_cdc/buyer_locations_scd.sql from buyer_locations 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/airbyte_cdc/buyer_locations.sql from buyer_locations 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/buyer_public_informations_ab1.sql from buyer_public_informations 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/buyer_public_informations_ab2.sql from buyer_public_informations 2022-07-30 02:57:20 normalization > Generating airbyte_views/airbyte_cdc/buyer_public_informations_stg.sql from buyer_public_informations 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/scd/airbyte_cdc/buyer_public_informations_scd.sql from buyer_public_informations 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/airbyte_cdc/buyer_public_informations.sql from buyer_public_informations 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/buyer_store_recommendations_ab1.sql from buyer_store_recommendations 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/buyer_store_recommendations_ab2.sql from buyer_store_recommendations 2022-07-30 02:57:20 normalization > Generating airbyte_views/airbyte_cdc/buyer_store_recommendations_stg.sql from buyer_store_recommendations 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/scd/airbyte_cdc/buyer_store_recommendations_scd.sql from buyer_store_recommendations 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/airbyte_cdc/buyer_store_recommendations.sql from buyer_store_recommendations 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/buyer_uploads_ab1.sql from buyer_uploads 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/buyer_uploads_ab2.sql from buyer_uploads 2022-07-30 02:57:20 normalization > Generating airbyte_views/airbyte_cdc/buyer_uploads_stg.sql from buyer_uploads 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/scd/airbyte_cdc/buyer_uploads_scd.sql from buyer_uploads 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/airbyte_cdc/buyer_uploads.sql from buyer_uploads 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/buyer_users_ab1.sql from buyer_users 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/buyer_users_ab2.sql from buyer_users 2022-07-30 02:57:20 normalization > Generating airbyte_views/airbyte_cdc/buyer_users_stg.sql from buyer_users 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/scd/airbyte_cdc/buyer_users_scd.sql from buyer_users 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/airbyte_cdc/buyer_users.sql from buyer_users 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/buyers_ab1.sql from buyers 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/buyers_ab2.sql from buyers 2022-07-30 02:57:20 normalization > Generating airbyte_views/airbyte_cdc/buyers_stg.sql from buyers 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/scd/airbyte_cdc/buyers_scd.sql from buyers 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/airbyte_cdc/buyers.sql from buyers 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/categories_ab1.sql from categories 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/categories_ab2.sql from categories 2022-07-30 02:57:20 normalization > Generating airbyte_views/airbyte_cdc/categories_stg.sql from categories 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/scd/airbyte_cdc/categories_scd.sql from categories 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/airbyte_cdc/categories.sql from categories 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/changebase_metadata_ab1.sql from changebase_metadata 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/changebase_metadata_ab2.sql from changebase_metadata 2022-07-30 02:57:20 normalization > Generating airbyte_views/airbyte_cdc/changebase_metadata_stg.sql from changebase_metadata 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/scd/airbyte_cdc/changebase_metadata_scd.sql from changebase_metadata 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/airbyte_cdc/changebase_metadata.sql from changebase_metadata 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/faq_ab1.sql from faq 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/faq_ab2.sql from faq 2022-07-30 02:57:20 normalization > Generating airbyte_views/airbyte_cdc/faq_stg.sql from faq 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/scd/airbyte_cdc/faq_scd.sql from faq 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/airbyte_cdc/faq.sql from faq 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/faq_categories_ab1.sql from faq_categories 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/faq_categories_ab2.sql from faq_categories 2022-07-30 02:57:20 normalization > Generating airbyte_views/airbyte_cdc/faq_categories_stg.sql from faq_categories 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/scd/airbyte_cdc/faq_categories_scd.sql from faq_categories 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/airbyte_cdc/faq_categories.sql from faq_categories 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/flipper_features_ab1.sql from flipper_features 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/flipper_features_ab2.sql from flipper_features 2022-07-30 02:57:20 normalization > Generating airbyte_views/airbyte_cdc/flipper_features_stg.sql from flipper_features 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/scd/airbyte_cdc/flipper_features_scd.sql from flipper_features 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/airbyte_cdc/flipper_features.sql from flipper_features 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/flipper_gates_ab1.sql from flipper_gates 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/flipper_gates_ab2.sql from flipper_gates 2022-07-30 02:57:20 normalization > Generating airbyte_views/airbyte_cdc/flipper_gates_stg.sql from flipper_gates 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/scd/airbyte_cdc/flipper_gates_scd.sql from flipper_gates 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/airbyte_cdc/flipper_gates.sql from flipper_gates 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/freight_partner_vehicles_ab1.sql from freight_partner_vehicles 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/freight_partner_vehicles_ab2.sql from freight_partner_vehicles 2022-07-30 02:57:20 normalization > Generating airbyte_views/airbyte_cdc/freight_partner_vehicles_stg.sql from freight_partner_vehicles 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/scd/airbyte_cdc/freight_partner_vehicles_scd.sql from freight_partner_vehicles 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/airbyte_cdc/freight_partner_vehicles.sql from freight_partner_vehicles 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/freight_partners_ab1.sql from freight_partners 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/freight_partners_ab2.sql from freight_partners 2022-07-30 02:57:20 normalization > Generating airbyte_views/airbyte_cdc/freight_partners_stg.sql from freight_partners 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/scd/airbyte_cdc/freight_partners_scd.sql from freight_partners 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/airbyte_cdc/freight_partners.sql from freight_partners 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/freight_product_orders_ab1.sql from freight_product_orders 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/freight_product_orders_ab2.sql from freight_product_orders 2022-07-30 02:57:20 normalization > Generating airbyte_views/airbyte_cdc/freight_product_orders_stg.sql from freight_product_orders 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/scd/airbyte_cdc/freight_product_orders_scd.sql from freight_product_orders 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/airbyte_cdc/freight_product_orders.sql from freight_product_orders 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/freight_route_groupings_ab1.sql from freight_route_groupings 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/freight_route_groupings_ab2.sql from freight_route_groupings 2022-07-30 02:57:20 normalization > Generating airbyte_views/airbyte_cdc/freight_route_groupings_stg.sql from freight_route_groupings 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/scd/airbyte_cdc/freight_route_groupings_scd.sql from freight_route_groupings 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/airbyte_cdc/freight_route_groupings.sql from freight_route_groupings 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/freight_route_partner_costs_ab1.sql from freight_route_partner_costs 2022-07-30 02:57:20 normalization > Generating airbyte_ctes/airbyte_cdc/freight_route_partner_costs_ab2.sql from freight_route_partner_costs 2022-07-30 02:57:20 normalization > Generating airbyte_views/airbyte_cdc/freight_route_partner_costs_stg.sql from freight_route_partner_costs 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/scd/airbyte_cdc/freight_route_partner_costs_scd.sql from freight_route_partner_costs 2022-07-30 02:57:20 normalization > Generating airbyte_incremental/airbyte_cdc/freight_route_partner_costs.sql from freight_route_partner_costs 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/freight_routes_ab1.sql from freight_routes 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/freight_routes_ab2.sql from freight_routes 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/freight_routes_stg.sql from freight_routes 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/freight_routes_scd.sql from freight_routes 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/freight_routes.sql from freight_routes 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/freight_vehicle_types_ab1.sql from freight_vehicle_types 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/freight_vehicle_types_ab2.sql from freight_vehicle_types 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/freight_vehicle_types_stg.sql from freight_vehicle_types 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/freight_vehicle_types_scd.sql from freight_vehicle_types 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/freight_vehicle_types.sql from freight_vehicle_types 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/freights_ab1.sql from freights 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/freights_ab2.sql from freights 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/freights_stg.sql from freights 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/freights_scd.sql from freights 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/freights.sql from freights 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/heya_campaign_memberships_ab1.sql from heya_campaign_memberships 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/heya_campaign_memberships_ab2.sql from heya_campaign_memberships 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/heya_campaign_memberships_stg.sql from heya_campaign_memberships 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/heya_campaign_memberships_scd.sql from heya_campaign_memberships 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/heya_campaign_memberships.sql from heya_campaign_memberships 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/heya_campaign_receipts_ab1.sql from heya_campaign_receipts 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/heya_campaign_receipts_ab2.sql from heya_campaign_receipts 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/heya_campaign_receipts_stg.sql from heya_campaign_receipts 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/heya_campaign_receipts_scd.sql from heya_campaign_receipts 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/heya_campaign_receipts.sql from heya_campaign_receipts 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/location_store_products_ab1.sql from location_store_products 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/location_store_products_ab2.sql from location_store_products 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/location_store_products_stg.sql from location_store_products 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/location_store_products_scd.sql from location_store_products 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/location_store_products.sql from location_store_products 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/memento_sessions_ab1.sql from memento_sessions 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/memento_sessions_ab2.sql from memento_sessions 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/memento_sessions_stg.sql from memento_sessions 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/memento_sessions_scd.sql from memento_sessions 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/memento_sessions.sql from memento_sessions 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/memento_states_ab1.sql from memento_states 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/memento_states_ab2.sql from memento_states 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/memento_states_stg.sql from memento_states 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/memento_states_scd.sql from memento_states 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/memento_states.sql from memento_states 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/oico_radar_products_ab1.sql from oico_radar_products 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/oico_radar_products_ab2.sql from oico_radar_products 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/oico_radar_products_stg.sql from oico_radar_products 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/oico_radar_products_scd.sql from oico_radar_products 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/oico_radar_products.sql from oico_radar_products 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/oico_radars_ab1.sql from oico_radars 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/oico_radars_ab2.sql from oico_radars 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/oico_radars_stg.sql from oico_radars 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/oico_radars_scd.sql from oico_radars 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/oico_radars.sql from oico_radars 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/oico_users_ab1.sql from oico_users 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/oico_users_ab2.sql from oico_users 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/oico_users_stg.sql from oico_users 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/oico_users_scd.sql from oico_users 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/oico_users.sql from oico_users 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/omie_accounts_ab1.sql from omie_accounts 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/omie_accounts_ab2.sql from omie_accounts 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/omie_accounts_stg.sql from omie_accounts 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/omie_accounts_scd.sql from omie_accounts 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/omie_accounts.sql from omie_accounts 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/order_categories_ab1.sql from order_categories 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/order_categories_ab2.sql from order_categories 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/order_categories_stg.sql from order_categories 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/order_categories_scd.sql from order_categories 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/order_categories.sql from order_categories 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/order_feedbacks_ab1.sql from order_feedbacks 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/order_feedbacks_ab2.sql from order_feedbacks 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/order_feedbacks_stg.sql from order_feedbacks 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/order_feedbacks_scd.sql from order_feedbacks 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/order_feedbacks.sql from order_feedbacks 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/order_issues_ab1.sql from order_issues 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/order_issues_ab2.sql from order_issues 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/order_issues_stg.sql from order_issues 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/order_issues_scd.sql from order_issues 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/order_issues.sql from order_issues 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/orders_ab1.sql from orders 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/orders_ab2.sql from orders 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/orders_stg.sql from orders 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/orders_scd.sql from orders 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/orders.sql from orders 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/payer_buyer_locations_ab1.sql from payer_buyer_locations 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/payer_buyer_locations_ab2.sql from payer_buyer_locations 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/payer_buyer_locations_stg.sql from payer_buyer_locations 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/payer_buyer_locations_scd.sql from payer_buyer_locations 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/payer_buyer_locations.sql from payer_buyer_locations 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/payers_ab1.sql from payers 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/payers_ab2.sql from payers 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/payers_stg.sql from payers 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/payers_scd.sql from payers 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/payers.sql from payers 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/payment_installments_ab1.sql from payment_installments 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/payment_installments_ab2.sql from payment_installments 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/payment_installments_stg.sql from payment_installments 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/payment_installments_scd.sql from payment_installments 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/payment_installments.sql from payment_installments 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/payments_ab1.sql from payments 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/payments_ab2.sql from payments 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/payments_stg.sql from payments 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/payments_scd.sql from payments 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/payments.sql from payments 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/popular_searches_ab1.sql from popular_searches 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/popular_searches_ab2.sql from popular_searches 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/popular_searches_stg.sql from popular_searches 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/popular_searches_scd.sql from popular_searches 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/popular_searches.sql from popular_searches 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/product_canonical_categories_ab1.sql from product_canonical_categories 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/product_canonical_categories_ab2.sql from product_canonical_categories 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/product_canonical_categories_stg.sql from product_canonical_categories 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/product_canonical_categories_scd.sql from product_canonical_categories 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/product_canonical_categories.sql from product_canonical_categories 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/product_canonicals_ab1.sql from product_canonicals 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/product_canonicals_ab2.sql from product_canonicals 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/product_canonicals_stg.sql from product_canonicals 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/product_canonicals_scd.sql from product_canonicals 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/product_canonicals.sql from product_canonicals 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/product_orders_ab1.sql from product_orders 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/product_orders_ab2.sql from product_orders 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/product_orders_stg.sql from product_orders 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/product_orders_scd.sql from product_orders 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/product_orders.sql from product_orders 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/product_reports_ab1.sql from product_reports 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/product_reports_ab2.sql from product_reports 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/product_reports_stg.sql from product_reports 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/product_reports_scd.sql from product_reports 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/product_reports.sql from product_reports 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/products_ab1.sql from products 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/products_ab2.sql from products 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/products_stg.sql from products 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/products_scd.sql from products 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/products.sql from products 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/reports_ab1.sql from reports 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/reports_ab2.sql from reports 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/reports_stg.sql from reports 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/reports_scd.sql from reports 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/reports.sql from reports 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/requested_products_ab1.sql from requested_products 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/requested_products_ab2.sql from requested_products 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/requested_products_stg.sql from requested_products 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/requested_products_scd.sql from requested_products 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/requested_products.sql from requested_products 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/responsible_deliveries_ab1.sql from responsible_deliveries 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/responsible_deliveries_ab2.sql from responsible_deliveries 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/responsible_deliveries_stg.sql from responsible_deliveries 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/responsible_deliveries_scd.sql from responsible_deliveries 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/responsible_deliveries.sql from responsible_deliveries 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/roi_products_ab1.sql from roi_products 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/roi_products_ab2.sql from roi_products 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/roi_products_stg.sql from roi_products 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/roi_products_scd.sql from roi_products 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/roi_products.sql from roi_products 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/schema_migrations_ab1.sql from schema_migrations 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/schema_migrations_ab2.sql from schema_migrations 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/schema_migrations_stg.sql from schema_migrations 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/schema_migrations_scd.sql from schema_migrations 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/schema_migrations.sql from schema_migrations 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/shortened_urls_ab1.sql from shortened_urls 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/shortened_urls_ab2.sql from shortened_urls 2022-07-30 02:57:21 normalization > Generating airbyte_views/airbyte_cdc/shortened_urls_stg.sql from shortened_urls 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/scd/airbyte_cdc/shortened_urls_scd.sql from shortened_urls 2022-07-30 02:57:21 normalization > Generating airbyte_incremental/airbyte_cdc/shortened_urls.sql from shortened_urls 2022-07-30 02:57:21 normalization > Generating airbyte_ctes/airbyte_cdc/sidekiq_sequence_records_ab1.sql from sidekiq_sequence_records 2022-07-30 02:57:22 normalization > Generating airbyte_ctes/airbyte_cdc/sidekiq_sequence_records_ab2.sql from sidekiq_sequence_records 2022-07-30 02:57:22 normalization > Generating airbyte_views/airbyte_cdc/sidekiq_sequence_records_stg.sql from sidekiq_sequence_records 2022-07-30 02:57:22 normalization > Generating airbyte_incremental/scd/airbyte_cdc/sidekiq_sequence_records_scd.sql from sidekiq_sequence_records 2022-07-30 02:57:22 normalization > Generating airbyte_incremental/airbyte_cdc/sidekiq_sequence_records.sql from sidekiq_sequence_records 2022-07-30 02:57:22 normalization > Generating airbyte_ctes/airbyte_cdc/spatial_ref_sys_ab1.sql from spatial_ref_sys 2022-07-30 02:57:22 normalization > Generating airbyte_ctes/airbyte_cdc/spatial_ref_sys_ab2.sql from spatial_ref_sys 2022-07-30 02:57:22 normalization > Generating airbyte_views/airbyte_cdc/spatial_ref_sys_stg.sql from spatial_ref_sys 2022-07-30 02:57:22 normalization > Generating airbyte_incremental/scd/airbyte_cdc/spatial_ref_sys_scd.sql from spatial_ref_sys 2022-07-30 02:57:22 normalization > Generating airbyte_incremental/airbyte_cdc/spatial_ref_sys.sql from spatial_ref_sys 2022-07-30 02:57:22 normalization > Generating airbyte_ctes/airbyte_cdc/stockout_events_ab1.sql from stockout_events 2022-07-30 02:57:22 normalization > Generating airbyte_ctes/airbyte_cdc/stockout_events_ab2.sql from stockout_events 2022-07-30 02:57:22 normalization > Generating airbyte_views/airbyte_cdc/stockout_events_stg.sql from stockout_events 2022-07-30 02:57:22 normalization > Generating airbyte_incremental/scd/airbyte_cdc/stockout_events_scd.sql from stockout_events 2022-07-30 02:57:22 normalization > Generating airbyte_incremental/airbyte_cdc/stockout_events.sql from stockout_events 2022-07-30 02:57:22 normalization > Generating airbyte_ctes/airbyte_cdc/store_categories_ab1.sql from store_categories 2022-07-30 02:57:22 normalization > Generating airbyte_ctes/airbyte_cdc/store_categories_ab2.sql from store_categories 2022-07-30 02:57:22 normalization > Generating airbyte_views/airbyte_cdc/store_categories_stg.sql from store_categories 2022-07-30 02:57:22 normalization > Generating airbyte_incremental/scd/airbyte_cdc/store_categories_scd.sql from store_categories 2022-07-30 02:57:22 normalization > Generating airbyte_incremental/airbyte_cdc/store_categories.sql from store_categories 2022-07-30 02:57:22 normalization > Generating airbyte_ctes/airbyte_cdc/store_locations_ab1.sql from store_locations 2022-07-30 02:57:22 normalization > Generating airbyte_ctes/airbyte_cdc/store_locations_ab2.sql from store_locations 2022-07-30 02:57:22 normalization > Generating airbyte_views/airbyte_cdc/store_locations_stg.sql from store_locations 2022-07-30 02:57:22 normalization > Generating airbyte_incremental/scd/airbyte_cdc/store_locations_scd.sql from store_locations 2022-07-30 02:57:22 normalization > Generating airbyte_incremental/airbyte_cdc/store_locations.sql from store_locations 2022-07-30 02:57:22 normalization > Generating airbyte_ctes/airbyte_cdc/store_order_quotes_ab1.sql from store_order_quotes 2022-07-30 02:57:22 normalization > Generating airbyte_ctes/airbyte_cdc/store_order_quotes_ab2.sql from store_order_quotes 2022-07-30 02:57:22 normalization > Generating airbyte_views/airbyte_cdc/store_order_quotes_stg.sql from store_order_quotes 2022-07-30 02:57:22 normalization > Generating airbyte_incremental/scd/airbyte_cdc/store_order_quotes_scd.sql from store_order_quotes 2022-07-30 02:57:22 normalization > Generating airbyte_incremental/airbyte_cdc/store_order_quotes.sql from store_order_quotes 2022-07-30 02:57:22 normalization > Generating airbyte_ctes/airbyte_cdc/store_orders_ab1.sql from store_orders 2022-07-30 02:57:22 normalization > Generating airbyte_ctes/airbyte_cdc/store_orders_ab2.sql from store_orders 2022-07-30 02:57:22 normalization > Generating airbyte_views/airbyte_cdc/store_orders_stg.sql from store_orders 2022-07-30 02:57:22 normalization > Generating airbyte_incremental/scd/airbyte_cdc/store_orders_scd.sql from store_orders 2022-07-30 02:57:22 normalization > Generating airbyte_incremental/airbyte_cdc/store_orders.sql from store_orders 2022-07-30 02:57:22 normalization > Generating airbyte_ctes/airbyte_cdc/store_users_ab1.sql from store_users 2022-07-30 02:57:22 normalization > Generating airbyte_ctes/airbyte_cdc/store_users_ab2.sql from store_users 2022-07-30 02:57:22 normalization > Generating airbyte_views/airbyte_cdc/store_users_stg.sql from store_users 2022-07-30 02:57:22 normalization > Generating airbyte_incremental/scd/airbyte_cdc/store_users_scd.sql from store_users 2022-07-30 02:57:22 normalization > Generating airbyte_incremental/airbyte_cdc/store_users.sql from store_users 2022-07-30 02:57:22 normalization > Generating airbyte_ctes/airbyte_cdc/stores_ab1.sql from stores 2022-07-30 02:57:22 normalization > Generating airbyte_ctes/airbyte_cdc/stores_ab2.sql from stores 2022-07-30 02:57:22 normalization > Generating airbyte_views/airbyte_cdc/stores_stg.sql from stores 2022-07-30 02:57:22 normalization > Generating airbyte_incremental/scd/airbyte_cdc/stores_scd.sql from stores 2022-07-30 02:57:22 normalization > Generating airbyte_incremental/airbyte_cdc/stores.sql from stores 2022-07-30 02:57:22 normalization > Generating airbyte_ctes/airbyte_cdc/term_acceptances_ab1.sql from term_acceptances 2022-07-30 02:57:22 normalization > Generating airbyte_ctes/airbyte_cdc/term_acceptances_ab2.sql from term_acceptances 2022-07-30 02:57:22 normalization > Generating airbyte_views/airbyte_cdc/term_acceptances_stg.sql from term_acceptances 2022-07-30 02:57:22 normalization > Generating airbyte_incremental/scd/airbyte_cdc/term_acceptances_scd.sql from term_acceptances 2022-07-30 02:57:22 normalization > Generating airbyte_incremental/airbyte_cdc/term_acceptances.sql from term_acceptances 2022-07-30 02:57:22 normalization > Generating airbyte_ctes/airbyte_cdc/terms_ab1.sql from terms 2022-07-30 02:57:22 normalization > Generating airbyte_ctes/airbyte_cdc/terms_ab2.sql from terms 2022-07-30 02:57:22 normalization > Generating airbyte_views/airbyte_cdc/terms_stg.sql from terms 2022-07-30 02:57:22 normalization > Generating airbyte_incremental/scd/airbyte_cdc/terms_scd.sql from terms 2022-07-30 02:57:22 normalization > Generating airbyte_incremental/airbyte_cdc/terms.sql from terms 2022-07-30 02:57:22 normalization > Generating airbyte_ctes/airbyte_cdc/transfeera_batches_ab1.sql from transfeera_batches 2022-07-30 02:57:22 normalization > Generating airbyte_ctes/airbyte_cdc/transfeera_batches_ab2.sql from transfeera_batches 2022-07-30 02:57:22 normalization > Generating airbyte_views/airbyte_cdc/transfeera_batches_stg.sql from transfeera_batches 2022-07-30 02:57:22 normalization > Generating airbyte_incremental/scd/airbyte_cdc/transfeera_batches_scd.sql from transfeera_batches 2022-07-30 02:57:22 normalization > Generating airbyte_incremental/airbyte_cdc/transfeera_batches.sql from transfeera_batches 2022-07-30 02:57:22 normalization > detected no config file for ssh, assuming ssh is off. 2022-07-30 02:57:24 normalization > [--event-buffer-size EVENT_BUFFER_SIZE] 2022-07-30 02:57:24 normalization > --event-buffer-size EVENT_BUFFER_SIZE 2022-07-30 02:57:24 normalization > 2022-07-30 02:57:24 normalization > DBT >=1.0.0 detected; using 10K event buffer size 2022-07-30 02:57:24 normalization > 2022-07-30 02:57:27 normalization > 02:57:27 Running with dbt=1.0.0 2022-07-30 02:57:27 normalization > 02:57:27 Partial parse save file not found. Starting full parse. 2022-07-30 02:57:34 normalization > 02:57:34 [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. 2022-07-30 02:57:34 normalization > There are 1 unused configuration paths: 2022-07-30 02:57:34 normalization > - models.airbyte_utils.generated.airbyte_tables 2022-07-30 02:57:34 normalization > 2022-07-30 02:57:34 normalization > 02:57:34 Found 335 models, 0 tests, 0 snapshots, 0 analyses, 554 macros, 0 operations, 0 seed files, 67 sources, 0 exposures, 0 metrics 2022-07-30 02:57:34 normalization > 02:57:34 2022-07-30 02:57:36 normalization > 02:57:36 Concurrency: 8 threads (target='prod') 2022-07-30 02:57:36 normalization > 02:57:36 2022-07-30 02:57:40 normalization > 02:57:40 2 of 201 START view model _airbyte_airbyte_cdc.buyer_contacts_stg....................................................... [RUN] 2022-07-30 02:57:40 normalization > 02:57:40 1 of 201 START view model _airbyte_airbyte_cdc.buyer_contact_rules_stg.................................................. [RUN] 2022-07-30 02:57:40 normalization > 02:57:40 4 of 201 START view model _airbyte_airbyte_cdc.active_storage_attachments_stg........................................... [RUN] 2022-07-30 02:57:40 normalization > 02:57:40 5 of 201 START view model _airbyte_airbyte_cdc.active_storage_variant_records_stg....................................... [RUN] 2022-07-30 02:57:40 normalization > 02:57:40 3 of 201 START view model _airbyte_airbyte_cdc.buyer_locations_stg...................................................... [RUN] 2022-07-30 02:57:40 normalization > 02:57:40 6 of 201 START view model _airbyte_airbyte_cdc.buyer_uploads_stg........................................................ [RUN] 2022-07-30 02:57:40 normalization > 02:57:40 7 of 201 START view model _airbyte_airbyte_cdc.categories_stg........................................................... [RUN] 2022-07-30 02:57:40 normalization > 02:57:40 8 of 201 START view model _airbyte_airbyte_cdc.buyer_public_informations_stg............................................ [RUN] 2022-07-30 02:57:41 normalization > 02:57:41 6 of 201 OK created view model _airbyte_airbyte_cdc.buyer_uploads_stg................................................... [OK in 0.95s] 2022-07-30 02:57:41 normalization > 02:57:41 9 of 201 START view model _airbyte_airbyte_cdc.ar_internal_metadata_stg................................................. [RUN] 2022-07-30 02:57:41 normalization > 02:57:41 5 of 201 OK created view model _airbyte_airbyte_cdc.active_storage_variant_records_stg.................................. [OK in 1.19s] 2022-07-30 02:57:41 normalization > 02:57:41 3 of 201 OK created view model _airbyte_airbyte_cdc.buyer_locations_stg................................................. [OK in 1.18s] 2022-07-30 02:57:41 normalization > 02:57:41 10 of 201 START view model _airbyte_airbyte_cdc.active_storage_blobs_stg................................................ [RUN] 2022-07-30 02:57:41 normalization > 02:57:41 11 of 201 START view model _airbyte_airbyte_cdc.changebase_metadata_stg................................................. [RUN] 2022-07-30 02:57:41 normalization > 02:57:41 4 of 201 OK created view model _airbyte_airbyte_cdc.active_storage_attachments_stg...................................... [OK in 1.20s] 2022-07-30 02:57:41 normalization > 02:57:41 12 of 201 START view model _airbyte_airbyte_cdc.faq_stg................................................................. [RUN] 2022-07-30 02:57:41 normalization > 02:57:41 8 of 201 OK created view model _airbyte_airbyte_cdc.buyer_public_informations_stg....................................... [OK in 1.08s] 2022-07-30 02:57:41 normalization > 02:57:41 13 of 201 START view model _airbyte_airbyte_cdc.flipper_features_stg.................................................... [RUN] 2022-07-30 02:57:41 normalization > 02:57:41 1 of 201 OK created view model _airbyte_airbyte_cdc.buyer_contact_rules_stg............................................. [OK in 1.45s] 2022-07-30 02:57:41 normalization > 02:57:41 2 of 201 OK created view model _airbyte_airbyte_cdc.buyer_contacts_stg.................................................. [OK in 1.45s] 2022-07-30 02:57:41 normalization > 02:57:41 7 of 201 OK created view model _airbyte_airbyte_cdc.categories_stg...................................................... [OK in 1.15s] 2022-07-30 02:57:41 normalization > 02:57:41 14 of 201 START view model _airbyte_airbyte_cdc.buyer_store_recommendations_stg......................................... [RUN] 2022-07-30 02:57:41 normalization > 02:57:41 16 of 201 START view model _airbyte_airbyte_cdc.buyers_stg.............................................................. [RUN] 2022-07-30 02:57:41 normalization > 02:57:41 15 of 201 START view model _airbyte_airbyte_cdc.freight_partners_stg.................................................... [RUN] 2022-07-30 02:57:42 normalization > 02:57:42 9 of 201 OK created view model _airbyte_airbyte_cdc.ar_internal_metadata_stg............................................ [OK in 0.81s] 2022-07-30 02:57:42 normalization > 02:57:42 17 of 201 START view model _airbyte_airbyte_cdc.faq_categories_stg...................................................... [RUN] 2022-07-30 02:57:42 normalization > 02:57:42 12 of 201 OK created view model _airbyte_airbyte_cdc.faq_stg............................................................ [OK in 0.99s] 2022-07-30 02:57:42 normalization > 02:57:42 10 of 201 OK created view model _airbyte_airbyte_cdc.active_storage_blobs_stg........................................... [OK in 1.04s] 2022-07-30 02:57:42 normalization > 02:57:42 18 of 201 START view model _airbyte_airbyte_cdc.freight_partner_vehicles_stg............................................ [RUN] 2022-07-30 02:57:42 normalization > 02:57:42 19 of 201 START view model _airbyte_airbyte_cdc.freight_route_partner_costs_stg......................................... [RUN] 2022-07-30 02:57:42 normalization > 02:57:42 11 of 201 OK created view model _airbyte_airbyte_cdc.changebase_metadata_stg............................................ [OK in 1.18s] 2022-07-30 02:57:42 normalization > 02:57:42 20 of 201 START view model _airbyte_airbyte_cdc.heya_campaign_memberships_stg........................................... [RUN] 2022-07-30 02:57:42 normalization > 02:57:42 13 of 201 OK created view model _airbyte_airbyte_cdc.flipper_features_stg............................................... [OK in 1.10s] 2022-07-30 02:57:42 normalization > 02:57:42 21 of 201 START view model _airbyte_airbyte_cdc.flipper_gates_stg....................................................... [RUN] 2022-07-30 02:57:42 normalization > 02:57:42 14 of 201 OK created view model _airbyte_airbyte_cdc.buyer_store_recommendations_stg.................................... [OK in 1.14s] 2022-07-30 02:57:42 normalization > 02:57:42 22 of 201 START view model _airbyte_airbyte_cdc.freight_product_orders_stg.............................................. [RUN] 2022-07-30 02:57:43 normalization > 02:57:43 17 of 201 OK created view model _airbyte_airbyte_cdc.faq_categories_stg................................................. [OK in 0.77s] 2022-07-30 02:57:43 normalization > 02:57:43 23 of 201 START view model _airbyte_airbyte_cdc.freight_route_groupings_stg............................................. [RUN] 2022-07-30 02:57:43 normalization > 02:57:43 16 of 201 OK created view model _airbyte_airbyte_cdc.buyers_stg......................................................... [OK in 1.13s] 2022-07-30 02:57:43 normalization > 02:57:43 15 of 201 OK created view model _airbyte_airbyte_cdc.freight_partners_stg............................................... [OK in 1.14s] 2022-07-30 02:57:43 normalization > 02:57:43 24 of 201 START view model _airbyte_airbyte_cdc.buyer_users_stg......................................................... [RUN] 2022-07-30 02:57:43 normalization > 02:57:43 25 of 201 START view model _airbyte_airbyte_cdc.freight_routes_stg...................................................... [RUN] 2022-07-30 02:57:43 normalization > 02:57:43 20 of 201 OK created view model _airbyte_airbyte_cdc.heya_campaign_memberships_stg...................................... [OK in 0.74s] 2022-07-30 02:57:43 normalization > 02:57:43 26 of 201 START view model _airbyte_airbyte_cdc.freights_stg............................................................ [RUN] 2022-07-30 02:57:43 normalization > 02:57:43 19 of 201 OK created view model _airbyte_airbyte_cdc.freight_route_partner_costs_stg.................................... [OK in 0.91s] 2022-07-30 02:57:43 normalization > 02:57:43 27 of 201 START view model _airbyte_airbyte_cdc.freight_vehicle_types_stg............................................... [RUN] 2022-07-30 02:57:43 normalization > 02:57:43 18 of 201 OK created view model _airbyte_airbyte_cdc.freight_partner_vehicles_stg....................................... [OK in 0.96s] 2022-07-30 02:57:43 normalization > 02:57:43 28 of 201 START view model _airbyte_airbyte_cdc.location_store_products_stg............................................. [RUN] 2022-07-30 02:57:43 normalization > 02:57:43 22 of 201 OK created view model _airbyte_airbyte_cdc.freight_product_orders_stg......................................... [OK in 0.98s] 2022-07-30 02:57:43 normalization > 02:57:43 29 of 201 START view model _airbyte_airbyte_cdc.memento_sessions_stg.................................................... [RUN] 2022-07-30 02:57:43 normalization > 02:57:43 21 of 201 OK created view model _airbyte_airbyte_cdc.flipper_gates_stg.................................................. [OK in 1.08s] 2022-07-30 02:57:43 normalization > 02:57:43 30 of 201 START view model _airbyte_airbyte_cdc.memento_states_stg...................................................... [RUN] 2022-07-30 02:57:44 normalization > 02:57:44 23 of 201 OK created view model _airbyte_airbyte_cdc.freight_route_groupings_stg........................................ [OK in 1.03s] 2022-07-30 02:57:44 normalization > 02:57:44 31 of 201 START view model _airbyte_airbyte_cdc.oico_radars_stg......................................................... [RUN] 2022-07-30 02:57:44 normalization > 02:57:44 24 of 201 OK created view model _airbyte_airbyte_cdc.buyer_users_stg.................................................... [OK in 1.11s] 2022-07-30 02:57:44 normalization > 02:57:44 32 of 201 START view model _airbyte_airbyte_cdc.oico_radar_products_stg................................................. [RUN] 2022-07-30 02:57:44 normalization > 02:57:44 25 of 201 OK created view model _airbyte_airbyte_cdc.freight_routes_stg................................................. [OK in 1.11s] 2022-07-30 02:57:44 normalization > 02:57:44 33 of 201 START view model _airbyte_airbyte_cdc.order_feedbacks_stg..................................................... [RUN] 2022-07-30 02:57:44 normalization > 02:57:44 27 of 201 OK created view model _airbyte_airbyte_cdc.freight_vehicle_types_stg.......................................... [OK in 0.74s] 2022-07-30 02:57:44 normalization > 02:57:44 28 of 201 OK created view model _airbyte_airbyte_cdc.location_store_products_stg........................................ [OK in 0.67s] 2022-07-30 02:57:44 normalization > 02:57:44 35 of 201 START view model _airbyte_airbyte_cdc.orders_stg.............................................................. [RUN] 2022-07-30 02:57:44 normalization > 02:57:44 34 of 201 START view model _airbyte_airbyte_cdc.order_issues_stg........................................................ [RUN] 2022-07-30 02:57:44 normalization > 02:57:44 26 of 201 OK created view model _airbyte_airbyte_cdc.freights_stg....................................................... [OK in 1.14s] 2022-07-30 02:57:44 normalization > 02:57:44 31 of 201 OK created view model _airbyte_airbyte_cdc.oico_radars_stg.................................................... [OK in 0.75s] 2022-07-30 02:57:44 normalization > 02:57:44 36 of 201 START view model _airbyte_airbyte_cdc.heya_campaign_receipts_stg.............................................. [RUN] 2022-07-30 02:57:44 normalization > 02:57:44 37 of 201 START view model _airbyte_airbyte_cdc.oico_users_stg.......................................................... [RUN] 2022-07-30 02:57:44 normalization > 02:57:44 30 of 201 OK created view model _airbyte_airbyte_cdc.memento_states_stg................................................. [OK in 0.91s] 2022-07-30 02:57:44 normalization > 02:57:44 29 of 201 OK created view model _airbyte_airbyte_cdc.memento_sessions_stg............................................... [OK in 0.96s] 2022-07-30 02:57:44 normalization > 02:57:44 38 of 201 START view model _airbyte_airbyte_cdc.omie_accounts_stg....................................................... [RUN] 2022-07-30 02:57:44 normalization > 02:57:44 39 of 201 START view model _airbyte_airbyte_cdc.popular_searches_stg.................................................... [RUN] 2022-07-30 02:57:45 normalization > 02:57:45 32 of 201 OK created view model _airbyte_airbyte_cdc.oico_radar_products_stg............................................ [OK in 0.87s] 2022-07-30 02:57:45 normalization > 02:57:45 33 of 201 OK created view model _airbyte_airbyte_cdc.order_feedbacks_stg................................................ [OK in 0.84s] 2022-07-30 02:57:45 normalization > 02:57:45 40 of 201 START view model _airbyte_airbyte_cdc.payer_buyer_locations_stg............................................... [RUN] 2022-07-30 02:57:45 normalization > 02:57:45 41 of 201 START view model _airbyte_airbyte_cdc.payers_stg.............................................................. [RUN] 2022-07-30 02:57:45 normalization > 02:57:45 35 of 201 OK created view model _airbyte_airbyte_cdc.orders_stg......................................................... [OK in 1.35s] 2022-07-30 02:57:45 normalization > 02:57:45 42 of 201 START view model _airbyte_airbyte_cdc.payments_stg............................................................ [RUN] 2022-07-30 02:57:45 normalization > 02:57:45 40 of 201 OK created view model _airbyte_airbyte_cdc.payer_buyer_locations_stg.......................................... [OK in 0.73s] 2022-07-30 02:57:45 normalization > 02:57:45 36 of 201 OK created view model _airbyte_airbyte_cdc.heya_campaign_receipts_stg......................................... [OK in 0.95s] 2022-07-30 02:57:45 normalization > 02:57:45 43 of 201 START view model _airbyte_airbyte_cdc.requested_products_stg.................................................. [RUN] 2022-07-30 02:57:45 normalization > 02:57:45 44 of 201 START view model _airbyte_airbyte_cdc.payment_installments_stg................................................ [RUN] 2022-07-30 02:57:45 normalization > 02:57:45 34 of 201 OK created view model _airbyte_airbyte_cdc.order_issues_stg................................................... [OK in 1.52s] 2022-07-30 02:57:45 normalization > 02:57:45 45 of 201 START view model _airbyte_airbyte_cdc.order_categories_stg.................................................... [RUN] 2022-07-30 02:57:46 normalization > 02:57:45 37 of 201 OK created view model _airbyte_airbyte_cdc.oico_users_stg..................................................... [OK in 1.11s] 2022-07-30 02:57:46 normalization > 02:57:46 46 of 201 START view model _airbyte_airbyte_cdc.product_canonical_categories_stg........................................ [RUN] 2022-07-30 02:57:46 normalization > 02:57:46 38 of 201 OK created view model _airbyte_airbyte_cdc.omie_accounts_stg.................................................. [OK in 1.10s] 2022-07-30 02:57:46 normalization > 02:57:46 41 of 201 OK created view model _airbyte_airbyte_cdc.payers_stg......................................................... [OK in 0.97s] 2022-07-30 02:57:46 normalization > 02:57:46 47 of 201 START view model _airbyte_airbyte_cdc.roi_products_stg........................................................ [RUN] 2022-07-30 02:57:46 normalization > 02:57:46 48 of 201 START view model _airbyte_airbyte_cdc.reports_stg............................................................. [RUN] 2022-07-30 02:57:46 normalization > 02:57:46 39 of 201 OK created view model _airbyte_airbyte_cdc.popular_searches_stg............................................... [OK in 1.13s] 2022-07-30 02:57:46 normalization > 02:57:46 49 of 201 START view model _airbyte_airbyte_cdc.product_orders_stg...................................................... [RUN] 2022-07-30 02:57:46 normalization > 02:57:46 44 of 201 OK created view model _airbyte_airbyte_cdc.payment_installments_stg........................................... [OK in 0.86s] 2022-07-30 02:57:46 normalization > 02:57:46 50 of 201 START view model _airbyte_airbyte_cdc.product_canonicals_stg.................................................. [RUN] 2022-07-30 02:57:46 normalization > 02:57:46 42 of 201 OK created view model _airbyte_airbyte_cdc.payments_stg....................................................... [OK in 1.00s] 2022-07-30 02:57:46 normalization > 02:57:46 51 of 201 START view model _airbyte_airbyte_cdc.products_stg............................................................ [RUN] 2022-07-30 02:57:46 normalization > 02:57:46 43 of 201 OK created view model _airbyte_airbyte_cdc.requested_products_stg............................................. [OK in 1.06s] 2022-07-30 02:57:46 normalization > 02:57:46 52 of 201 START view model _airbyte_airbyte_cdc.spatial_ref_sys_stg..................................................... [RUN] 2022-07-30 02:57:47 normalization > 02:57:47 45 of 201 OK created view model _airbyte_airbyte_cdc.order_categories_stg............................................... [OK in 1.06s] 2022-07-30 02:57:47 normalization > 02:57:47 53 of 201 START view model _airbyte_airbyte_cdc.schema_migrations_stg................................................... [RUN] 2022-07-30 02:57:47 normalization > 02:57:47 49 of 201 OK created view model _airbyte_airbyte_cdc.product_orders_stg................................................. [OK in 0.92s] 2022-07-30 02:57:47 normalization > 02:57:47 47 of 201 OK created view model _airbyte_airbyte_cdc.roi_products_stg................................................... [OK in 0.97s] 2022-07-30 02:57:47 normalization > 02:57:47 46 of 201 OK created view model _airbyte_airbyte_cdc.product_canonical_categories_stg................................... [OK in 1.05s] 2022-07-30 02:57:47 normalization > 02:57:47 54 of 201 START view model _airbyte_airbyte_cdc.product_reports_stg..................................................... [RUN] 2022-07-30 02:57:47 normalization > 02:57:47 55 of 201 START view model _airbyte_airbyte_cdc.store_categories_stg.................................................... [RUN] 2022-07-30 02:57:47 normalization > 02:57:47 56 of 201 START view model _airbyte_airbyte_cdc.shortened_urls_stg...................................................... [RUN] 2022-07-30 02:57:47 normalization > 02:57:47 48 of 201 OK created view model _airbyte_airbyte_cdc.reports_stg........................................................ [OK in 1.12s] 2022-07-30 02:57:47 normalization > 02:57:47 57 of 201 START view model _airbyte_airbyte_cdc.store_order_quotes_stg.................................................. [RUN] 2022-07-30 02:57:47 normalization > 02:57:47 51 of 201 OK created view model _airbyte_airbyte_cdc.products_stg....................................................... [OK in 0.89s] 2022-07-30 02:57:47 normalization > 02:57:47 58 of 201 START view model _airbyte_airbyte_cdc.stockout_events_stg..................................................... [RUN] 2022-07-30 02:57:47 normalization > 02:57:47 52 of 201 OK created view model _airbyte_airbyte_cdc.spatial_ref_sys_stg................................................ [OK in 0.77s] 2022-07-30 02:57:47 normalization > 02:57:47 50 of 201 OK created view model _airbyte_airbyte_cdc.product_canonicals_stg............................................. [OK in 0.99s] 2022-07-30 02:57:47 normalization > 02:57:47 60 of 201 START view model _airbyte_airbyte_cdc.terms_stg............................................................... [RUN] 2022-07-30 02:57:47 normalization > 02:57:47 59 of 201 START view model _airbyte_airbyte_cdc.sidekiq_sequence_records_stg............................................ [RUN] 2022-07-30 02:57:47 normalization > 02:57:47 53 of 201 OK created view model _airbyte_airbyte_cdc.schema_migrations_stg.............................................. [OK in 0.80s] 2022-07-30 02:57:47 normalization > 02:57:47 61 of 201 START view model _airbyte_airbyte_cdc.transfeera_batches_stg.................................................. [RUN] 2022-07-30 02:57:48 normalization > 02:57:47 57 of 201 OK created view model _airbyte_airbyte_cdc.store_order_quotes_stg............................................. [OK in 0.76s] 2022-07-30 02:57:48 normalization > 02:57:48 56 of 201 OK created view model _airbyte_airbyte_cdc.shortened_urls_stg................................................. [OK in 0.92s] 2022-07-30 02:57:48 normalization > 02:57:48 63 of 201 START view model _airbyte_airbyte_cdc.store_locations_stg..................................................... [RUN] 2022-07-30 02:57:48 normalization > 02:57:48 62 of 201 START view model _airbyte_airbyte_cdc.responsible_deliveries_stg.............................................. [RUN] 2022-07-30 02:57:48 normalization > 02:57:48 55 of 201 OK created view model _airbyte_airbyte_cdc.store_categories_stg............................................... [OK in 0.99s] 2022-07-30 02:57:48 normalization > 02:57:48 64 of 201 START view model _airbyte_airbyte_cdc.stores_stg.............................................................. [RUN] 2022-07-30 02:57:48 normalization > 02:57:48 54 of 201 OK created view model _airbyte_airbyte_cdc.product_reports_stg................................................ [OK in 1.13s] 2022-07-30 02:57:48 normalization > 02:57:48 65 of 201 START view model _airbyte_airbyte_cdc.term_acceptances_stg.................................................... [RUN] 2022-07-30 02:57:48 normalization > 02:57:48 59 of 201 OK created view model _airbyte_airbyte_cdc.sidekiq_sequence_records_stg....................................... [OK in 0.61s] 2022-07-30 02:57:48 normalization > 02:57:48 66 of 201 START view model _airbyte_airbyte_cdc.store_users_stg......................................................... [RUN] 2022-07-30 02:57:48 normalization > 02:57:48 58 of 201 OK created view model _airbyte_airbyte_cdc.stockout_events_stg................................................ [OK in 0.90s] 2022-07-30 02:57:48 normalization > 02:57:48 67 of 201 START view model _airbyte_airbyte_cdc.store_orders_stg........................................................ [RUN] 2022-07-30 02:57:48 normalization > 02:57:48 61 of 201 OK created view model _airbyte_airbyte_cdc.transfeera_batches_stg............................................. [OK in 0.83s] 2022-07-30 02:57:48 normalization > 02:57:48 68 of 201 START incremental model airbyte_cdc.buyer_uploads_scd......................................................... [RUN] 2022-07-30 02:57:48 normalization > 02:57:48 60 of 201 OK created view model _airbyte_airbyte_cdc.terms_stg.......................................................... [OK in 0.98s] 2022-07-30 02:57:48 normalization > 02:57:48 69 of 201 START incremental model airbyte_cdc.active_storage_variant_records_scd........................................ [RUN] 2022-07-30 02:57:48 normalization > 02:57:48 62 of 201 OK created view model _airbyte_airbyte_cdc.responsible_deliveries_stg......................................... [OK in 0.79s] 2022-07-30 02:57:48 normalization > 02:57:48 70 of 201 START incremental model airbyte_cdc.buyer_locations_scd....................................................... [RUN] 2022-07-30 02:57:48 normalization > 02:57:48 63 of 201 OK created view model _airbyte_airbyte_cdc.store_locations_stg................................................ [OK in 0.90s] 2022-07-30 02:57:48 normalization > 02:57:48 71 of 201 START incremental model airbyte_cdc.active_storage_attachments_scd............................................ [RUN] 2022-07-30 02:57:48 normalization > 02:57:48 02:57:48 + `dwcasa`.airbyte_cdc.`buyer_uploads_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:57:48 normalization > 02:57:48 02:57:48 + `dwcasa`.airbyte_cdc.`active_storage_variant_records_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:57:48 normalization > 02:57:48 02:57:48 + `dwcasa`.airbyte_cdc.`buyer_locations_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:57:49 normalization > 02:57:49 64 of 201 OK created view model _airbyte_airbyte_cdc.stores_stg......................................................... [OK in 0.97s] 2022-07-30 02:57:49 normalization > 02:57:49 72 of 201 START incremental model airbyte_cdc.buyer_public_informations_scd............................................. [RUN] 2022-07-30 02:57:49 normalization > 02:57:49 65 of 201 OK created view model _airbyte_airbyte_cdc.term_acceptances_stg............................................... [OK in 0.87s] 2022-07-30 02:57:49 normalization > 02:57:49 73 of 201 START incremental model airbyte_cdc.buyer_contact_rules_scd................................................... [RUN] 2022-07-30 02:57:49 normalization > 02:57:49 02:57:49 + `dwcasa`.airbyte_cdc.`active_storage_attachments_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:57:49 normalization > 02:57:49 66 of 201 OK created view model _airbyte_airbyte_cdc.store_users_stg.................................................... [OK in 0.88s] 2022-07-30 02:57:49 normalization > 02:57:49 74 of 201 START incremental model airbyte_cdc.buyer_contacts_scd........................................................ [RUN] 2022-07-30 02:57:49 normalization > 02:57:49 67 of 201 OK created view model _airbyte_airbyte_cdc.store_orders_stg................................................... [OK in 0.80s] 2022-07-30 02:57:49 normalization > 02:57:49 02:57:49 + `dwcasa`.airbyte_cdc.`buyer_public_informations_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:57:49 normalization > 02:57:49 75 of 201 START incremental model airbyte_cdc.categories_scd............................................................ [RUN] 2022-07-30 02:57:49 normalization > 02:57:49 02:57:49 + `dwcasa`.airbyte_cdc.`buyer_contact_rules_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:57:49 normalization > 02:57:49 02:57:49 + `dwcasa`.airbyte_cdc.`buyer_contacts_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:57:49 normalization > 02:57:49 02:57:49 + `dwcasa`.airbyte_cdc.`categories_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:57:54 normalization > 02:57:54 69 of 201 OK created incremental model airbyte_cdc.active_storage_variant_records_scd................................... [CREATE TABLE (0.0 rows, 0 processed) in 5.69s] 2022-07-30 02:57:54 normalization > 02:57:54 76 of 201 START incremental model airbyte_cdc.ar_internal_metadata_scd.................................................. [RUN] 2022-07-30 02:57:54 normalization > 02:57:54 02:57:54 + `dwcasa`.airbyte_cdc.`ar_internal_metadata_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:57:55 normalization > 02:57:55 74 of 201 OK created incremental model airbyte_cdc.buyer_contacts_scd................................................... [CREATE TABLE (5.0 rows, 1.7 KB processed) in 5.80s] 2022-07-30 02:57:55 normalization > 02:57:55 77 of 201 START incremental model airbyte_cdc.faq_scd................................................................... [RUN] 2022-07-30 02:57:55 normalization > 02:57:55 70 of 201 OK created incremental model airbyte_cdc.buyer_locations_scd.................................................. [CREATE TABLE (4.2k rows, 2.3 MB processed) in 6.38s] 2022-07-30 02:57:55 normalization > 02:57:55 78 of 201 START incremental model airbyte_cdc.active_storage_blobs_scd.................................................. [RUN] 2022-07-30 02:57:55 normalization > 02:57:55 73 of 201 OK created incremental model airbyte_cdc.buyer_contact_rules_scd.............................................. [CREATE TABLE (5.0 rows, 1.6 KB processed) in 6.15s] 2022-07-30 02:57:55 normalization > 02:57:55 79 of 201 START incremental model airbyte_cdc.changebase_metadata_scd................................................... [RUN] 2022-07-30 02:57:55 normalization > 02:57:55 75 of 201 OK created incremental model airbyte_cdc.categories_scd....................................................... [CREATE TABLE (43.0 rows, 13.8 KB processed) in 5.99s] 2022-07-30 02:57:55 normalization > 02:57:55 80 of 201 START incremental model airbyte_cdc.flipper_features_scd...................................................... [RUN] 2022-07-30 02:57:55 normalization > 02:57:55 68 of 201 OK created incremental model airbyte_cdc.buyer_uploads_scd.................................................... [CREATE TABLE (14.0 rows, 9.0 KB processed) in 6.72s] 2022-07-30 02:57:55 normalization > 02:57:55 81 of 201 START incremental model airbyte_cdc.buyer_store_recommendations_scd........................................... [RUN] 2022-07-30 02:57:55 normalization > 02:57:55 02:57:55 + `dwcasa`.airbyte_cdc.`active_storage_blobs_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:57:55 normalization > 02:57:55 02:57:55 + `dwcasa`.airbyte_cdc.`faq_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:57:55 normalization > 02:57:55 02:57:55 + `dwcasa`.airbyte_cdc.`flipper_features_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:57:55 normalization > 02:57:55 02:57:55 + `dwcasa`.airbyte_cdc.`changebase_metadata_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:57:55 normalization > 02:57:55 02:57:55 + `dwcasa`.airbyte_cdc.`buyer_store_recommendations_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:57:55 normalization > 02:57:55 72 of 201 OK created incremental model airbyte_cdc.buyer_public_informations_scd........................................ [CREATE TABLE (2.0k rows, 5.1 MB processed) in 6.74s] 2022-07-30 02:57:55 normalization > 02:57:55 82 of 201 START incremental model airbyte_cdc.faq_categories_scd........................................................ [RUN] 2022-07-30 02:57:55 normalization > 02:57:55 02:57:55 + `dwcasa`.airbyte_cdc.`faq_categories_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:57:57 normalization > 02:57:57 71 of 201 OK created incremental model airbyte_cdc.active_storage_attachments_scd....................................... [CREATE TABLE (56.2k rows, 16.1 MB processed) in 8.59s] 2022-07-30 02:57:57 normalization > 02:57:57 83 of 201 START incremental model airbyte_cdc.buyers_scd................................................................ [RUN] 2022-07-30 02:57:57 normalization > 02:57:57 02:57:57 + `dwcasa`.airbyte_cdc.`buyers_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:00 normalization > 02:58:00 76 of 201 OK created incremental model airbyte_cdc.ar_internal_metadata_scd............................................. [CREATE TABLE (1.0 rows, 277.0 Bytes processed) in 6.09s] 2022-07-30 02:58:00 normalization > 02:58:00 84 of 201 START incremental model airbyte_cdc.freight_partners_scd...................................................... [RUN] 2022-07-30 02:58:00 normalization > 02:58:00 02:58:00 + `dwcasa`.airbyte_cdc.`freight_partners_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:01 normalization > 02:58:01 82 of 201 OK created incremental model airbyte_cdc.faq_categories_scd................................................... [CREATE TABLE (8.0 rows, 2.1 KB processed) in 5.56s] 2022-07-30 02:58:01 normalization > 02:58:01 85 of 201 START incremental model airbyte_cdc.heya_campaign_memberships_scd............................................. [RUN] 2022-07-30 02:58:01 normalization > 02:58:01 79 of 201 OK created incremental model airbyte_cdc.changebase_metadata_scd.............................................. [CREATE TABLE (0.0 rows, 0 processed) in 6.17s] 2022-07-30 02:58:01 normalization > 02:58:01 86 of 201 START incremental model airbyte_cdc.freight_route_partner_costs_scd........................................... [RUN] 2022-07-30 02:58:01 normalization > 02:58:01 81 of 201 OK created incremental model airbyte_cdc.buyer_store_recommendations_scd...................................... [CREATE TABLE (1.0 rows, 410.0 Bytes processed) in 6.08s] 2022-07-30 02:58:01 normalization > 02:58:01 87 of 201 START incremental model airbyte_cdc.freight_partner_vehicles_scd.............................................. [RUN] 2022-07-30 02:58:01 normalization > 02:58:01 02:58:01 + `dwcasa`.airbyte_cdc.`heya_campaign_memberships_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:01 normalization > 02:58:01 80 of 201 OK created incremental model airbyte_cdc.flipper_features_scd................................................. [CREATE TABLE (10.0 rows, 2.6 KB processed) in 6.32s] 2022-07-30 02:58:01 normalization > 02:58:01 88 of 201 START incremental model airbyte_cdc.freight_product_orders_scd................................................ [RUN] 2022-07-30 02:58:01 normalization > 02:58:01 02:58:01 + `dwcasa`.airbyte_cdc.`freight_route_partner_costs_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:01 normalization > 02:58:01 02:58:01 + `dwcasa`.airbyte_cdc.`freight_partner_vehicles_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:01 normalization > 02:58:01 77 of 201 OK created incremental model airbyte_cdc.faq_scd.............................................................. [CREATE TABLE (23.0 rows, 15.9 KB processed) in 6.79s] 2022-07-30 02:58:01 normalization > 02:58:01 89 of 201 START incremental model airbyte_cdc.flipper_gates_scd......................................................... [RUN] 2022-07-30 02:58:01 normalization > 02:58:01 02:58:01 + `dwcasa`.airbyte_cdc.`freight_product_orders_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:02 normalization > 02:58:02 02:58:02 + `dwcasa`.airbyte_cdc.`flipper_gates_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:03 normalization > 02:58:03 83 of 201 ERROR creating incremental model airbyte_cdc.buyers_scd....................................................... [ERROR in 6.02s] 2022-07-30 02:58:03 normalization > 02:58:03 90 of 201 START incremental model airbyte_cdc.freight_route_groupings_scd............................................... [RUN] 2022-07-30 02:58:03 normalization > 02:58:03 02:58:03 + `dwcasa`.airbyte_cdc.`freight_route_groupings_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:05 normalization > 02:58:05 78 of 201 OK created incremental model airbyte_cdc.active_storage_blobs_scd............................................. [CREATE TABLE (56.5k rows, 26.0 MB processed) in 10.53s] 2022-07-30 02:58:05 normalization > 02:58:05 91 of 201 START incremental model airbyte_cdc.buyer_users_scd........................................................... [RUN] 2022-07-30 02:58:05 normalization > 02:58:05 02:58:05 + `dwcasa`.airbyte_cdc.`buyer_users_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:06 normalization > 02:58:06 84 of 201 OK created incremental model airbyte_cdc.freight_partners_scd................................................. [CREATE TABLE (99.0 rows, 50.9 KB processed) in 6.02s] 2022-07-30 02:58:06 normalization > 02:58:06 92 of 201 START incremental model airbyte_cdc.freight_routes_scd........................................................ [RUN] 2022-07-30 02:58:06 normalization > 02:58:06 02:58:06 + `dwcasa`.airbyte_cdc.`freight_routes_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:07 normalization > 02:58:07 87 of 201 OK created incremental model airbyte_cdc.freight_partner_vehicles_scd......................................... [CREATE TABLE (113.0 rows, 43.1 KB processed) in 5.70s] 2022-07-30 02:58:07 normalization > 02:58:07 93 of 201 START incremental model airbyte_cdc.freight_vehicle_types_scd................................................. [RUN] 2022-07-30 02:58:07 normalization > 02:58:07 85 of 201 OK created incremental model airbyte_cdc.heya_campaign_memberships_scd........................................ [CREATE TABLE (14.0 rows, 7.3 KB processed) in 5.93s] 2022-07-30 02:58:07 normalization > 02:58:07 94 of 201 START incremental model airbyte_cdc.location_store_products_scd............................................... [RUN] 2022-07-30 02:58:07 normalization > 02:58:07 02:58:07 + `dwcasa`.airbyte_cdc.`freight_vehicle_types_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:07 normalization > 02:58:07 02:58:07 + `dwcasa`.airbyte_cdc.`location_store_products_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:07 normalization > 02:58:07 86 of 201 OK created incremental model airbyte_cdc.freight_route_partner_costs_scd...................................... [CREATE TABLE (73.0 rows, 35.6 KB processed) in 6.18s] 2022-07-30 02:58:07 normalization > 02:58:07 95 of 201 START incremental model airbyte_cdc.freights_scd.............................................................. [RUN] 2022-07-30 02:58:07 normalization > 02:58:07 02:58:07 + `dwcasa`.airbyte_cdc.`freights_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:08 normalization > 02:58:08 88 of 201 OK created incremental model airbyte_cdc.freight_product_orders_scd........................................... [CREATE TABLE (35.0k rows, 11.8 MB processed) in 7.22s] 2022-07-30 02:58:08 normalization > 02:58:08 96 of 201 START incremental model airbyte_cdc.oico_radars_scd........................................................... [RUN] 2022-07-30 02:58:09 normalization > 02:58:09 02:58:09 + `dwcasa`.airbyte_cdc.`oico_radars_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:11 normalization > 02:58:11 90 of 201 OK created incremental model airbyte_cdc.freight_route_groupings_scd.......................................... [CREATE TABLE (24.0k rows, 15.3 MB processed) in 7.77s] 2022-07-30 02:58:11 normalization > 02:58:11 97 of 201 START incremental model airbyte_cdc.memento_states_scd........................................................ [RUN] 2022-07-30 02:58:11 normalization > 02:58:11 02:58:11 + `dwcasa`.airbyte_cdc.`memento_states_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:12 normalization > 02:58:12 93 of 201 OK created incremental model airbyte_cdc.freight_vehicle_types_scd............................................ [CREATE TABLE (22.0 rows, 7.6 KB processed) in 5.06s] 2022-07-30 02:58:12 normalization > 02:58:12 98 of 201 START incremental model airbyte_cdc.memento_sessions_scd...................................................... [RUN] 2022-07-30 02:58:12 normalization > 02:58:12 91 of 201 OK created incremental model airbyte_cdc.buyer_users_scd...................................................... [CREATE TABLE (1.8k rows, 1.6 MB processed) in 6.71s] 2022-07-30 02:58:12 normalization > 02:58:12 99 of 201 START incremental model airbyte_cdc.oico_radar_products_scd................................................... [RUN] 2022-07-30 02:58:12 normalization > 02:58:12 02:58:12 + `dwcasa`.airbyte_cdc.`memento_sessions_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:12 normalization > 02:58:12 02:58:12 + `dwcasa`.airbyte_cdc.`oico_radar_products_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:13 normalization > 02:58:13 94 of 201 OK created incremental model airbyte_cdc.location_store_products_scd.......................................... [CREATE TABLE (1.2k rows, 443.3 KB processed) in 5.88s] 2022-07-30 02:58:13 normalization > 02:58:13 100 of 201 START incremental model airbyte_cdc.order_feedbacks_scd...................................................... [RUN] 2022-07-30 02:58:13 normalization > 02:58:13 02:58:13 + `dwcasa`.airbyte_cdc.`order_feedbacks_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:14 normalization > 02:58:14 96 of 201 OK created incremental model airbyte_cdc.oico_radars_scd...................................................... [CREATE TABLE (3.0 rows, 1.3 KB processed) in 5.33s] 2022-07-30 02:58:14 normalization > 02:58:14 101 of 201 START incremental model airbyte_cdc.orders_scd............................................................... [RUN] 2022-07-30 02:58:14 normalization > 02:58:14 02:58:14 + `dwcasa`.airbyte_cdc.`orders_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:15 normalization > 02:58:15 92 of 201 OK created incremental model airbyte_cdc.freight_routes_scd................................................... [CREATE TABLE (9.6k rows, 15.0 MB processed) in 9.08s] 2022-07-30 02:58:15 normalization > 02:58:15 102 of 201 START incremental model airbyte_cdc.payer_buyer_locations_scd................................................ [RUN] 2022-07-30 02:58:15 normalization > 02:58:15 02:58:15 + `dwcasa`.airbyte_cdc.`payer_buyer_locations_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:17 normalization > 02:58:17 95 of 201 OK created incremental model airbyte_cdc.freights_scd......................................................... [CREATE TABLE (25.2k rows, 22.1 MB processed) in 9.50s] 2022-07-30 02:58:17 normalization > 02:58:17 103 of 201 START incremental model airbyte_cdc.heya_campaign_receipts_scd............................................... [RUN] 2022-07-30 02:58:17 normalization > 02:58:17 02:58:17 + `dwcasa`.airbyte_cdc.`heya_campaign_receipts_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:17 normalization > 02:58:17 97 of 201 OK created incremental model airbyte_cdc.memento_states_scd................................................... [CREATE TABLE (9.2k rows, 5.3 MB processed) in 6.61s] 2022-07-30 02:58:17 normalization > 02:58:17 104 of 201 START incremental model airbyte_cdc.order_issues_scd......................................................... [RUN] 2022-07-30 02:58:18 normalization > 02:58:18 02:58:18 + `dwcasa`.airbyte_cdc.`order_issues_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:18 normalization > 02:58:18 99 of 201 OK created incremental model airbyte_cdc.oico_radar_products_scd.............................................. [CREATE TABLE (7.0 rows, 2.1 KB processed) in 5.65s] 2022-07-30 02:58:18 normalization > 02:58:18 105 of 201 START incremental model airbyte_cdc.oico_users_scd........................................................... [RUN] 2022-07-30 02:58:18 normalization > 02:58:18 02:58:18 + `dwcasa`.airbyte_cdc.`oico_users_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:18 normalization > 02:58:18 100 of 201 OK created incremental model airbyte_cdc.order_feedbacks_scd................................................. [CREATE TABLE (324.0 rows, 89.8 KB processed) in 5.72s] 2022-07-30 02:58:18 normalization > 02:58:18 106 of 201 START incremental model airbyte_cdc.omie_accounts_scd........................................................ [RUN] 2022-07-30 02:58:19 normalization > 02:58:19 02:58:19 + `dwcasa`.airbyte_cdc.`omie_accounts_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:19 normalization > 02:58:19 98 of 201 OK created incremental model airbyte_cdc.memento_sessions_scd................................................. [CREATE TABLE (3.4k rows, 857.1 KB processed) in 6.90s] 2022-07-30 02:58:19 normalization > 02:58:19 107 of 201 START incremental model airbyte_cdc.payers_scd............................................................... [RUN] 2022-07-30 02:58:19 normalization > 02:58:19 02:58:19 + `dwcasa`.airbyte_cdc.`payers_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:21 normalization > 02:58:21 101 of 201 ERROR creating incremental model airbyte_cdc.orders_scd...................................................... [ERROR in 6.79s] 2022-07-30 02:58:21 normalization > 02:58:21 108 of 201 START incremental model airbyte_cdc.popular_searches_scd..................................................... [RUN] 2022-07-30 02:58:21 normalization > 02:58:21 02:58:21 + `dwcasa`.airbyte_cdc.`popular_searches_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:21 normalization > 02:58:21 102 of 201 OK created incremental model airbyte_cdc.payer_buyer_locations_scd........................................... [CREATE TABLE (4.9k rows, 1.4 MB processed) in 6.31s] 2022-07-30 02:58:21 normalization > 02:58:21 109 of 201 START incremental model airbyte_cdc.payment_installments_scd................................................. [RUN] 2022-07-30 02:58:22 normalization > 02:58:22 02:58:22 + `dwcasa`.airbyte_cdc.`payment_installments_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:23 normalization > 02:58:23 105 of 201 OK created incremental model airbyte_cdc.oico_users_scd...................................................... [CREATE TABLE (13.0 rows, 5.9 KB processed) in 5.69s] 2022-07-30 02:58:23 normalization > 02:58:23 110 of 201 START incremental model airbyte_cdc.payments_scd............................................................. [RUN] 2022-07-30 02:58:24 normalization > 02:58:24 02:58:24 + `dwcasa`.airbyte_cdc.`payments_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:24 normalization > 02:58:24 104 of 201 OK created incremental model airbyte_cdc.order_issues_scd.................................................... [CREATE TABLE (6.5k rows, 3.1 MB processed) in 6.20s] 2022-07-30 02:58:24 normalization > 02:58:24 111 of 201 START incremental model airbyte_cdc.requested_products_scd................................................... [RUN] 2022-07-30 02:58:24 normalization > 02:58:24 02:58:24 + `dwcasa`.airbyte_cdc.`requested_products_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:24 normalization > 02:58:24 103 of 201 OK created incremental model airbyte_cdc.heya_campaign_receipts_scd.......................................... [CREATE TABLE (30.7k rows, 12.5 MB processed) in 7.51s] 2022-07-30 02:58:24 normalization > 02:58:24 112 of 201 START incremental model airbyte_cdc.order_categories_scd..................................................... [RUN] 2022-07-30 02:58:24 normalization > 02:58:24 02:58:24 + `dwcasa`.airbyte_cdc.`order_categories_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:25 normalization > 02:58:25 107 of 201 OK created incremental model airbyte_cdc.payers_scd.......................................................... [CREATE TABLE (1.9k rows, 2.0 MB processed) in 6.11s] 2022-07-30 02:58:25 normalization > 02:58:25 113 of 201 START incremental model airbyte_cdc.product_orders_scd....................................................... [RUN] 2022-07-30 02:58:25 normalization > 02:58:25 02:58:25 + `dwcasa`.airbyte_cdc.`product_orders_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:26 normalization > 02:58:26 106 of 201 OK created incremental model airbyte_cdc.omie_accounts_scd................................................... [CREATE TABLE (1.0 rows, 357.0 Bytes processed) in 7.87s] 2022-07-30 02:58:26 normalization > 02:58:26 114 of 201 START incremental model airbyte_cdc.roi_products_scd......................................................... [RUN] 2022-07-30 02:58:26 normalization > 02:58:26 108 of 201 OK created incremental model airbyte_cdc.popular_searches_scd................................................ [CREATE TABLE (6.0 rows, 1.5 KB processed) in 5.75s] 2022-07-30 02:58:26 normalization > 02:58:26 115 of 201 START incremental model airbyte_cdc.product_canonical_categories_scd......................................... [RUN] 2022-07-30 02:58:26 normalization > 02:58:26 02:58:26 + `dwcasa`.airbyte_cdc.`product_canonical_categories_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:27 normalization > 02:58:27 02:58:27 + `dwcasa`.airbyte_cdc.`roi_products_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:28 normalization > 02:58:28 109 of 201 ERROR creating incremental model airbyte_cdc.payment_installments_scd........................................ [ERROR in 6.78s] 2022-07-30 02:58:28 normalization > 02:58:28 116 of 201 START incremental model airbyte_cdc.reports_scd.............................................................. [RUN] 2022-07-30 02:58:28 normalization > 02:58:28 02:58:28 + `dwcasa`.airbyte_cdc.`reports_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:30 normalization > 02:58:30 89 of 201 OK created incremental model airbyte_cdc.flipper_gates_scd.................................................... [CREATE TABLE (11.0 rows, 3.3 KB processed) in 28.61s] 2022-07-30 02:58:30 normalization > 02:58:30 117 of 201 START incremental model airbyte_cdc.products_scd............................................................. [RUN] 2022-07-30 02:58:30 normalization > 02:58:30 02:58:30 + `dwcasa`.airbyte_cdc.`products_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:30 normalization > 02:58:30 112 of 201 OK created incremental model airbyte_cdc.order_categories_scd................................................ [CREATE TABLE (13.7k rows, 3.7 MB processed) in 5.90s] 2022-07-30 02:58:30 normalization > 02:58:30 118 of 201 START incremental model airbyte_cdc.spatial_ref_sys_scd...................................................... [RUN] 2022-07-30 02:58:30 normalization > 02:58:30 02:58:30 + `dwcasa`.airbyte_cdc.`spatial_ref_sys_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:32 normalization > 02:58:32 114 of 201 OK created incremental model airbyte_cdc.roi_products_scd.................................................... [CREATE TABLE (5.0 rows, 1.0 KB processed) in 5.61s] 2022-07-30 02:58:32 normalization > 02:58:32 119 of 201 START incremental model airbyte_cdc.product_canonicals_scd................................................... [RUN] 2022-07-30 02:58:32 normalization > 02:58:32 02:58:32 + `dwcasa`.airbyte_cdc.`product_canonicals_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:33 normalization > 02:58:33 111 of 201 OK created incremental model airbyte_cdc.requested_products_scd.............................................. [CREATE TABLE (38.7k rows, 21.6 MB processed) in 9.44s] 2022-07-30 02:58:33 normalization > 02:58:33 120 of 201 START incremental model airbyte_cdc.schema_migrations_scd.................................................... [RUN] 2022-07-30 02:58:33 normalization > 02:58:33 02:58:33 + `dwcasa`.airbyte_cdc.`schema_migrations_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:34 normalization > 02:58:34 116 of 201 OK created incremental model airbyte_cdc.reports_scd......................................................... [CREATE TABLE (0.0 rows, 0 processed) in 5.86s] 2022-07-30 02:58:34 normalization > 02:58:34 121 of 201 START incremental model airbyte_cdc.store_order_quotes_scd................................................... [RUN] 2022-07-30 02:58:34 normalization > 02:58:34 02:58:34 + `dwcasa`.airbyte_cdc.`store_order_quotes_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:36 normalization > 02:58:36 118 of 201 OK created incremental model airbyte_cdc.spatial_ref_sys_scd................................................. [CREATE TABLE (0.0 rows, 0 processed) in 6.08s] 2022-07-30 02:58:36 normalization > 02:58:36 122 of 201 START incremental model airbyte_cdc.shortened_urls_scd....................................................... [RUN] 2022-07-30 02:58:36 normalization > 02:58:36 02:58:36 + `dwcasa`.airbyte_cdc.`shortened_urls_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:37 normalization > 02:58:37 110 of 201 OK created incremental model airbyte_cdc.payments_scd........................................................ [CREATE TABLE (28.7k rows, 27.3 MB processed) in 13.61s] 2022-07-30 02:58:37 normalization > 02:58:37 123 of 201 START incremental model airbyte_cdc.store_categories_scd..................................................... [RUN] 2022-07-30 02:58:37 normalization > 02:58:37 02:58:37 + `dwcasa`.airbyte_cdc.`store_categories_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:40 normalization > 02:58:40 120 of 201 OK created incremental model airbyte_cdc.schema_migrations_scd............................................... [CREATE TABLE (385.0 rows, 66.5 KB processed) in 6.67s] 2022-07-30 02:58:40 normalization > 02:58:40 124 of 201 START incremental model airbyte_cdc.product_reports_scd...................................................... [RUN] 2022-07-30 02:58:40 normalization > 02:58:40 02:58:40 + `dwcasa`.airbyte_cdc.`product_reports_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:43 normalization > 02:58:43 119 of 201 OK created incremental model airbyte_cdc.product_canonicals_scd.............................................. [CREATE TABLE (67.7k rows, 34.4 MB processed) in 10.67s] 2022-07-30 02:58:43 normalization > 02:58:43 125 of 201 START incremental model airbyte_cdc.sidekiq_sequence_records_scd............................................. [RUN] 2022-07-30 02:58:43 normalization > 02:58:43 02:58:43 + `dwcasa`.airbyte_cdc.`sidekiq_sequence_records_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:43 normalization > 02:58:43 122 of 201 OK created incremental model airbyte_cdc.shortened_urls_scd.................................................. [CREATE TABLE (19.4k rows, 9.0 MB processed) in 6.77s] 2022-07-30 02:58:43 normalization > 02:58:43 126 of 201 START incremental model airbyte_cdc.stockout_events_scd...................................................... [RUN] 2022-07-30 02:58:43 normalization > 02:58:43 02:58:43 + `dwcasa`.airbyte_cdc.`stockout_events_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:43 normalization > 02:58:43 121 of 201 OK created incremental model airbyte_cdc.store_order_quotes_scd.............................................. [CREATE TABLE (58.9k rows, 25.6 MB processed) in 9.41s] 2022-07-30 02:58:43 normalization > 02:58:43 127 of 201 START incremental model airbyte_cdc.transfeera_batches_scd................................................... [RUN] 2022-07-30 02:58:44 normalization > 02:58:44 02:58:44 + `dwcasa`.airbyte_cdc.`transfeera_batches_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:45 normalization > 02:58:45 123 of 201 OK created incremental model airbyte_cdc.store_categories_scd................................................ [CREATE TABLE (2.4k rows, 661.8 KB processed) in 8.41s] 2022-07-30 02:58:45 normalization > 02:58:45 128 of 201 START incremental model airbyte_cdc.terms_scd................................................................ [RUN] 2022-07-30 02:58:45 normalization > 02:58:45 124 of 201 OK created incremental model airbyte_cdc.product_reports_scd................................................. [CREATE TABLE (211.0 rows, 71.8 KB processed) in 5.73s] 2022-07-30 02:58:45 normalization > 02:58:45 129 of 201 START incremental model airbyte_cdc.responsible_deliveries_scd............................................... [RUN] 2022-07-30 02:58:46 normalization > 02:58:46 02:58:46 + `dwcasa`.airbyte_cdc.`terms_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:46 normalization > 02:58:46 02:58:46 + `dwcasa`.airbyte_cdc.`responsible_deliveries_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:46 normalization > 02:58:46 113 of 201 OK created incremental model airbyte_cdc.product_orders_scd.................................................. [CREATE TABLE (84.8k rows, 67.4 MB processed) in 20.95s] 2022-07-30 02:58:46 normalization > 02:58:46 130 of 201 START incremental model airbyte_cdc.store_locations_scd...................................................... [RUN] 2022-07-30 02:58:46 normalization > 02:58:46 02:58:46 + `dwcasa`.airbyte_cdc.`store_locations_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:48 normalization > 02:58:48 125 of 201 OK created incremental model airbyte_cdc.sidekiq_sequence_records_scd........................................ [CREATE TABLE (2.0 rows, 751.0 Bytes processed) in 5.79s] 2022-07-30 02:58:48 normalization > 02:58:48 131 of 201 START incremental model airbyte_cdc.stores_scd............................................................... [RUN] 2022-07-30 02:58:49 normalization > 02:58:49 126 of 201 OK created incremental model airbyte_cdc.stockout_events_scd................................................. [CREATE TABLE (1.1k rows, 388.5 KB processed) in 5.62s] 2022-07-30 02:58:49 normalization > 02:58:49 132 of 201 START incremental model airbyte_cdc.term_acceptances_scd..................................................... [RUN] 2022-07-30 02:58:49 normalization > 02:58:49 02:58:49 + `dwcasa`.airbyte_cdc.`stores_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:49 normalization > 02:58:49 02:58:49 + `dwcasa`.airbyte_cdc.`term_acceptances_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:49 normalization > 02:58:49 127 of 201 OK created incremental model airbyte_cdc.transfeera_batches_scd.............................................. [CREATE TABLE (1.8k rows, 535.0 KB processed) in 5.55s] 2022-07-30 02:58:49 normalization > 02:58:49 133 of 201 START incremental model airbyte_cdc.store_users_scd.......................................................... [RUN] 2022-07-30 02:58:49 normalization > 02:58:49 02:58:49 + `dwcasa`.airbyte_cdc.`store_users_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:51 normalization > 02:58:51 128 of 201 OK created incremental model airbyte_cdc.terms_scd........................................................... [CREATE TABLE (2.0 rows, 718.0 Bytes processed) in 5.27s] 2022-07-30 02:58:51 normalization > 02:58:51 134 of 201 START incremental model airbyte_cdc.store_orders_scd......................................................... [RUN] 2022-07-30 02:58:51 normalization > 02:58:51 02:58:51 + `dwcasa`.airbyte_cdc.`store_orders_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:51 normalization > 02:58:51 129 of 201 OK created incremental model airbyte_cdc.responsible_deliveries_scd.......................................... [CREATE TABLE (2.7k rows, 947.2 KB processed) in 5.44s] 2022-07-30 02:58:51 normalization > 02:58:51 135 of 201 START incremental model airbyte_cdc.active_storage_variant_records........................................... [RUN] 2022-07-30 02:58:51 normalization > 02:58:51 02:58:51 + `dwcasa`.airbyte_cdc.`active_storage_variant_records`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:52 normalization > 02:58:52 130 of 201 OK created incremental model airbyte_cdc.store_locations_scd................................................. [CREATE TABLE (1.3k rows, 808.6 KB processed) in 5.77s] 2022-07-30 02:58:52 normalization > 02:58:52 136 of 201 START incremental model airbyte_cdc.buyer_contacts........................................................... [RUN] 2022-07-30 02:58:52 normalization > 02:58:52 02:58:52 + `dwcasa`.airbyte_cdc.`buyer_contacts`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:54 normalization > 02:58:54 136 of 201 OK created incremental model airbyte_cdc.buyer_contacts...................................................... [CREATE TABLE (5.0 rows, 1.2 KB processed) in 2.34s] 2022-07-30 02:58:54 normalization > 02:58:54 137 of 201 START incremental model airbyte_cdc.buyer_locations.......................................................... [RUN] 2022-07-30 02:58:54 normalization > 02:58:54 131 of 201 OK created incremental model airbyte_cdc.stores_scd.......................................................... [CREATE TABLE (1.2k rows, 1.1 MB processed) in 5.57s] 2022-07-30 02:58:54 normalization > 02:58:54 138 of 201 START incremental model airbyte_cdc.buyer_contact_rules...................................................... [RUN] 2022-07-30 02:58:54 normalization > 02:58:54 02:58:54 + `dwcasa`.airbyte_cdc.`buyer_locations`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:54 normalization > 02:58:54 02:58:54 + `dwcasa`.airbyte_cdc.`buyer_contact_rules`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:54 normalization > 02:58:54 135 of 201 OK created incremental model airbyte_cdc.active_storage_variant_records...................................... [CREATE TABLE (0.0 rows, 0 processed) in 3.44s] 2022-07-30 02:58:54 normalization > 02:58:54 139 of 201 START incremental model airbyte_cdc.categories............................................................... [RUN] 2022-07-30 02:58:54 normalization > 02:58:54 132 of 201 OK created incremental model airbyte_cdc.term_acceptances_scd................................................ [CREATE TABLE (1.2k rows, 349.3 KB processed) in 5.82s] 2022-07-30 02:58:54 normalization > 02:58:54 140 of 201 START incremental model airbyte_cdc.buyer_uploads............................................................ [RUN] 2022-07-30 02:58:55 normalization > 02:58:55 02:58:55 + `dwcasa`.airbyte_cdc.`categories`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:55 normalization > 02:58:55 115 of 201 OK created incremental model airbyte_cdc.product_canonical_categories_scd.................................... [CREATE TABLE (65.9k rows, 18.4 MB processed) in 28.40s] 2022-07-30 02:58:55 normalization > 02:58:55 141 of 201 START incremental model airbyte_cdc.buyer_public_informations................................................ [RUN] 2022-07-30 02:58:55 normalization > 02:58:55 133 of 201 OK created incremental model airbyte_cdc.store_users_scd..................................................... [CREATE TABLE (226.0 rows, 141.6 KB processed) in 5.79s] 2022-07-30 02:58:55 normalization > 02:58:55 02:58:55 + `dwcasa`.airbyte_cdc.`buyer_uploads`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:55 normalization > 02:58:55 142 of 201 START incremental model airbyte_cdc.active_storage_attachments............................................... [RUN] 2022-07-30 02:58:55 normalization > 02:58:55 02:58:55 + `dwcasa`.airbyte_cdc.`buyer_public_informations`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:55 normalization > 02:58:55 02:58:55 + `dwcasa`.airbyte_cdc.`active_storage_attachments`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:56 normalization > 02:58:56 134 of 201 OK created incremental model airbyte_cdc.store_orders_scd.................................................... [CREATE TABLE (13.1k rows, 3.9 MB processed) in 5.61s] 2022-07-30 02:58:56 normalization > 02:58:56 143 of 201 START incremental model airbyte_cdc.ar_internal_metadata..................................................... [RUN] 2022-07-30 02:58:56 normalization > 02:58:56 02:58:56 + `dwcasa`.airbyte_cdc.`ar_internal_metadata`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:56 normalization > 02:58:56 138 of 201 OK created incremental model airbyte_cdc.buyer_contact_rules................................................. [CREATE TABLE (5.0 rows, 980.0 Bytes processed) in 2.54s] 2022-07-30 02:58:57 normalization > 02:58:56 144 of 201 START incremental model airbyte_cdc.faq_categories........................................................... [RUN] 2022-07-30 02:58:57 normalization > 02:58:57 02:58:57 + `dwcasa`.airbyte_cdc.`faq_categories`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:57 normalization > 02:58:57 139 of 201 OK created incremental model airbyte_cdc.categories.......................................................... [CREATE TABLE (43.0 rows, 8.6 KB processed) in 2.37s] 2022-07-30 02:58:57 normalization > 02:58:57 145 of 201 START incremental model airbyte_cdc.changebase_metadata...................................................... [RUN] 2022-07-30 02:58:57 normalization > 02:58:57 137 of 201 OK created incremental model airbyte_cdc.buyer_locations..................................................... [CREATE TABLE (4.2k rows, 1.5 MB processed) in 2.90s] 2022-07-30 02:58:57 normalization > 02:58:57 146 of 201 START incremental model airbyte_cdc.buyer_store_recommendations.............................................. [RUN] 2022-07-30 02:58:57 normalization > 02:58:57 02:58:57 + `dwcasa`.airbyte_cdc.`changebase_metadata`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:57 normalization > 02:58:57 02:58:57 + `dwcasa`.airbyte_cdc.`buyer_store_recommendations`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:57 normalization > 02:58:57 141 of 201 OK created incremental model airbyte_cdc.buyer_public_informations........................................... [CREATE TABLE (2.0k rows, 4.4 MB processed) in 2.76s] 2022-07-30 02:58:57 normalization > 02:58:57 147 of 201 START incremental model airbyte_cdc.flipper_features......................................................... [RUN] 2022-07-30 02:58:58 normalization > 02:58:58 02:58:58 + `dwcasa`.airbyte_cdc.`flipper_features`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:59 normalization > 02:58:59 117 of 201 OK created incremental model airbyte_cdc.products_scd........................................................ [CREATE TABLE (142.4k rows, 122.9 MB processed) in 28.60s] 2022-07-30 02:58:59 normalization > 02:58:59 148 of 201 START incremental model airbyte_cdc.faq...................................................................... [RUN] 2022-07-30 02:58:59 normalization > 02:58:59 02:58:59 + `dwcasa`.airbyte_cdc.`faq`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:59 normalization > 02:58:59 143 of 201 OK created incremental model airbyte_cdc.ar_internal_metadata................................................ [CREATE TABLE (1.0 rows, 197.0 Bytes processed) in 2.51s] 2022-07-30 02:58:59 normalization > 02:58:59 149 of 201 SKIP relation airbyte_cdc.buyers............................................................................. [SKIP] 2022-07-30 02:58:59 normalization > 02:58:59 150 of 201 START incremental model airbyte_cdc.active_storage_blobs..................................................... [RUN] 2022-07-30 02:58:59 normalization > 02:58:59 02:58:59 + `dwcasa`.airbyte_cdc.`active_storage_blobs`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:59 normalization > 02:58:59 144 of 201 OK created incremental model airbyte_cdc.faq_categories...................................................... [CREATE TABLE (8.0 rows, 1.6 KB processed) in 2.43s] 2022-07-30 02:58:59 normalization > 02:58:59 151 of 201 START incremental model airbyte_cdc.freight_partners......................................................... [RUN] 2022-07-30 02:58:59 normalization > 02:58:59 142 of 201 OK created incremental model airbyte_cdc.active_storage_attachments.......................................... [CREATE TABLE (56.2k rows, 12.1 MB processed) in 4.10s] 2022-07-30 02:58:59 normalization > 02:58:59 152 of 201 START incremental model airbyte_cdc.freight_partner_vehicles................................................. [RUN] 2022-07-30 02:58:59 normalization > 02:58:59 145 of 201 OK created incremental model airbyte_cdc.changebase_metadata................................................. [CREATE TABLE (0.0 rows, 0 processed) in 2.27s] 2022-07-30 02:58:59 normalization > 02:58:59 153 of 201 START incremental model airbyte_cdc.heya_campaign_memberships................................................ [RUN] 2022-07-30 02:58:59 normalization > 02:58:59 02:58:59 + `dwcasa`.airbyte_cdc.`freight_partner_vehicles`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:59 normalization > 02:58:59 02:58:59 + `dwcasa`.airbyte_cdc.`freight_partners`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:59 normalization > 02:58:59 02:58:59 + `dwcasa`.airbyte_cdc.`heya_campaign_memberships`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:58:59 normalization > 02:58:59 146 of 201 OK created incremental model airbyte_cdc.buyer_store_recommendations......................................... [CREATE TABLE (1.0 rows, 255.0 Bytes processed) in 2.60s] 2022-07-30 02:58:59 normalization > 02:58:59 154 of 201 START incremental model airbyte_cdc.freight_route_partner_costs.............................................. [RUN] 2022-07-30 02:59:00 normalization > 02:59:00 02:59:00 + `dwcasa`.airbyte_cdc.`freight_route_partner_costs`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:00 normalization > 02:59:00 147 of 201 OK created incremental model airbyte_cdc.flipper_features.................................................... [CREATE TABLE (10.0 rows, 1.9 KB processed) in 2.52s] 2022-07-30 02:59:00 normalization > 02:59:00 155 of 201 START incremental model airbyte_cdc.freight_product_orders................................................... [RUN] 2022-07-30 02:59:00 normalization > 02:59:00 02:59:00 + `dwcasa`.airbyte_cdc.`freight_product_orders`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:01 normalization > 02:59:01 148 of 201 OK created incremental model airbyte_cdc.faq................................................................. [CREATE TABLE (23.0 rows, 13.6 KB processed) in 2.57s] 2022-07-30 02:59:01 normalization > 02:59:01 156 of 201 START incremental model airbyte_cdc.freight_route_groupings.................................................. [RUN] 2022-07-30 02:59:01 normalization > 02:59:01 02:59:01 + `dwcasa`.airbyte_cdc.`freight_route_groupings`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:02 normalization > 02:59:02 152 of 201 OK created incremental model airbyte_cdc.freight_partner_vehicles............................................ [CREATE TABLE (113.0 rows, 24.7 KB processed) in 2.54s] 2022-07-30 02:59:02 normalization > 02:59:02 157 of 201 START incremental model airbyte_cdc.freight_vehicle_types.................................................... [RUN] 2022-07-30 02:59:02 normalization > 02:59:02 151 of 201 OK created incremental model airbyte_cdc.freight_partners.................................................... [CREATE TABLE (99.0 rows, 27.8 KB processed) in 2.63s] 2022-07-30 02:59:02 normalization > 02:59:02 158 of 201 START incremental model airbyte_cdc.buyer_users.............................................................. [RUN] 2022-07-30 02:59:02 normalization > 02:59:02 153 of 201 OK created incremental model airbyte_cdc.heya_campaign_memberships........................................... [CREATE TABLE (14.0 rows, 4.9 KB processed) in 2.62s] 2022-07-30 02:59:02 normalization > 02:59:02 159 of 201 START incremental model airbyte_cdc.location_store_products.................................................. [RUN] 2022-07-30 02:59:02 normalization > 02:59:02 02:59:02 + `dwcasa`.airbyte_cdc.`freight_vehicle_types`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:02 normalization > 02:59:02 02:59:02 + `dwcasa`.airbyte_cdc.`buyer_users`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:02 normalization > 02:59:02 02:59:02 + `dwcasa`.airbyte_cdc.`location_store_products`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:02 normalization > 02:59:02 154 of 201 OK created incremental model airbyte_cdc.freight_route_partner_costs......................................... [CREATE TABLE (73.0 rows, 17.8 KB processed) in 2.86s] 2022-07-30 02:59:02 normalization > 02:59:02 160 of 201 START incremental model airbyte_cdc.oico_radars.............................................................. [RUN] 2022-07-30 02:59:02 normalization > 02:59:02 150 of 201 OK created incremental model airbyte_cdc.active_storage_blobs................................................ [CREATE TABLE (56.5k rows, 19.5 MB processed) in 3.66s] 2022-07-30 02:59:02 normalization > 02:59:02 161 of 201 START incremental model airbyte_cdc.freight_routes........................................................... [RUN] 2022-07-30 02:59:02 normalization > 02:59:02 02:59:02 + `dwcasa`.airbyte_cdc.`oico_radars`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:03 normalization > 02:59:03 02:59:03 + `dwcasa`.airbyte_cdc.`freight_routes`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:03 normalization > 02:59:03 155 of 201 OK created incremental model airbyte_cdc.freight_product_orders.............................................. [CREATE TABLE (35.0k rows, 6.8 MB processed) in 3.06s] 2022-07-30 02:59:03 normalization > 02:59:03 162 of 201 START incremental model airbyte_cdc.freights................................................................. [RUN] 2022-07-30 02:59:03 normalization > 02:59:03 02:59:03 + `dwcasa`.airbyte_cdc.`freights`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:04 normalization > 02:59:04 157 of 201 OK created incremental model airbyte_cdc.freight_vehicle_types............................................... [CREATE TABLE (22.0 rows, 4.6 KB processed) in 2.30s] 2022-07-30 02:59:04 normalization > 02:59:04 163 of 201 START incremental model airbyte_cdc.memento_states........................................................... [RUN] 2022-07-30 02:59:04 normalization > 02:59:04 159 of 201 OK created incremental model airbyte_cdc.location_store_products............................................. [CREATE TABLE (1.2k rows, 243.6 KB processed) in 2.34s] 2022-07-30 02:59:04 normalization > 02:59:04 164 of 201 START incremental model airbyte_cdc.oico_radar_products...................................................... [RUN] 2022-07-30 02:59:04 normalization > 02:59:04 02:59:04 + `dwcasa`.airbyte_cdc.`memento_states`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:04 normalization > 02:59:04 158 of 201 OK created incremental model airbyte_cdc.buyer_users......................................................... [CREATE TABLE (1.8k rows, 652.4 KB processed) in 2.61s] 2022-07-30 02:59:04 normalization > 02:59:04 02:59:04 + `dwcasa`.airbyte_cdc.`oico_radar_products`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:04 normalization > 02:59:04 165 of 201 START incremental model airbyte_cdc.order_feedbacks.......................................................... [RUN] 2022-07-30 02:59:04 normalization > 02:59:04 156 of 201 OK created incremental model airbyte_cdc.freight_route_groupings............................................. [CREATE TABLE (24.0k rows, 12.6 MB processed) in 3.23s] 2022-07-30 02:59:04 normalization > 02:59:04 166 of 201 START incremental model airbyte_cdc.memento_sessions......................................................... [RUN] 2022-07-30 02:59:04 normalization > 02:59:04 02:59:04 + `dwcasa`.airbyte_cdc.`order_feedbacks`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:05 normalization > 02:59:05 02:59:05 + `dwcasa`.airbyte_cdc.`memento_sessions`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:05 normalization > 02:59:05 160 of 201 OK created incremental model airbyte_cdc.oico_radars......................................................... [CREATE TABLE (3.0 rows, 823.0 Bytes processed) in 2.56s] 2022-07-30 02:59:05 normalization > 02:59:05 167 of 201 SKIP relation airbyte_cdc.orders............................................................................. [SKIP] 2022-07-30 02:59:05 normalization > 02:59:05 168 of 201 START incremental model airbyte_cdc.payer_buyer_locations.................................................... [RUN] 2022-07-30 02:59:05 normalization > 02:59:05 02:59:05 + `dwcasa`.airbyte_cdc.`payer_buyer_locations`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:06 normalization > 02:59:06 161 of 201 OK created incremental model airbyte_cdc.freight_routes...................................................... [CREATE TABLE (9.6k rows, 9.1 MB processed) in 3.48s] 2022-07-30 02:59:06 normalization > 02:59:06 169 of 201 START incremental model airbyte_cdc.oico_users............................................................... [RUN] 2022-07-30 02:59:06 normalization > 02:59:06 02:59:06 + `dwcasa`.airbyte_cdc.`oico_users`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:06 normalization > 02:59:06 162 of 201 OK created incremental model airbyte_cdc.freights............................................................ [CREATE TABLE (25.2k rows, 6.7 MB processed) in 3.25s] 2022-07-30 02:59:06 normalization > 02:59:06 170 of 201 START incremental model airbyte_cdc.order_issues............................................................. [RUN] 2022-07-30 02:59:06 normalization > 02:59:06 02:59:06 + `dwcasa`.airbyte_cdc.`order_issues`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:07 normalization > 02:59:07 164 of 201 OK created incremental model airbyte_cdc.oico_radar_products................................................. [CREATE TABLE (7.0 rows, 1.4 KB processed) in 2.57s] 2022-07-30 02:59:07 normalization > 02:59:07 171 of 201 START incremental model airbyte_cdc.heya_campaign_receipts................................................... [RUN] 2022-07-30 02:59:07 normalization > 02:59:07 02:59:07 + `dwcasa`.airbyte_cdc.`heya_campaign_receipts`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:07 normalization > 02:59:07 165 of 201 OK created incremental model airbyte_cdc.order_feedbacks..................................................... [CREATE TABLE (324.0 rows, 62.3 KB processed) in 2.60s] 2022-07-30 02:59:07 normalization > 02:59:07 172 of 201 START incremental model airbyte_cdc.payers................................................................... [RUN] 2022-07-30 02:59:07 normalization > 02:59:07 166 of 201 OK created incremental model airbyte_cdc.memento_sessions.................................................... [CREATE TABLE (3.4k rows, 618.7 KB processed) in 2.53s] 2022-07-30 02:59:07 normalization > 02:59:07 173 of 201 START incremental model airbyte_cdc.omie_accounts............................................................ [RUN] 2022-07-30 02:59:07 normalization > 02:59:07 02:59:07 + `dwcasa`.airbyte_cdc.`payers`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:07 normalization > 02:59:07 02:59:07 + `dwcasa`.airbyte_cdc.`omie_accounts`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:07 normalization > 02:59:07 168 of 201 OK created incremental model airbyte_cdc.payer_buyer_locations............................................... [CREATE TABLE (4.9k rows, 934.5 KB processed) in 2.55s] 2022-07-30 02:59:07 normalization > 02:59:07 174 of 201 START incremental model airbyte_cdc.popular_searches......................................................... [RUN] 2022-07-30 02:59:08 normalization > 02:59:08 02:59:08 + `dwcasa`.airbyte_cdc.`popular_searches`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:09 normalization > 02:59:09 169 of 201 OK created incremental model airbyte_cdc.oico_users.......................................................... [CREATE TABLE (13.0 rows, 3.4 KB processed) in 2.78s] 2022-07-30 02:59:09 normalization > 02:59:09 175 of 201 SKIP relation airbyte_cdc.payment_installments............................................................... [SKIP] 2022-07-30 02:59:09 normalization > 02:59:09 176 of 201 START incremental model airbyte_cdc.flipper_gates............................................................ [RUN] 2022-07-30 02:59:09 normalization > 02:59:09 02:59:09 + `dwcasa`.airbyte_cdc.`flipper_gates`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:09 normalization > 02:59:09 170 of 201 OK created incremental model airbyte_cdc.order_issues........................................................ [CREATE TABLE (6.5k rows, 1.7 MB processed) in 2.78s] 2022-07-30 02:59:09 normalization > 02:59:09 177 of 201 START incremental model airbyte_cdc.order_categories......................................................... [RUN] 2022-07-30 02:59:09 normalization > 02:59:09 02:59:09 + `dwcasa`.airbyte_cdc.`order_categories`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:09 normalization > 02:59:09 173 of 201 OK created incremental model airbyte_cdc.omie_accounts....................................................... [CREATE TABLE (1.0 rows, 253.0 Bytes processed) in 2.42s] 2022-07-30 02:59:09 normalization > 02:59:09 178 of 201 START incremental model airbyte_cdc.roi_products............................................................. [RUN] 2022-07-30 02:59:09 normalization > 02:59:09 171 of 201 OK created incremental model airbyte_cdc.heya_campaign_receipts.............................................. [CREATE TABLE (30.7k rows, 8.7 MB processed) in 2.81s] 2022-07-30 02:59:09 normalization > 02:59:09 179 of 201 START incremental model airbyte_cdc.requested_products....................................................... [RUN] 2022-07-30 02:59:09 normalization > 02:59:09 02:59:09 + `dwcasa`.airbyte_cdc.`roi_products`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:10 normalization > 02:59:10 02:59:10 + `dwcasa`.airbyte_cdc.`requested_products`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:10 normalization > 02:59:10 174 of 201 OK created incremental model airbyte_cdc.popular_searches.................................................... [CREATE TABLE (6.0 rows, 1.1 KB processed) in 2.55s] 2022-07-30 02:59:10 normalization > 02:59:10 180 of 201 START incremental model airbyte_cdc.reports.................................................................. [RUN] 2022-07-30 02:59:10 normalization > 02:59:10 02:59:10 + `dwcasa`.airbyte_cdc.`reports`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:11 normalization > 02:59:11 176 of 201 OK created incremental model airbyte_cdc.flipper_gates....................................................... [CREATE TABLE (11.0 rows, 2.2 KB processed) in 2.27s] 2022-07-30 02:59:11 normalization > 02:59:11 181 of 201 START incremental model airbyte_cdc.spatial_ref_sys.......................................................... [RUN] 2022-07-30 02:59:11 normalization > 02:59:11 02:59:11 + `dwcasa`.airbyte_cdc.`spatial_ref_sys`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:12 normalization > 02:59:12 178 of 201 OK created incremental model airbyte_cdc.roi_products........................................................ [CREATE TABLE (5.0 rows, 1001.0 Bytes processed) in 2.21s] 2022-07-30 02:59:12 normalization > 02:59:12 182 of 201 START incremental model airbyte_cdc.payments................................................................. [RUN] 2022-07-30 02:59:12 normalization > 02:59:12 177 of 201 OK created incremental model airbyte_cdc.order_categories.................................................... [CREATE TABLE (13.7k rows, 2.6 MB processed) in 2.50s] 2022-07-30 02:59:12 normalization > 02:59:12 183 of 201 START incremental model airbyte_cdc.schema_migrations........................................................ [RUN] 2022-07-30 02:59:12 normalization > 02:59:12 02:59:12 + `dwcasa`.airbyte_cdc.`payments`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:12 normalization > 02:59:12 02:59:12 + `dwcasa`.airbyte_cdc.`schema_migrations`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:12 normalization > 02:59:12 180 of 201 OK created incremental model airbyte_cdc.reports............................................................. [CREATE TABLE (0.0 rows, 0 processed) in 2.52s] 2022-07-30 02:59:12 normalization > 02:59:12 184 of 201 START incremental model airbyte_cdc.product_canonicals....................................................... [RUN] 2022-07-30 02:59:13 normalization > 02:59:13 163 of 201 OK created incremental model airbyte_cdc.memento_states...................................................... [CREATE TABLE (9.2k rows, 4.1 MB processed) in 8.76s] 2022-07-30 02:59:13 normalization > 02:59:13 185 of 201 START incremental model airbyte_cdc.shortened_urls........................................................... [RUN] 2022-07-30 02:59:13 normalization > 02:59:13 02:59:13 + `dwcasa`.airbyte_cdc.`product_canonicals`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:13 normalization > 02:59:13 02:59:13 + `dwcasa`.airbyte_cdc.`shortened_urls`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:13 normalization > 02:59:13 179 of 201 OK created incremental model airbyte_cdc.requested_products.................................................. [CREATE TABLE (38.7k rows, 12.2 MB processed) in 3.43s] 2022-07-30 02:59:13 normalization > 02:59:13 186 of 201 START incremental model airbyte_cdc.store_order_quotes....................................................... [RUN] 2022-07-30 02:59:13 normalization > 02:59:13 02:59:13 + `dwcasa`.airbyte_cdc.`store_order_quotes`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:14 normalization > 02:59:14 181 of 201 OK created incremental model airbyte_cdc.spatial_ref_sys..................................................... [CREATE TABLE (0.0 rows, 0 processed) in 2.56s] 2022-07-30 02:59:14 normalization > 02:59:14 187 of 201 START incremental model airbyte_cdc.store_categories......................................................... [RUN] 2022-07-30 02:59:14 normalization > 02:59:14 02:59:14 + `dwcasa`.airbyte_cdc.`store_categories`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:14 normalization > 02:59:14 183 of 201 OK created incremental model airbyte_cdc.schema_migrations................................................... [CREATE TABLE (385.0 rows, 64.7 KB processed) in 2.49s] 2022-07-30 02:59:14 normalization > 02:59:14 188 of 201 START incremental model airbyte_cdc.product_reports.......................................................... [RUN] 2022-07-30 02:59:14 normalization > 02:59:14 02:59:14 + `dwcasa`.airbyte_cdc.`product_reports`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:15 normalization > 02:59:15 182 of 201 OK created incremental model airbyte_cdc.payments............................................................ [CREATE TABLE (28.7k rows, 14.7 MB processed) in 3.48s] 2022-07-30 02:59:15 normalization > 02:59:15 189 of 201 START incremental model airbyte_cdc.product_orders........................................................... [RUN] 2022-07-30 02:59:15 normalization > 02:59:15 02:59:15 + `dwcasa`.airbyte_cdc.`product_orders`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:16 normalization > 02:59:16 187 of 201 OK created incremental model airbyte_cdc.store_categories.................................................... [CREATE TABLE (2.4k rows, 464.5 KB processed) in 2.56s] 2022-07-30 02:59:16 normalization > 02:59:16 190 of 201 START incremental model airbyte_cdc.sidekiq_sequence_records................................................. [RUN] 2022-07-30 02:59:16 normalization > 02:59:16 02:59:16 + `dwcasa`.airbyte_cdc.`sidekiq_sequence_records`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:17 normalization > 02:59:17 184 of 201 OK created incremental model airbyte_cdc.product_canonicals.................................................. [CREATE TABLE (67.7k rows, 19.9 MB processed) in 4.09s] 2022-07-30 02:59:17 normalization > 02:59:17 191 of 201 START incremental model airbyte_cdc.stockout_events.......................................................... [RUN] 2022-07-30 02:59:17 normalization > 02:59:17 186 of 201 OK created incremental model airbyte_cdc.store_order_quotes.................................................. [CREATE TABLE (58.9k rows, 17.9 MB processed) in 3.76s] 2022-07-30 02:59:17 normalization > 02:59:17 192 of 201 START incremental model airbyte_cdc.transfeera_batches....................................................... [RUN] 2022-07-30 02:59:17 normalization > 02:59:17 02:59:17 + `dwcasa`.airbyte_cdc.`stockout_events`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:17 normalization > 02:59:17 02:59:17 + `dwcasa`.airbyte_cdc.`transfeera_batches`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:17 normalization > 02:59:17 140 of 201 OK created incremental model airbyte_cdc.buyer_uploads....................................................... [CREATE TABLE (14.0 rows, 8.3 KB processed) in 22.67s] 2022-07-30 02:59:17 normalization > 02:59:17 193 of 201 START incremental model airbyte_cdc.terms.................................................................... [RUN] 2022-07-30 02:59:17 normalization > 02:59:17 02:59:17 + `dwcasa`.airbyte_cdc.`terms`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:18 normalization > 02:59:18 185 of 201 OK created incremental model airbyte_cdc.shortened_urls...................................................... [CREATE TABLE (19.4k rows, 6.0 MB processed) in 5.06s] 2022-07-30 02:59:18 normalization > 02:59:18 194 of 201 START incremental model airbyte_cdc.responsible_deliveries................................................... [RUN] 2022-07-30 02:59:18 normalization > 02:59:18 02:59:18 + `dwcasa`.airbyte_cdc.`responsible_deliveries`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:19 normalization > 02:59:19 191 of 201 OK created incremental model airbyte_cdc.stockout_events..................................................... [CREATE TABLE (1.1k rows, 255.9 KB processed) in 2.20s] 2022-07-30 02:59:19 normalization > 02:59:19 195 of 201 START incremental model airbyte_cdc.store_locations.......................................................... [RUN] 2022-07-30 02:59:19 normalization > 02:59:19 02:59:19 + `dwcasa`.airbyte_cdc.`store_locations`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:19 normalization > 02:59:19 192 of 201 OK created incremental model airbyte_cdc.transfeera_batches.................................................. [CREATE TABLE (1.8k rows, 376.0 KB processed) in 2.51s] 2022-07-30 02:59:19 normalization > 02:59:19 196 of 201 START incremental model airbyte_cdc.stores................................................................... [RUN] 2022-07-30 02:59:19 normalization > 02:59:19 193 of 201 OK created incremental model airbyte_cdc.terms............................................................... [CREATE TABLE (2.0 rows, 520.0 Bytes processed) in 2.32s] 2022-07-30 02:59:19 normalization > 02:59:19 197 of 201 START incremental model airbyte_cdc.term_acceptances......................................................... [RUN] 2022-07-30 02:59:20 normalization > 02:59:20 189 of 201 OK created incremental model airbyte_cdc.product_orders...................................................... [CREATE TABLE (84.8k rows, 21.1 MB processed) in 4.50s] 2022-07-30 02:59:20 normalization > 02:59:20 198 of 201 START incremental model airbyte_cdc.product_canonical_categories............................................. [RUN] 2022-07-30 02:59:20 normalization > 02:59:20 02:59:20 + `dwcasa`.airbyte_cdc.`stores`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:20 normalization > 02:59:20 02:59:20 + `dwcasa`.airbyte_cdc.`term_acceptances`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:20 normalization > 02:59:20 02:59:20 + `dwcasa`.airbyte_cdc.`product_canonical_categories`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:20 normalization > 02:59:20 194 of 201 OK created incremental model airbyte_cdc.responsible_deliveries.............................................. [CREATE TABLE (2.7k rows, 617.9 KB processed) in 2.31s] 2022-07-30 02:59:20 normalization > 02:59:20 199 of 201 START incremental model airbyte_cdc.store_users.............................................................. [RUN] 2022-07-30 02:59:20 normalization > 02:59:20 02:59:20 + `dwcasa`.airbyte_cdc.`store_users`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:21 normalization > 02:59:21 190 of 201 OK created incremental model airbyte_cdc.sidekiq_sequence_records............................................ [CREATE TABLE (2.0 rows, 566.0 Bytes processed) in 4.68s] 2022-07-30 02:59:21 normalization > 02:59:21 200 of 201 START incremental model airbyte_cdc.store_orders............................................................. [RUN] 2022-07-30 02:59:21 normalization > 02:59:21 02:59:21 + `dwcasa`.airbyte_cdc.`store_orders`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:21 normalization > 02:59:21 195 of 201 OK created incremental model airbyte_cdc.store_locations..................................................... [CREATE TABLE (1.3k rows, 533.4 KB processed) in 2.31s] 2022-07-30 02:59:21 normalization > 02:59:21 201 of 201 START incremental model airbyte_cdc.products................................................................. [RUN] 2022-07-30 02:59:21 normalization > 02:59:21 02:59:21 + `dwcasa`.airbyte_cdc.`products`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:22 normalization > 02:59:22 188 of 201 OK created incremental model airbyte_cdc.product_reports..................................................... [CREATE TABLE (211.0 rows, 44.1 KB processed) in 7.53s] 2022-07-30 02:59:22 normalization > 02:59:22 196 of 201 OK created incremental model airbyte_cdc.stores.............................................................. [CREATE TABLE (1.2k rows, 397.0 KB processed) in 2.61s] 2022-07-30 02:59:22 normalization > 02:59:22 199 of 201 OK created incremental model airbyte_cdc.store_users......................................................... [CREATE TABLE (226.0 rows, 63.9 KB processed) in 2.49s] 2022-07-30 02:59:23 normalization > 02:59:23 198 of 201 OK created incremental model airbyte_cdc.product_canonical_categories........................................ [CREATE TABLE (65.9k rows, 12.3 MB processed) in 3.42s] 2022-07-30 02:59:23 normalization > 02:59:23 200 of 201 OK created incremental model airbyte_cdc.store_orders........................................................ [CREATE TABLE (13.1k rows, 2.5 MB processed) in 2.53s] 2022-07-30 02:59:26 normalization > 02:59:26 197 of 201 OK created incremental model airbyte_cdc.term_acceptances.................................................... [CREATE TABLE (1.2k rows, 222.8 KB processed) in 6.11s] 2022-07-30 02:59:27 normalization > 02:59:27 201 of 201 OK created incremental model airbyte_cdc.products............................................................ [CREATE TABLE (142.4k rows, 46.5 MB processed) in 5.65s] 2022-07-30 02:59:31 normalization > 02:59:31 172 of 201 OK created incremental model airbyte_cdc.payers.............................................................. [CREATE TABLE (1.9k rows, 772.5 KB processed) in 23.76s] 2022-07-30 02:59:31 normalization > 02:59:31 2022-07-30 02:59:31 normalization > 02:59:31 Finished running 67 view models, 134 incremental models in 116.08s. 2022-07-30 02:59:31 normalization > 02:59:31 2022-07-30 02:59:31 normalization > 02:59:31 Completed with 3 errors and 0 warnings: 2022-07-30 02:59:31 normalization > 02:59:31 2022-07-30 02:59:31 normalization > 02:59:31 Database Error in model buyers_scd (models/generated/airbyte_incremental/scd/airbyte_cdc/buyers_scd.sql) 2022-07-30 02:59:31 normalization > 02:59:31 Invalid date: '2019-10-31T00:00:00Z' 2022-07-30 02:59:31 normalization > 02:59:31 compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_incremental/scd/airbyte_cdc/buyers_scd.sql 2022-07-30 02:59:31 normalization > 02:59:31 2022-07-30 02:59:31 normalization > 02:59:31 Database Error in model orders_scd (models/generated/airbyte_incremental/scd/airbyte_cdc/orders_scd.sql) 2022-07-30 02:59:31 normalization > 02:59:31 Invalid date: '2021-05-14T00:00:00Z' 2022-07-30 02:59:31 normalization > 02:59:31 compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_incremental/scd/airbyte_cdc/orders_scd.sql 2022-07-30 02:59:31 normalization > 02:59:31 2022-07-30 02:59:31 normalization > 02:59:31 Database Error in model payment_installments_scd (models/generated/airbyte_incremental/scd/airbyte_cdc/payment_installments_scd.sql) 2022-07-30 02:59:31 normalization > 02:59:31 Invalid date: '2022-07-15T00:00:00Z' 2022-07-30 02:59:31 normalization > 02:59:31 compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_incremental/scd/airbyte_cdc/payment_installments_scd.sql 2022-07-30 02:59:31 normalization > 02:59:31 2022-07-30 02:59:31 normalization > 02:59:31 Done. PASS=195 WARN=0 ERROR=3 SKIP=3 TOTAL=201 2022-07-30 02:59:31 normalization > 2022-07-30 02:59:31 normalization > Diagnosing dbt debug to check if destination is available for dbt and well configured (1): 2022-07-30 02:59:31 normalization > 2022-07-30 02:59:34 normalization > 02:59:34 Running with dbt=1.0.0 2022-07-30 02:59:34 normalization > dbt version: 1.0.0 2022-07-30 02:59:34 normalization > python version: 3.9.9 2022-07-30 02:59:34 normalization > python path: /usr/local/bin/python 2022-07-30 02:59:34 normalization > os info: Linux-5.10.130-118.517.amzn2.x86_64-x86_64-with-glibc2.31 2022-07-30 02:59:34 normalization > Using profiles.yml file at /data/54/0/normalize/profiles.yml 2022-07-30 02:59:34 normalization > Using dbt_project.yml file at /data/54/0/normalize/dbt_project.yml 2022-07-30 02:59:34 normalization > 2022-07-30 02:59:34 normalization > Configuration: 2022-07-30 02:59:34 normalization > profiles.yml file [OK found and valid] 2022-07-30 02:59:34 normalization > dbt_project.yml file [OK found and valid] 2022-07-30 02:59:34 normalization > 2022-07-30 02:59:34 normalization > Required dependencies: 2022-07-30 02:59:34 normalization > - git [OK found] 2022-07-30 02:59:34 normalization > 2022-07-30 02:59:34 normalization > Connection: 2022-07-30 02:59:34 normalization > method: service-account-json 2022-07-30 02:59:34 normalization > database: dwcasa 2022-07-30 02:59:34 normalization > schema: dwcasa 2022-07-30 02:59:34 normalization > location: US 2022-07-30 02:59:34 normalization > priority: interactive 2022-07-30 02:59:34 normalization > timeout_seconds: 300 2022-07-30 02:59:34 normalization > maximum_bytes_billed: None 2022-07-30 02:59:34 normalization > execution_project: dwcasa 2022-07-30 02:59:34 normalization > Connection test: [OK connection ok] 2022-07-30 02:59:34 normalization > 2022-07-30 02:59:34 normalization > All checks passed! 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > Forward dbt output logs to diagnose/debug errors (0): 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ============================== 2022-07-30 02:57:27.246857 | e67c9e40-b438-4dba-8442-f8b58700d856 ============================== 2022-07-30 02:59:35 normalization > 02:57:27.246857 [info ] [MainThread]: Running with dbt=1.0.0 2022-07-30 02:59:35 normalization > 02:57:27.247924 [debug] [MainThread]: running dbt with arguments Namespace(record_timing_info=None, debug=None, log_format=None, write_json=None, use_colors=None, printer_width=None, warn_error=None, version_check=None, partial_parse=None, single_threaded=False, use_experimental_parser=None, static_parser=None, profiles_dir='/data/54/0/normalize', send_anonymous_usage_stats=None, fail_fast=None, event_buffer_size='10000', project_dir='/data/54/0/normalize', profile=None, target=None, vars='{}', log_cache_events=False, threads=None, select=None, exclude=None, selector_name=None, state=None, defer=None, full_refresh=False, cls=, which='run', rpc_method='run') 2022-07-30 02:59:35 normalization > 02:57:27.248815 [debug] [MainThread]: Tracking: do not track 2022-07-30 02:59:35 normalization > 02:57:27.293178 [info ] [MainThread]: Partial parse save file not found. Starting full parse. 2022-07-30 02:59:35 normalization > 02:57:27.357561 [debug] [MainThread]: Parsing macros/clean_tmp_tables.sql 2022-07-30 02:59:35 normalization > 02:57:27.360954 [debug] [MainThread]: Parsing macros/configuration.sql 2022-07-30 02:59:35 normalization > 02:57:27.363230 [debug] [MainThread]: Parsing macros/get_custom_schema.sql 2022-07-30 02:59:35 normalization > 02:57:27.364073 [debug] [MainThread]: Parsing macros/incremental.sql 2022-07-30 02:59:35 normalization > 02:57:27.371583 [debug] [MainThread]: Parsing macros/should_full_refresh.sql 2022-07-30 02:59:35 normalization > 02:57:27.376843 [debug] [MainThread]: Parsing macros/star_intersect.sql 2022-07-30 02:59:35 normalization > 02:57:27.383650 [debug] [MainThread]: Parsing macros/cross_db_utils/array.sql 2022-07-30 02:59:35 normalization > 02:57:27.398606 [debug] [MainThread]: Parsing macros/cross_db_utils/columns.sql 2022-07-30 02:59:35 normalization > 02:57:27.401479 [debug] [MainThread]: Parsing macros/cross_db_utils/concat.sql 2022-07-30 02:59:35 normalization > 02:57:27.404108 [debug] [MainThread]: Parsing macros/cross_db_utils/current_timestamp.sql 2022-07-30 02:59:35 normalization > 02:57:27.404824 [debug] [MainThread]: Parsing macros/cross_db_utils/datatypes.sql 2022-07-30 02:59:35 normalization > 02:57:27.415780 [debug] [MainThread]: Parsing macros/cross_db_utils/except.sql 2022-07-30 02:59:35 normalization > 02:57:27.416724 [debug] [MainThread]: Parsing macros/cross_db_utils/hash.sql 2022-07-30 02:59:35 normalization > 02:57:27.417368 [debug] [MainThread]: Parsing macros/cross_db_utils/json_operations.sql 2022-07-30 02:59:35 normalization > 02:57:27.456465 [debug] [MainThread]: Parsing macros/cross_db_utils/quote.sql 2022-07-30 02:59:35 normalization > 02:57:27.458213 [debug] [MainThread]: Parsing macros/cross_db_utils/surrogate_key.sql 2022-07-30 02:59:35 normalization > 02:57:27.460349 [debug] [MainThread]: Parsing macros/cross_db_utils/type_conversions.sql 2022-07-30 02:59:35 normalization > 02:57:27.469087 [debug] [MainThread]: Parsing macros/schema_tests/equal_rowcount.sql 2022-07-30 02:59:35 normalization > 02:57:27.470446 [debug] [MainThread]: Parsing macros/schema_tests/equality.sql 2022-07-30 02:59:35 normalization > 02:57:27.477452 [debug] [MainThread]: Parsing macros/adapters.sql 2022-07-30 02:59:35 normalization > 02:57:27.502000 [debug] [MainThread]: Parsing macros/catalog.sql 2022-07-30 02:59:35 normalization > 02:57:27.508764 [debug] [MainThread]: Parsing macros/etc.sql 2022-07-30 02:59:35 normalization > 02:57:27.510951 [debug] [MainThread]: Parsing macros/materializations/copy.sql 2022-07-30 02:59:35 normalization > 02:57:27.513900 [debug] [MainThread]: Parsing macros/materializations/incremental.sql 2022-07-30 02:59:35 normalization > 02:57:27.530456 [debug] [MainThread]: Parsing macros/materializations/seed.sql 2022-07-30 02:59:35 normalization > 02:57:27.533325 [debug] [MainThread]: Parsing macros/materializations/snapshot.sql 2022-07-30 02:59:35 normalization > 02:57:27.535225 [debug] [MainThread]: Parsing macros/materializations/table.sql 2022-07-30 02:59:35 normalization > 02:57:27.539438 [debug] [MainThread]: Parsing macros/materializations/view.sql 2022-07-30 02:59:35 normalization > 02:57:27.542301 [debug] [MainThread]: Parsing macros/adapters/columns.sql 2022-07-30 02:59:35 normalization > 02:57:27.553190 [debug] [MainThread]: Parsing macros/adapters/freshness.sql 2022-07-30 02:59:35 normalization > 02:57:27.556544 [debug] [MainThread]: Parsing macros/adapters/indexes.sql 2022-07-30 02:59:35 normalization > 02:57:27.559571 [debug] [MainThread]: Parsing macros/adapters/metadata.sql 2022-07-30 02:59:35 normalization > 02:57:27.567264 [debug] [MainThread]: Parsing macros/adapters/persist_docs.sql 2022-07-30 02:59:35 normalization > 02:57:27.572292 [debug] [MainThread]: Parsing macros/adapters/relation.sql 2022-07-30 02:59:35 normalization > 02:57:27.582675 [debug] [MainThread]: Parsing macros/adapters/schema.sql 2022-07-30 02:59:35 normalization > 02:57:27.585134 [debug] [MainThread]: Parsing macros/etc/datetime.sql 2022-07-30 02:59:35 normalization > 02:57:27.594609 [debug] [MainThread]: Parsing macros/etc/statement.sql 2022-07-30 02:59:35 normalization > 02:57:27.599505 [debug] [MainThread]: Parsing macros/generic_test_sql/accepted_values.sql 2022-07-30 02:59:35 normalization > 02:57:27.601081 [debug] [MainThread]: Parsing macros/generic_test_sql/not_null.sql 2022-07-30 02:59:35 normalization > 02:57:27.601701 [debug] [MainThread]: Parsing macros/generic_test_sql/relationships.sql 2022-07-30 02:59:35 normalization > 02:57:27.602647 [debug] [MainThread]: Parsing macros/generic_test_sql/unique.sql 2022-07-30 02:59:35 normalization > 02:57:27.603416 [debug] [MainThread]: Parsing macros/get_custom_name/get_custom_alias.sql 2022-07-30 02:59:35 normalization > 02:57:27.605016 [debug] [MainThread]: Parsing macros/get_custom_name/get_custom_database.sql 2022-07-30 02:59:35 normalization > 02:57:27.606758 [debug] [MainThread]: Parsing macros/get_custom_name/get_custom_schema.sql 2022-07-30 02:59:35 normalization > 02:57:27.609498 [debug] [MainThread]: Parsing macros/materializations/configs.sql 2022-07-30 02:59:35 normalization > 02:57:27.612277 [debug] [MainThread]: Parsing macros/materializations/hooks.sql 2022-07-30 02:59:35 normalization > 02:57:27.616512 [debug] [MainThread]: Parsing macros/materializations/models/incremental/column_helpers.sql 2022-07-30 02:59:35 normalization > 02:57:27.621446 [debug] [MainThread]: Parsing macros/materializations/models/incremental/incremental.sql 2022-07-30 02:59:35 normalization > 02:57:27.632423 [debug] [MainThread]: Parsing macros/materializations/models/incremental/is_incremental.sql 2022-07-30 02:59:35 normalization > 02:57:27.634258 [debug] [MainThread]: Parsing macros/materializations/models/incremental/merge.sql 2022-07-30 02:59:35 normalization > 02:57:27.646554 [debug] [MainThread]: Parsing macros/materializations/models/incremental/on_schema_change.sql 2022-07-30 02:59:35 normalization > 02:57:27.663818 [debug] [MainThread]: Parsing macros/materializations/models/table/create_table_as.sql 2022-07-30 02:59:35 normalization > 02:57:27.667181 [debug] [MainThread]: Parsing macros/materializations/models/table/table.sql 2022-07-30 02:59:35 normalization > 02:57:27.675107 [debug] [MainThread]: Parsing macros/materializations/models/view/create_or_replace_view.sql 2022-07-30 02:59:35 normalization > 02:57:27.678216 [debug] [MainThread]: Parsing macros/materializations/models/view/create_view_as.sql 2022-07-30 02:59:35 normalization > 02:57:27.680856 [debug] [MainThread]: Parsing macros/materializations/models/view/helpers.sql 2022-07-30 02:59:35 normalization > 02:57:27.682320 [debug] [MainThread]: Parsing macros/materializations/models/view/view.sql 2022-07-30 02:59:35 normalization > 02:57:27.690658 [debug] [MainThread]: Parsing macros/materializations/seeds/helpers.sql 2022-07-30 02:59:35 normalization > 02:57:27.708883 [debug] [MainThread]: Parsing macros/materializations/seeds/seed.sql 2022-07-30 02:59:35 normalization > 02:57:27.715754 [debug] [MainThread]: Parsing macros/materializations/snapshots/helpers.sql 2022-07-30 02:59:35 normalization > 02:57:27.727910 [debug] [MainThread]: Parsing macros/materializations/snapshots/snapshot.sql 2022-07-30 02:59:35 normalization > 02:57:27.740477 [debug] [MainThread]: Parsing macros/materializations/snapshots/snapshot_merge.sql 2022-07-30 02:59:35 normalization > 02:57:27.742934 [debug] [MainThread]: Parsing macros/materializations/snapshots/strategies.sql 2022-07-30 02:59:35 normalization > 02:57:27.761582 [debug] [MainThread]: Parsing macros/materializations/tests/helpers.sql 2022-07-30 02:59:35 normalization > 02:57:27.763705 [debug] [MainThread]: Parsing macros/materializations/tests/test.sql 2022-07-30 02:59:35 normalization > 02:57:27.768539 [debug] [MainThread]: Parsing macros/materializations/tests/where_subquery.sql 2022-07-30 02:59:35 normalization > 02:57:27.770674 [debug] [MainThread]: Parsing tests/generic/builtin.sql 2022-07-30 02:59:35 normalization > 02:57:27.774482 [debug] [MainThread]: Parsing macros/cross_db_utils/_is_ephemeral.sql 2022-07-30 02:59:35 normalization > 02:57:27.777761 [debug] [MainThread]: Parsing macros/cross_db_utils/_is_relation.sql 2022-07-30 02:59:35 normalization > 02:57:27.779092 [debug] [MainThread]: Parsing macros/cross_db_utils/any_value.sql 2022-07-30 02:59:35 normalization > 02:57:27.780538 [debug] [MainThread]: Parsing macros/cross_db_utils/bool_or.sql 2022-07-30 02:59:35 normalization > 02:57:27.782286 [debug] [MainThread]: Parsing macros/cross_db_utils/cast_bool_to_text.sql 2022-07-30 02:59:35 normalization > 02:57:27.784014 [debug] [MainThread]: Parsing macros/cross_db_utils/concat.sql 2022-07-30 02:59:35 normalization > 02:57:27.785092 [debug] [MainThread]: Parsing macros/cross_db_utils/current_timestamp.sql 2022-07-30 02:59:35 normalization > 02:57:27.788792 [debug] [MainThread]: Parsing macros/cross_db_utils/datatypes.sql 2022-07-30 02:59:35 normalization > 02:57:27.795527 [debug] [MainThread]: Parsing macros/cross_db_utils/date_trunc.sql 2022-07-30 02:59:35 normalization > 02:57:27.797204 [debug] [MainThread]: Parsing macros/cross_db_utils/dateadd.sql 2022-07-30 02:59:35 normalization > 02:57:27.800304 [debug] [MainThread]: Parsing macros/cross_db_utils/datediff.sql 2022-07-30 02:59:35 normalization > 02:57:27.811191 [debug] [MainThread]: Parsing macros/cross_db_utils/escape_single_quotes.sql 2022-07-30 02:59:35 normalization > 02:57:27.813301 [debug] [MainThread]: Parsing macros/cross_db_utils/except.sql 2022-07-30 02:59:35 normalization > 02:57:27.814511 [debug] [MainThread]: Parsing macros/cross_db_utils/hash.sql 2022-07-30 02:59:35 normalization > 02:57:27.816073 [debug] [MainThread]: Parsing macros/cross_db_utils/identifier.sql 2022-07-30 02:59:35 normalization > 02:57:27.817845 [debug] [MainThread]: Parsing macros/cross_db_utils/intersect.sql 2022-07-30 02:59:35 normalization > 02:57:27.818993 [debug] [MainThread]: Parsing macros/cross_db_utils/last_day.sql 2022-07-30 02:59:35 normalization > 02:57:27.822960 [debug] [MainThread]: Parsing macros/cross_db_utils/length.sql 2022-07-30 02:59:35 normalization > 02:57:27.824388 [debug] [MainThread]: Parsing macros/cross_db_utils/literal.sql 2022-07-30 02:59:35 normalization > 02:57:27.825416 [debug] [MainThread]: Parsing macros/cross_db_utils/position.sql 2022-07-30 02:59:35 normalization > 02:57:27.827072 [debug] [MainThread]: Parsing macros/cross_db_utils/replace.sql 2022-07-30 02:59:35 normalization > 02:57:27.828450 [debug] [MainThread]: Parsing macros/cross_db_utils/right.sql 2022-07-30 02:59:35 normalization > 02:57:27.830858 [debug] [MainThread]: Parsing macros/cross_db_utils/safe_cast.sql 2022-07-30 02:59:35 normalization > 02:57:27.833323 [debug] [MainThread]: Parsing macros/cross_db_utils/split_part.sql 2022-07-30 02:59:35 normalization > 02:57:27.835283 [debug] [MainThread]: Parsing macros/cross_db_utils/width_bucket.sql 2022-07-30 02:59:35 normalization > 02:57:27.840747 [debug] [MainThread]: Parsing macros/jinja_helpers/log_info.sql 2022-07-30 02:59:35 normalization > 02:57:27.841982 [debug] [MainThread]: Parsing macros/jinja_helpers/pretty_log_format.sql 2022-07-30 02:59:35 normalization > 02:57:27.843279 [debug] [MainThread]: Parsing macros/jinja_helpers/pretty_time.sql 2022-07-30 02:59:35 normalization > 02:57:27.844600 [debug] [MainThread]: Parsing macros/jinja_helpers/slugify.sql 2022-07-30 02:59:35 normalization > 02:57:27.845902 [debug] [MainThread]: Parsing macros/materializations/insert_by_period_materialization.sql 2022-07-30 02:59:35 normalization > 02:57:27.873342 [debug] [MainThread]: Parsing macros/schema_tests/accepted_range.sql 2022-07-30 02:59:35 normalization > 02:57:27.876261 [debug] [MainThread]: Parsing macros/schema_tests/at_least_one.sql 2022-07-30 02:59:35 normalization > 02:57:27.877734 [debug] [MainThread]: Parsing macros/schema_tests/cardinality_equality.sql 2022-07-30 02:59:35 normalization > 02:57:27.879970 [debug] [MainThread]: Parsing macros/schema_tests/equal_rowcount.sql 2022-07-30 02:59:35 normalization > 02:57:27.881810 [debug] [MainThread]: Parsing macros/schema_tests/equality.sql 2022-07-30 02:59:35 normalization > 02:57:27.885780 [debug] [MainThread]: Parsing macros/schema_tests/expression_is_true.sql 2022-07-30 02:59:35 normalization > 02:57:27.887817 [debug] [MainThread]: Parsing macros/schema_tests/fewer_rows_than.sql 2022-07-30 02:59:35 normalization > 02:57:27.889656 [debug] [MainThread]: Parsing macros/schema_tests/mutually_exclusive_ranges.sql 2022-07-30 02:59:35 normalization > 02:57:27.900080 [debug] [MainThread]: Parsing macros/schema_tests/not_accepted_values.sql 2022-07-30 02:59:35 normalization > 02:57:27.902723 [debug] [MainThread]: Parsing macros/schema_tests/not_constant.sql 2022-07-30 02:59:35 normalization > 02:57:27.904246 [debug] [MainThread]: Parsing macros/schema_tests/not_null_proportion.sql 2022-07-30 02:59:35 normalization > 02:57:27.906993 [debug] [MainThread]: Parsing macros/schema_tests/recency.sql 2022-07-30 02:59:35 normalization > 02:57:27.908967 [debug] [MainThread]: Parsing macros/schema_tests/relationships_where.sql 2022-07-30 02:59:35 normalization > 02:57:27.911360 [debug] [MainThread]: Parsing macros/schema_tests/sequential_values.sql 2022-07-30 02:59:35 normalization > 02:57:27.914488 [debug] [MainThread]: Parsing macros/schema_tests/test_not_null_where.sql 2022-07-30 02:59:35 normalization > 02:57:27.916124 [debug] [MainThread]: Parsing macros/schema_tests/test_unique_where.sql 2022-07-30 02:59:35 normalization > 02:57:27.917675 [debug] [MainThread]: Parsing macros/schema_tests/unique_combination_of_columns.sql 2022-07-30 02:59:35 normalization > 02:57:27.920927 [debug] [MainThread]: Parsing macros/sql/date_spine.sql 2022-07-30 02:59:35 normalization > 02:57:27.925432 [debug] [MainThread]: Parsing macros/sql/generate_series.sql 2022-07-30 02:59:35 normalization > 02:57:27.930102 [debug] [MainThread]: Parsing macros/sql/get_column_values.sql 2022-07-30 02:59:35 normalization > 02:57:27.935712 [debug] [MainThread]: Parsing macros/sql/get_query_results_as_dict.sql 2022-07-30 02:59:35 normalization > 02:57:27.938309 [debug] [MainThread]: Parsing macros/sql/get_relations_by_pattern.sql 2022-07-30 02:59:35 normalization > 02:57:27.942022 [debug] [MainThread]: Parsing macros/sql/get_relations_by_prefix.sql 2022-07-30 02:59:35 normalization > 02:57:27.946089 [debug] [MainThread]: Parsing macros/sql/get_table_types_sql.sql 2022-07-30 02:59:35 normalization > 02:57:27.948361 [debug] [MainThread]: Parsing macros/sql/get_tables_by_pattern_sql.sql 2022-07-30 02:59:35 normalization > 02:57:27.955193 [debug] [MainThread]: Parsing macros/sql/get_tables_by_prefix_sql.sql 2022-07-30 02:59:35 normalization > 02:57:27.957185 [debug] [MainThread]: Parsing macros/sql/groupby.sql 2022-07-30 02:59:35 normalization > 02:57:27.958703 [debug] [MainThread]: Parsing macros/sql/haversine_distance.sql 2022-07-30 02:59:35 normalization > 02:57:27.965147 [debug] [MainThread]: Parsing macros/sql/nullcheck.sql 2022-07-30 02:59:35 normalization > 02:57:27.967049 [debug] [MainThread]: Parsing macros/sql/nullcheck_table.sql 2022-07-30 02:59:35 normalization > 02:57:27.968889 [debug] [MainThread]: Parsing macros/sql/pivot.sql 2022-07-30 02:59:35 normalization > 02:57:27.973365 [debug] [MainThread]: Parsing macros/sql/safe_add.sql 2022-07-30 02:59:35 normalization > 02:57:27.975244 [debug] [MainThread]: Parsing macros/sql/star.sql 2022-07-30 02:59:35 normalization > 02:57:27.979919 [debug] [MainThread]: Parsing macros/sql/surrogate_key.sql 2022-07-30 02:59:35 normalization > 02:57:27.983715 [debug] [MainThread]: Parsing macros/sql/union.sql 2022-07-30 02:59:35 normalization > 02:57:27.995768 [debug] [MainThread]: Parsing macros/sql/unpivot.sql 2022-07-30 02:59:35 normalization > 02:57:28.005592 [debug] [MainThread]: Parsing macros/web/get_url_host.sql 2022-07-30 02:59:35 normalization > 02:57:28.007965 [debug] [MainThread]: Parsing macros/web/get_url_parameter.sql 2022-07-30 02:59:35 normalization > 02:57:28.009752 [debug] [MainThread]: Parsing macros/web/get_url_path.sql 2022-07-30 02:59:35 normalization > 02:57:28.478374 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/active_storage_attachments_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:28.582139 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/active_storage_attachments_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:28.583884 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/active_storage_attachments_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:28.603457 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/active_storage_attachments_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:28.605131 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/active_storage_blobs_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:28.622503 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/active_storage_blobs_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:28.624239 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/active_storage_blobs_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:28.637237 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/active_storage_blobs_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:28.638873 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/active_storage_variant_records_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:28.652700 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/active_storage_variant_records_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:28.654329 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/active_storage_variant_records_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:28.664880 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/active_storage_variant_records_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:28.666500 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/ar_internal_metadata_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:28.679836 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/ar_internal_metadata_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:28.681437 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/ar_internal_metadata_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:28.692685 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/ar_internal_metadata_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:28.694393 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/buyer_contact_rules_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:28.712326 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/buyer_contact_rules_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:28.714080 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/buyer_contact_rules_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:28.727130 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/buyer_contact_rules_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:28.730485 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/buyer_contacts_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:28.746407 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/buyer_contacts_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:28.748177 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/buyer_contacts_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:28.761084 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/buyer_contacts_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:28.763167 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/buyer_locations_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:28.787125 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/buyer_locations_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:28.788897 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/buyer_locations_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:28.803989 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/buyer_locations_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:28.806007 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/buyer_public_informations_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:28.823253 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/buyer_public_informations_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:28.824992 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/buyer_public_informations_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:28.838387 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/buyer_public_informations_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:28.840149 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/buyer_store_recommendations_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:28.859215 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/buyer_store_recommendations_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:28.860933 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/buyer_store_recommendations_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:28.874925 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/buyer_store_recommendations_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:28.876637 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/buyer_uploads_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:28.892125 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/buyer_uploads_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:28.893774 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/buyer_uploads_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:28.908052 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/buyer_uploads_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:28.909978 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/buyer_users_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:28.938326 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/buyer_users_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:28.940200 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/buyer_users_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:28.960109 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/buyer_users_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:28.962156 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/buyers_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:28.996262 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/buyers_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:28.998166 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/buyers_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.021997 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/buyers_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.023703 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/categories_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.039279 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/categories_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.041000 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/categories_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.053682 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/categories_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.055282 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/changebase_metadata_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.068060 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/changebase_metadata_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.069627 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/changebase_metadata_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.079651 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/changebase_metadata_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.081280 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/faq_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.096274 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/faq_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.098027 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/faq_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.110103 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/faq_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.112377 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/faq_categories_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.126920 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/faq_categories_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.128551 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/faq_categories_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.139561 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/faq_categories_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.141235 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/flipper_features_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.154968 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/flipper_features_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.156798 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/flipper_features_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.167979 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/flipper_features_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.169943 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/flipper_gates_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.186215 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/flipper_gates_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.187952 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/flipper_gates_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.199772 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/flipper_gates_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.201426 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/freight_partner_vehicles_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.218521 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/freight_partner_vehicles_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.220292 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/freight_partner_vehicles_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.233703 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/freight_partner_vehicles_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.235479 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/freight_partners_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.258634 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/freight_partners_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.260400 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/freight_partners_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.276317 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/freight_partners_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.277982 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/freight_product_orders_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.293629 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/freight_product_orders_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.295360 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/freight_product_orders_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.307536 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/freight_product_orders_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.309469 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/freight_route_groupings_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.325686 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/freight_route_groupings_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.327348 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/freight_route_groupings_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.339335 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/freight_route_groupings_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.341059 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/freight_route_partner_costs_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.360330 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/freight_route_partner_costs_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.362033 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/freight_route_partner_costs_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.376948 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/freight_route_partner_costs_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.378846 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/freight_routes_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.405980 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/freight_routes_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.407883 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/freight_routes_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.426819 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/freight_routes_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.428583 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/freight_vehicle_types_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.445902 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/freight_vehicle_types_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.447624 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/freight_vehicle_types_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.461832 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/freight_vehicle_types_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.463704 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/freights_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.492277 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/freights_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.494110 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/freights_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.516217 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/freights_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.517875 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/heya_campaign_memberships_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.536025 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/heya_campaign_memberships_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.537710 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/heya_campaign_memberships_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.551528 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/heya_campaign_memberships_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.553151 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/heya_campaign_receipts_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.569476 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/heya_campaign_receipts_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.571145 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/heya_campaign_receipts_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.583850 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/heya_campaign_receipts_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.585460 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/location_store_products_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.603069 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/location_store_products_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.604755 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/location_store_products_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.617437 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/location_store_products_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.619044 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/memento_sessions_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.632298 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/memento_sessions_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.633876 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/memento_sessions_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.644827 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/memento_sessions_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.646494 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/memento_states_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.662679 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/memento_states_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.666136 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/memento_states_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.678742 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/memento_states_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.680400 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/oico_radar_products_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.696666 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/oico_radar_products_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.698314 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/oico_radar_products_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.710443 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/oico_radar_products_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.712133 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/oico_radars_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.730377 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/oico_radars_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.732098 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/oico_radars_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.747447 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/oico_radars_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.749126 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/oico_users_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.766455 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/oico_users_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.768197 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/oico_users_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.782212 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/oico_users_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.783921 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/omie_accounts_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.798716 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/omie_accounts_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.800376 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/omie_accounts_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.813440 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/omie_accounts_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.815391 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/order_categories_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.829454 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/order_categories_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.831089 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/order_categories_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.842528 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/order_categories_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.844209 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/order_feedbacks_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.858985 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/order_feedbacks_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.860634 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/order_feedbacks_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.874012 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/order_feedbacks_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.875738 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/order_issues_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.895025 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/order_issues_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.897207 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/order_issues_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.912048 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/order_issues_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:29.914317 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/orders_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.969672 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/orders_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:29.971894 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/orders_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.005826 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/orders_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.007550 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/payer_buyer_locations_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.088077 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/payer_buyer_locations_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.089806 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/payer_buyer_locations_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.102140 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/payer_buyer_locations_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.104111 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/payers_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.140517 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/payers_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.142590 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/payers_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.166907 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/payers_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.168758 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/payment_installments_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.194543 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/payment_installments_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.196819 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/payment_installments_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.215757 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/payment_installments_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.217637 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/payments_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.248469 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/payments_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.250359 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/payments_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.271302 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/payments_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.272955 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/popular_searches_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.286330 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/popular_searches_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.287970 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/popular_searches_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.299069 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/popular_searches_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.300696 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/product_canonical_categories_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.315801 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/product_canonical_categories_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.317409 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/product_canonical_categories_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.329518 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/product_canonical_categories_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.331263 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/product_canonicals_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.353527 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/product_canonicals_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.355295 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/product_canonicals_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.371220 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/product_canonicals_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.373141 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/product_orders_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.405310 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/product_orders_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.407163 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/product_orders_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.427454 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/product_orders_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.429095 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/product_reports_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.445348 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/product_reports_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.447479 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/product_reports_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.460963 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/product_reports_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.462846 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/products_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.497535 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/products_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.499533 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/products_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.522424 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/products_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.524100 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/reports_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.540095 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/reports_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.541748 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/reports_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.553958 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/reports_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.555766 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/requested_products_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.577764 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/requested_products_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.579521 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/requested_products_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.596523 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/requested_products_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.598308 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/responsible_deliveries_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.614667 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/responsible_deliveries_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.616394 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/responsible_deliveries_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.629386 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/responsible_deliveries_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.630996 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/roi_products_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.643276 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/roi_products_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.645302 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/roi_products_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.655278 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/roi_products_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.656907 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/schema_migrations_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.669296 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/schema_migrations_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.670884 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/schema_migrations_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.680185 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/schema_migrations_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.681863 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/shortened_urls_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.700200 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/shortened_urls_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.701871 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/shortened_urls_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.715680 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/shortened_urls_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.717307 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/sidekiq_sequence_records_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.734046 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/sidekiq_sequence_records_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.735725 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/sidekiq_sequence_records_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.748445 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/sidekiq_sequence_records_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.750058 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/spatial_ref_sys_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.764520 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/spatial_ref_sys_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.766133 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/spatial_ref_sys_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.776959 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/spatial_ref_sys_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.778625 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/stockout_events_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.795477 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/stockout_events_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.797544 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/stockout_events_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.809693 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/stockout_events_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.811335 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/store_categories_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.825389 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/store_categories_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.827019 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/store_categories_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.838667 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/store_categories_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.840475 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/store_locations_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.864114 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/store_locations_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.865929 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/store_locations_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.882661 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/store_locations_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.884344 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/store_order_quotes_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.900724 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/store_order_quotes_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.902413 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/store_order_quotes_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.915703 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/store_order_quotes_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.917296 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/store_orders_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.933669 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/store_orders_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.935322 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/store_orders_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.947669 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/store_orders_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.949371 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/store_users_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.969970 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/store_users_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:30.972144 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/store_users_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.987680 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/store_users_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:30.989607 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/stores_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:31.025561 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/stores_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:31.027571 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/stores_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:31.050012 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/stores_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:31.051694 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/term_acceptances_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:31.066615 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/term_acceptances_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:31.068334 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/term_acceptances_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:31.081446 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/term_acceptances_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:31.083134 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/terms_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:31.099277 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/terms_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:31.101009 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/terms_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:31.113322 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/terms_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:31.114954 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/transfeera_batches_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:31.129673 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/transfeera_batches_ab1.sql 2022-07-30 02:59:35 normalization > 02:57:31.131303 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_cdc/transfeera_batches_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:31.143973 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_cdc/transfeera_batches_ab2.sql 2022-07-30 02:59:35 normalization > 02:57:31.145525 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/active_storage_attachments_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.171566 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/active_storage_attachments_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.173122 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/active_storage_blobs_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.184726 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/active_storage_blobs_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.186281 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/active_storage_variant_records_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.196073 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/active_storage_variant_records_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.197891 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/ar_internal_metadata_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.209093 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/ar_internal_metadata_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.210649 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/buyer_contact_rules_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.221945 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/buyer_contact_rules_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.223851 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/buyer_contacts_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.235190 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/buyer_contacts_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.236802 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/buyer_locations_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.249697 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/buyer_locations_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.251256 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/buyer_public_informations_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.263163 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/buyer_public_informations_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.264779 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/buyer_store_recommendations_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.278403 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/buyer_store_recommendations_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.279997 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/buyer_uploads_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.293598 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/buyer_uploads_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.295216 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/buyer_users_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.310148 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/buyer_users_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.311818 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/buyers_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.329520 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/buyers_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.331121 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/categories_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.344145 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/categories_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.345691 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/changebase_metadata_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.355564 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/changebase_metadata_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.357150 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/faq_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.368489 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/faq_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.370041 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/faq_categories_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.380319 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/faq_categories_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.381849 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/flipper_features_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.393578 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/flipper_features_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.395149 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/flipper_gates_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.406099 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/flipper_gates_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.408160 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/freight_partner_vehicles_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.419522 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/freight_partner_vehicles_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.421117 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/freight_partners_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.436034 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/freight_partners_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.437584 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/freight_product_orders_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.448866 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/freight_product_orders_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.450431 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/freight_route_groupings_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.462372 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/freight_route_groupings_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.464352 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/freight_route_partner_costs_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.476962 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/freight_route_partner_costs_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.478950 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/freight_routes_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.493718 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/freight_routes_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.495352 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/freight_vehicle_types_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.506912 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/freight_vehicle_types_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.508866 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/freights_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.527127 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/freights_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.528743 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/heya_campaign_memberships_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.540746 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/heya_campaign_memberships_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.542327 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/heya_campaign_receipts_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.553865 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/heya_campaign_receipts_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.555494 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/location_store_products_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.566966 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/location_store_products_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.568768 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/memento_sessions_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.580339 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/memento_sessions_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.581881 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/memento_states_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.659674 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/memento_states_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.661185 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/oico_radar_products_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.672129 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/oico_radar_products_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.673730 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/oico_radars_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.686469 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/oico_radars_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.688036 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/oico_users_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.700197 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/oico_users_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.701757 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/omie_accounts_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.713436 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/omie_accounts_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.715077 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/order_categories_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.725780 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/order_categories_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.727675 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/order_feedbacks_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.738676 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/order_feedbacks_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.740293 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/order_issues_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.752869 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/order_issues_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.754574 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/orders_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.781465 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/orders_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.783044 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/payer_buyer_locations_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.794119 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/payer_buyer_locations_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.795802 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/payers_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.815047 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/payers_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.816637 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/payment_installments_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.831321 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/payment_installments_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.833377 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/payments_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.850127 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/payments_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.851694 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/popular_searches_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.861802 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/popular_searches_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.863398 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/product_canonical_categories_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.874050 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/product_canonical_categories_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.875693 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/product_canonicals_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.889095 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/product_canonicals_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.890744 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/product_orders_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.910647 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/product_orders_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.912239 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/product_reports_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.923810 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/product_reports_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.925445 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/products_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.944710 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/products_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.946281 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/reports_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.957710 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/reports_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.959279 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/requested_products_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.974717 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/requested_products_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.976318 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/responsible_deliveries_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.987493 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/responsible_deliveries_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.989035 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/roi_products_stg.sql 2022-07-30 02:59:35 normalization > 02:57:31.999183 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/roi_products_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.000822 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/schema_migrations_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.010247 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/schema_migrations_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.011855 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/shortened_urls_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.023800 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/shortened_urls_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.025348 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/sidekiq_sequence_records_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.037535 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/sidekiq_sequence_records_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.039115 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/spatial_ref_sys_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.049783 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/spatial_ref_sys_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.051344 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/stockout_events_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.062670 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/stockout_events_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.064232 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/store_categories_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.074835 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/store_categories_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.076858 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/store_locations_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.091597 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/store_locations_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.093203 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/store_order_quotes_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.104410 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/store_order_quotes_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.105945 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/store_orders_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.116979 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/store_orders_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.118574 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/store_users_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.131711 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/store_users_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.133339 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/stores_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.153834 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/stores_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.155476 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/term_acceptances_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.167087 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/term_acceptances_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.168876 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/terms_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.180894 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/terms_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.182487 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/airbyte_cdc/transfeera_batches_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.192936 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/airbyte_cdc/transfeera_batches_stg.sql 2022-07-30 02:59:35 normalization > 02:57:32.194973 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/active_storage_attachments_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.219593 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/active_storage_attachments_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.221720 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/active_storage_blobs_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.244422 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/active_storage_blobs_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.246550 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/active_storage_variant_records_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.269265 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/active_storage_variant_records_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.271351 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/ar_internal_metadata_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.293468 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/ar_internal_metadata_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.295615 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/buyer_contact_rules_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.319862 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/buyer_contact_rules_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.321965 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/buyer_contacts_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.345426 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/buyer_contacts_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.347621 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/buyer_locations_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.370659 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/buyer_locations_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.373045 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/buyer_public_informations_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.397426 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/buyer_public_informations_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.399568 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/buyer_store_recommendations_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.424354 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/buyer_store_recommendations_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.426575 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/buyer_uploads_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.449342 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/buyer_uploads_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.451561 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/buyer_users_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.474576 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/buyer_users_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.476735 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/buyers_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.500122 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/buyers_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.502269 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/categories_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.526498 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/categories_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.528625 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/changebase_metadata_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.552279 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/changebase_metadata_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.554390 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/faq_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.577805 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/faq_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.579929 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/faq_categories_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.602476 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/faq_categories_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.604677 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/flipper_features_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.629705 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/flipper_features_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.631867 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/flipper_gates_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.654679 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/flipper_gates_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.656799 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/freight_partner_vehicles_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.679321 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/freight_partner_vehicles_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.681492 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/freight_partners_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.704305 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/freight_partners_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.706411 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/freight_product_orders_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.730561 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/freight_product_orders_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.732715 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/freight_route_groupings_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.756005 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/freight_route_groupings_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.758087 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/freight_route_partner_costs_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.781702 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/freight_route_partner_costs_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.783868 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/freight_routes_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.807483 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/freight_routes_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.809627 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/freight_vehicle_types_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.833775 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/freight_vehicle_types_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.835930 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/freights_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.858855 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/freights_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.860966 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/heya_campaign_memberships_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.883574 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/heya_campaign_memberships_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.885901 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/heya_campaign_receipts_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.908571 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/heya_campaign_receipts_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.910667 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/location_store_products_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.935923 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/location_store_products_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.938002 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/memento_sessions_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.960811 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/memento_sessions_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.962913 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/memento_states_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.985968 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/memento_states_scd.sql 2022-07-30 02:59:35 normalization > 02:57:32.988098 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/oico_radar_products_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.011098 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/oico_radar_products_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.013250 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/oico_radars_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.038172 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/oico_radars_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.040325 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/oico_users_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.063182 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/oico_users_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.065459 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/omie_accounts_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.088131 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/omie_accounts_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.090237 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/order_categories_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.113016 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/order_categories_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.115121 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/order_feedbacks_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.139878 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/order_feedbacks_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.141983 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/order_issues_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.165157 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/order_issues_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.167318 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/orders_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.190763 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/orders_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.192937 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/payer_buyer_locations_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.215747 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/payer_buyer_locations_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.217854 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/payers_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.242457 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/payers_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.244557 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/payment_installments_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.266653 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/payment_installments_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.268751 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/payments_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.291053 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/payments_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.293205 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/popular_searches_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.315993 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/popular_searches_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.318099 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/product_canonical_categories_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.343184 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/product_canonical_categories_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.345313 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/product_canonicals_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.439341 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/product_canonicals_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.441473 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/product_orders_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.464318 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/product_orders_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.466430 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/product_reports_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.489299 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/product_reports_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.491436 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/products_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.516283 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/products_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.518412 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/reports_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.542759 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/reports_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.545042 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/requested_products_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.568025 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/requested_products_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.570105 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/responsible_deliveries_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.593795 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/responsible_deliveries_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.595921 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/roi_products_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.621672 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/roi_products_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.623777 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/schema_migrations_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.645728 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/schema_migrations_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.648560 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/shortened_urls_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.671318 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/shortened_urls_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.673458 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/sidekiq_sequence_records_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.696767 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/sidekiq_sequence_records_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.698904 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/spatial_ref_sys_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.723207 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/spatial_ref_sys_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.725355 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/stockout_events_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.748676 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/stockout_events_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.750811 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/store_categories_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.773417 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/store_categories_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.775556 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/store_locations_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.799947 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/store_locations_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.802041 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/store_order_quotes_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.826982 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/store_order_quotes_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.829157 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/store_orders_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.852181 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/store_orders_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.854360 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/store_users_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.877164 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/store_users_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.879312 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/stores_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.903091 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/stores_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.905252 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/term_acceptances_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.930419 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/term_acceptances_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.932616 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/terms_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.956272 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/terms_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.958403 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/airbyte_cdc/transfeera_batches_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.981593 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/airbyte_cdc/transfeera_batches_scd.sql 2022-07-30 02:59:35 normalization > 02:57:33.983221 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/active_storage_attachments.sql 2022-07-30 02:59:35 normalization > 02:57:33.991620 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/active_storage_attachments.sql 2022-07-30 02:59:35 normalization > 02:57:33.993144 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/active_storage_blobs.sql 2022-07-30 02:59:35 normalization > 02:57:34.003098 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/active_storage_blobs.sql 2022-07-30 02:59:35 normalization > 02:57:34.005072 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/active_storage_variant_records.sql 2022-07-30 02:59:35 normalization > 02:57:34.015197 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/active_storage_variant_records.sql 2022-07-30 02:59:35 normalization > 02:57:34.016767 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/ar_internal_metadata.sql 2022-07-30 02:59:35 normalization > 02:57:34.026042 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/ar_internal_metadata.sql 2022-07-30 02:59:35 normalization > 02:57:34.027914 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/buyer_contact_rules.sql 2022-07-30 02:59:35 normalization > 02:57:34.036857 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/buyer_contact_rules.sql 2022-07-30 02:59:35 normalization > 02:57:34.038384 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/buyer_contacts.sql 2022-07-30 02:59:35 normalization > 02:57:34.047896 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/buyer_contacts.sql 2022-07-30 02:59:35 normalization > 02:57:34.049447 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/buyer_locations.sql 2022-07-30 02:59:35 normalization > 02:57:34.059092 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/buyer_locations.sql 2022-07-30 02:59:35 normalization > 02:57:34.060678 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/buyer_public_informations.sql 2022-07-30 02:59:35 normalization > 02:57:34.068701 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/buyer_public_informations.sql 2022-07-30 02:59:35 normalization > 02:57:34.070207 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/buyer_store_recommendations.sql 2022-07-30 02:59:35 normalization > 02:57:34.079876 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/buyer_store_recommendations.sql 2022-07-30 02:59:35 normalization > 02:57:34.081628 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/buyer_uploads.sql 2022-07-30 02:59:35 normalization > 02:57:34.089652 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/buyer_uploads.sql 2022-07-30 02:59:35 normalization > 02:57:34.091254 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/buyer_users.sql 2022-07-30 02:59:35 normalization > 02:57:34.099440 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/buyer_users.sql 2022-07-30 02:59:35 normalization > 02:57:34.101095 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/buyers.sql 2022-07-30 02:59:35 normalization > 02:57:34.109263 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/buyers.sql 2022-07-30 02:59:35 normalization > 02:57:34.110792 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/categories.sql 2022-07-30 02:59:35 normalization > 02:57:34.118704 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/categories.sql 2022-07-30 02:59:35 normalization > 02:57:34.120278 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/changebase_metadata.sql 2022-07-30 02:59:35 normalization > 02:57:34.130433 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/changebase_metadata.sql 2022-07-30 02:59:35 normalization > 02:57:34.132008 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/faq.sql 2022-07-30 02:59:35 normalization > 02:57:34.139989 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/faq.sql 2022-07-30 02:59:35 normalization > 02:57:34.142139 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/faq_categories.sql 2022-07-30 02:59:35 normalization > 02:57:34.150115 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/faq_categories.sql 2022-07-30 02:59:35 normalization > 02:57:34.151701 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/flipper_features.sql 2022-07-30 02:59:35 normalization > 02:57:34.159687 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/flipper_features.sql 2022-07-30 02:59:35 normalization > 02:57:34.161185 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/flipper_gates.sql 2022-07-30 02:59:35 normalization > 02:57:34.168990 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/flipper_gates.sql 2022-07-30 02:59:35 normalization > 02:57:34.170496 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/freight_partner_vehicles.sql 2022-07-30 02:59:35 normalization > 02:57:34.178299 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/freight_partner_vehicles.sql 2022-07-30 02:59:35 normalization > 02:57:34.179810 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/freight_partners.sql 2022-07-30 02:59:35 normalization > 02:57:34.189673 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/freight_partners.sql 2022-07-30 02:59:35 normalization > 02:57:34.191427 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/freight_product_orders.sql 2022-07-30 02:59:35 normalization > 02:57:34.199079 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/freight_product_orders.sql 2022-07-30 02:59:35 normalization > 02:57:34.200554 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/freight_route_groupings.sql 2022-07-30 02:59:35 normalization > 02:57:34.208552 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/freight_route_groupings.sql 2022-07-30 02:59:35 normalization > 02:57:34.210072 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/freight_route_partner_costs.sql 2022-07-30 02:59:35 normalization > 02:57:34.218091 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/freight_route_partner_costs.sql 2022-07-30 02:59:35 normalization > 02:57:34.219659 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/freight_routes.sql 2022-07-30 02:59:35 normalization > 02:57:34.227640 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/freight_routes.sql 2022-07-30 02:59:35 normalization > 02:57:34.229142 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/freight_vehicle_types.sql 2022-07-30 02:59:35 normalization > 02:57:34.239517 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/freight_vehicle_types.sql 2022-07-30 02:59:35 normalization > 02:57:34.241039 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/freights.sql 2022-07-30 02:59:35 normalization > 02:57:34.249268 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/freights.sql 2022-07-30 02:59:35 normalization > 02:57:34.251074 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/heya_campaign_memberships.sql 2022-07-30 02:59:35 normalization > 02:57:34.259106 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/heya_campaign_memberships.sql 2022-07-30 02:59:35 normalization > 02:57:34.260682 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/heya_campaign_receipts.sql 2022-07-30 02:59:35 normalization > 02:57:34.268687 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/heya_campaign_receipts.sql 2022-07-30 02:59:35 normalization > 02:57:34.270182 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/location_store_products.sql 2022-07-30 02:59:35 normalization > 02:57:34.278007 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/location_store_products.sql 2022-07-30 02:59:35 normalization > 02:57:34.279535 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/memento_sessions.sql 2022-07-30 02:59:35 normalization > 02:57:34.287279 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/memento_sessions.sql 2022-07-30 02:59:35 normalization > 02:57:34.288810 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/memento_states.sql 2022-07-30 02:59:35 normalization > 02:57:34.298698 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/memento_states.sql 2022-07-30 02:59:35 normalization > 02:57:34.300495 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/oico_radar_products.sql 2022-07-30 02:59:35 normalization > 02:57:34.308402 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/oico_radar_products.sql 2022-07-30 02:59:35 normalization > 02:57:34.310039 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/oico_radars.sql 2022-07-30 02:59:35 normalization > 02:57:34.318649 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/oico_radars.sql 2022-07-30 02:59:35 normalization > 02:57:34.320203 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/oico_users.sql 2022-07-30 02:59:35 normalization > 02:57:34.328171 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/oico_users.sql 2022-07-30 02:59:35 normalization > 02:57:34.329696 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/omie_accounts.sql 2022-07-30 02:59:35 normalization > 02:57:34.337629 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/omie_accounts.sql 2022-07-30 02:59:35 normalization > 02:57:34.339159 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/order_categories.sql 2022-07-30 02:59:35 normalization > 02:57:34.349177 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/order_categories.sql 2022-07-30 02:59:35 normalization > 02:57:34.350719 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/order_feedbacks.sql 2022-07-30 02:59:35 normalization > 02:57:34.358909 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/order_feedbacks.sql 2022-07-30 02:59:35 normalization > 02:57:34.360751 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/order_issues.sql 2022-07-30 02:59:35 normalization > 02:57:34.368859 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/order_issues.sql 2022-07-30 02:59:35 normalization > 02:57:34.370363 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/orders.sql 2022-07-30 02:59:35 normalization > 02:57:34.378485 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/orders.sql 2022-07-30 02:59:35 normalization > 02:57:34.380045 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/payer_buyer_locations.sql 2022-07-30 02:59:35 normalization > 02:57:34.388249 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/payer_buyer_locations.sql 2022-07-30 02:59:35 normalization > 02:57:34.389756 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/payers.sql 2022-07-30 02:59:35 normalization > 02:57:34.397638 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/payers.sql 2022-07-30 02:59:35 normalization > 02:57:34.399130 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/payment_installments.sql 2022-07-30 02:59:35 normalization > 02:57:34.408710 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/payment_installments.sql 2022-07-30 02:59:35 normalization > 02:57:34.410471 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/payments.sql 2022-07-30 02:59:35 normalization > 02:57:34.418208 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/payments.sql 2022-07-30 02:59:35 normalization > 02:57:34.419743 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/popular_searches.sql 2022-07-30 02:59:35 normalization > 02:57:34.427873 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/popular_searches.sql 2022-07-30 02:59:35 normalization > 02:57:34.429389 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/product_canonical_categories.sql 2022-07-30 02:59:35 normalization > 02:57:34.437328 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/product_canonical_categories.sql 2022-07-30 02:59:35 normalization > 02:57:34.438873 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/product_canonicals.sql 2022-07-30 02:59:35 normalization > 02:57:34.446817 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/product_canonicals.sql 2022-07-30 02:59:35 normalization > 02:57:34.448350 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/product_orders.sql 2022-07-30 02:59:35 normalization > 02:57:34.457821 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/product_orders.sql 2022-07-30 02:59:35 normalization > 02:57:34.459340 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/product_reports.sql 2022-07-30 02:59:35 normalization > 02:57:34.467190 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/product_reports.sql 2022-07-30 02:59:35 normalization > 02:57:34.468975 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/products.sql 2022-07-30 02:59:35 normalization > 02:57:34.476911 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/products.sql 2022-07-30 02:59:35 normalization > 02:57:34.478417 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/reports.sql 2022-07-30 02:59:35 normalization > 02:57:34.486232 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/reports.sql 2022-07-30 02:59:35 normalization > 02:57:34.487773 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/requested_products.sql 2022-07-30 02:59:35 normalization > 02:57:34.496139 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/requested_products.sql 2022-07-30 02:59:35 normalization > 02:57:34.497643 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/responsible_deliveries.sql 2022-07-30 02:59:35 normalization > 02:57:34.505511 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/responsible_deliveries.sql 2022-07-30 02:59:35 normalization > 02:57:34.507021 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/roi_products.sql 2022-07-30 02:59:35 normalization > 02:57:34.516544 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/roi_products.sql 2022-07-30 02:59:35 normalization > 02:57:34.518272 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/schema_migrations.sql 2022-07-30 02:59:35 normalization > 02:57:34.526087 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/schema_migrations.sql 2022-07-30 02:59:35 normalization > 02:57:34.527617 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/shortened_urls.sql 2022-07-30 02:59:35 normalization > 02:57:34.535583 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/shortened_urls.sql 2022-07-30 02:59:35 normalization > 02:57:34.537126 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/sidekiq_sequence_records.sql 2022-07-30 02:59:35 normalization > 02:57:34.545456 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/sidekiq_sequence_records.sql 2022-07-30 02:59:35 normalization > 02:57:34.546996 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/spatial_ref_sys.sql 2022-07-30 02:59:35 normalization > 02:57:34.555097 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/spatial_ref_sys.sql 2022-07-30 02:59:35 normalization > 02:57:34.556650 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/stockout_events.sql 2022-07-30 02:59:35 normalization > 02:57:34.565933 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/stockout_events.sql 2022-07-30 02:59:35 normalization > 02:57:34.567519 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/store_categories.sql 2022-07-30 02:59:35 normalization > 02:57:34.575563 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/store_categories.sql 2022-07-30 02:59:35 normalization > 02:57:34.577412 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/store_locations.sql 2022-07-30 02:59:35 normalization > 02:57:34.585535 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/store_locations.sql 2022-07-30 02:59:35 normalization > 02:57:34.587047 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/store_order_quotes.sql 2022-07-30 02:59:35 normalization > 02:57:34.594935 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/store_order_quotes.sql 2022-07-30 02:59:35 normalization > 02:57:34.596480 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/store_orders.sql 2022-07-30 02:59:35 normalization > 02:57:34.604308 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/store_orders.sql 2022-07-30 02:59:35 normalization > 02:57:34.605870 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/store_users.sql 2022-07-30 02:59:35 normalization > 02:57:34.613564 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/store_users.sql 2022-07-30 02:59:35 normalization > 02:57:34.615080 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/stores.sql 2022-07-30 02:59:35 normalization > 02:57:34.624612 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/stores.sql 2022-07-30 02:59:35 normalization > 02:57:34.626351 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/term_acceptances.sql 2022-07-30 02:59:35 normalization > 02:57:34.634214 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/term_acceptances.sql 2022-07-30 02:59:35 normalization > 02:57:34.635781 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/terms.sql 2022-07-30 02:59:35 normalization > 02:57:34.643917 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/terms.sql 2022-07-30 02:59:35 normalization > 02:57:34.645523 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_cdc/transfeera_batches.sql 2022-07-30 02:59:35 normalization > 02:57:34.654167 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_cdc/transfeera_batches.sql 2022-07-30 02:59:35 normalization > 02:57:34.885035 [warn ] [MainThread]: [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. 2022-07-30 02:59:35 normalization > There are 1 unused configuration paths: 2022-07-30 02:59:35 normalization > - models.airbyte_utils.generated.airbyte_tables 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:34.977985 [info ] [MainThread]: Found 335 models, 0 tests, 0 snapshots, 0 analyses, 554 macros, 0 operations, 0 seed files, 67 sources, 0 exposures, 0 metrics 2022-07-30 02:59:35 normalization > 02:57:34.997605 [info ] [MainThread]: 2022-07-30 02:59:35 normalization > 02:57:34.998972 [debug] [MainThread]: Acquiring new bigquery connection "master" 2022-07-30 02:59:35 normalization > 02:57:35.010872 [debug] [ThreadPool]: Acquiring new bigquery connection "list_dwcasa" 2022-07-30 02:59:35 normalization > 02:57:35.011871 [debug] [ThreadPool]: Acquiring new bigquery connection "list_dwcasa" 2022-07-30 02:59:35 normalization > 02:57:35.012125 [debug] [ThreadPool]: Opening a new connection, currently in state init 2022-07-30 02:59:35 normalization > 02:57:35.012443 [debug] [ThreadPool]: Opening a new connection, currently in state init 2022-07-30 02:59:35 normalization > 02:57:35.447002 [debug] [ThreadPool]: Acquiring new bigquery connection "create_dwcasa__airbyte_airbyte_cdc" 2022-07-30 02:59:35 normalization > 02:57:35.447691 [debug] [ThreadPool]: Acquiring new bigquery connection "create_dwcasa__airbyte_airbyte_cdc" 2022-07-30 02:59:35 normalization > 02:57:35.447883 [debug] [ThreadPool]: BigQuery adapter: Creating schema "dwcasa._airbyte_airbyte_cdc". 2022-07-30 02:59:35 normalization > 02:57:35.448000 [debug] [ThreadPool]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:35.944734 [debug] [ThreadPool]: Acquiring new bigquery connection "list_dwcasa_airbyte_cdc" 2022-07-30 02:59:35 normalization > 02:57:35.945629 [debug] [ThreadPool]: Acquiring new bigquery connection "list_dwcasa__airbyte_airbyte_cdc" 2022-07-30 02:59:35 normalization > 02:57:35.945897 [debug] [ThreadPool]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:35.946198 [debug] [ThreadPool]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:36.243317 [info ] [MainThread]: Concurrency: 8 threads (target='prod') 2022-07-30 02:59:35 normalization > 02:57:36.243873 [info ] [MainThread]: 2022-07-30 02:59:35 normalization > 02:57:36.268086 [debug] [Thread-1 ]: Began running node model.airbyte_utils.active_storage_attachments_ab1 2022-07-30 02:59:35 normalization > 02:57:36.268979 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.active_storage_attachments_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.269183 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.active_storage_attachments_ab1 2022-07-30 02:59:35 normalization > 02:57:36.269320 [debug] [Thread-1 ]: Compiling model.airbyte_utils.active_storage_attachments_ab1 2022-07-30 02:59:35 normalization > 02:57:36.271615 [debug] [Thread-2 ]: Began running node model.airbyte_utils.active_storage_blobs_ab1 2022-07-30 02:59:35 normalization > 02:57:36.272721 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.active_storage_blobs_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.272893 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.active_storage_blobs_ab1 2022-07-30 02:59:35 normalization > 02:57:36.273009 [debug] [Thread-2 ]: Compiling model.airbyte_utils.active_storage_blobs_ab1 2022-07-30 02:59:35 normalization > 02:57:36.271838 [debug] [Thread-3 ]: Began running node model.airbyte_utils.active_storage_variant_records_ab1 2022-07-30 02:59:35 normalization > 02:57:36.289420 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.active_storage_variant_records_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.289779 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.active_storage_variant_records_ab1 2022-07-30 02:59:35 normalization > 02:57:36.289907 [debug] [Thread-3 ]: Compiling model.airbyte_utils.active_storage_variant_records_ab1 2022-07-30 02:59:35 normalization > 02:57:36.305751 [debug] [Thread-4 ]: Began running node model.airbyte_utils.ar_internal_metadata_ab1 2022-07-30 02:59:35 normalization > 02:57:36.306733 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.ar_internal_metadata_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.306936 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.ar_internal_metadata_ab1 2022-07-30 02:59:35 normalization > 02:57:36.307150 [debug] [Thread-4 ]: Compiling model.airbyte_utils.ar_internal_metadata_ab1 2022-07-30 02:59:35 normalization > 02:57:36.312691 [debug] [Thread-5 ]: Began running node model.airbyte_utils.buyer_contact_rules_ab1 2022-07-30 02:59:35 normalization > 02:57:36.313574 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_contact_rules_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.313754 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.buyer_contact_rules_ab1 2022-07-30 02:59:35 normalization > 02:57:36.313872 [debug] [Thread-5 ]: Compiling model.airbyte_utils.buyer_contact_rules_ab1 2022-07-30 02:59:35 normalization > 02:57:36.331041 [debug] [Thread-6 ]: Began running node model.airbyte_utils.buyer_contacts_ab1 2022-07-30 02:59:35 normalization > 02:57:36.337341 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_contacts_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.337776 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.buyer_contacts_ab1 2022-07-30 02:59:35 normalization > 02:57:36.337926 [debug] [Thread-6 ]: Compiling model.airbyte_utils.buyer_contacts_ab1 2022-07-30 02:59:35 normalization > 02:57:36.350112 [debug] [Thread-7 ]: Began running node model.airbyte_utils.buyer_locations_ab1 2022-07-30 02:59:35 normalization > 02:57:36.376885 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_locations_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.377104 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.buyer_locations_ab1 2022-07-30 02:59:35 normalization > 02:57:36.377227 [debug] [Thread-7 ]: Compiling model.airbyte_utils.buyer_locations_ab1 2022-07-30 02:59:35 normalization > 02:57:36.375981 [debug] [Thread-8 ]: Began running node model.airbyte_utils.buyer_public_informations_ab1 2022-07-30 02:59:35 normalization > 02:57:36.464114 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_public_informations_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.468290 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.active_storage_attachments_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.370748 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.buyer_contact_rules_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.479014 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.active_storage_blobs_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.482254 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.active_storage_variant_records_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.490095 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.buyer_contacts_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.495922 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.buyer_public_informations_ab1 2022-07-30 02:59:35 normalization > 02:57:36.536854 [debug] [Thread-8 ]: Compiling model.airbyte_utils.buyer_public_informations_ab1 2022-07-30 02:59:35 normalization > 02:57:36.499047 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:36.499323 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:36.546665 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.buyer_contact_rules_ab1 2022-07-30 02:59:35 normalization > 02:57:36.546884 [debug] [Thread-5 ]: Began running node model.airbyte_utils.buyer_store_recommendations_ab1 2022-07-30 02:59:35 normalization > 02:57:36.536303 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.buyer_locations_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.497906 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.ar_internal_metadata_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.545872 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.active_storage_attachments_ab1 2022-07-30 02:59:35 normalization > 02:57:36.562915 [debug] [Thread-1 ]: Began running node model.airbyte_utils.buyer_uploads_ab1 2022-07-30 02:59:35 normalization > 02:57:36.571258 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_uploads_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.571626 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.buyer_uploads_ab1 2022-07-30 02:59:35 normalization > 02:57:36.571780 [debug] [Thread-1 ]: Compiling model.airbyte_utils.buyer_uploads_ab1 2022-07-30 02:59:35 normalization > 02:57:36.547911 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_store_recommendations_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.568835 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:36.570407 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.buyer_public_informations_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.596376 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:36.597072 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.buyer_public_informations_ab1 2022-07-30 02:59:35 normalization > 02:57:36.556587 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:36.598582 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.buyer_contacts_ab1 2022-07-30 02:59:35 normalization > 02:57:36.594271 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.buyer_store_recommendations_ab1 2022-07-30 02:59:35 normalization > 02:57:36.594722 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:36.596019 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.ar_internal_metadata_ab1 2022-07-30 02:59:35 normalization > 02:57:36.600602 [debug] [Thread-4 ]: Began running node model.airbyte_utils.categories_ab1 2022-07-30 02:59:35 normalization > 02:57:36.601100 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.categories_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.601236 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.categories_ab1 2022-07-30 02:59:35 normalization > 02:57:36.593954 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.buyer_uploads_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.598806 [debug] [Thread-6 ]: Began running node model.airbyte_utils.buyers_ab1 2022-07-30 02:59:35 normalization > 02:57:36.602583 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.buyers_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.600151 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.buyer_locations_ab1 2022-07-30 02:59:35 normalization > 02:57:36.601365 [debug] [Thread-4 ]: Compiling model.airbyte_utils.categories_ab1 2022-07-30 02:59:35 normalization > 02:57:36.513089 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:36.625125 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.active_storage_variant_records_ab1 2022-07-30 02:59:35 normalization > 02:57:36.597282 [debug] [Thread-8 ]: Began running node model.airbyte_utils.buyer_users_ab1 2022-07-30 02:59:35 normalization > 02:57:36.626646 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_users_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.626822 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.buyer_users_ab1 2022-07-30 02:59:35 normalization > 02:57:36.603064 [debug] [Thread-7 ]: Began running node model.airbyte_utils.changebase_metadata_ab1 2022-07-30 02:59:35 normalization > 02:57:36.603652 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:36.628594 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.buyer_uploads_ab1 2022-07-30 02:59:35 normalization > 02:57:36.625415 [debug] [Thread-3 ]: Began running node model.airbyte_utils.faq_ab1 2022-07-30 02:59:35 normalization > 02:57:36.629371 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.faq_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.629627 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.faq_ab1 2022-07-30 02:59:35 normalization > 02:57:36.629761 [debug] [Thread-3 ]: Compiling model.airbyte_utils.faq_ab1 2022-07-30 02:59:35 normalization > 02:57:36.602851 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.buyers_ab1 2022-07-30 02:59:35 normalization > 02:57:36.647634 [debug] [Thread-6 ]: Compiling model.airbyte_utils.buyers_ab1 2022-07-30 02:59:35 normalization > 02:57:36.624208 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.categories_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.518433 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:36.682212 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.active_storage_blobs_ab1 2022-07-30 02:59:35 normalization > 02:57:36.696356 [debug] [Thread-2 ]: Began running node model.airbyte_utils.flipper_features_ab1 2022-07-30 02:59:35 normalization > 02:57:36.628879 [debug] [Thread-1 ]: Began running node model.airbyte_utils.faq_categories_ab1 2022-07-30 02:59:35 normalization > 02:57:36.627851 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.changebase_metadata_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.650178 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.faq_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.599137 [debug] [Thread-5 ]: Compiling model.airbyte_utils.buyer_store_recommendations_ab1 2022-07-30 02:59:35 normalization > 02:57:36.695836 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.buyers_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.696157 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:36.725042 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.categories_ab1 2022-07-30 02:59:35 normalization > 02:57:36.725249 [debug] [Thread-4 ]: Began running node model.airbyte_utils.flipper_gates_ab1 2022-07-30 02:59:35 normalization > 02:57:36.698210 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.faq_categories_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.726100 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.faq_categories_ab1 2022-07-30 02:59:35 normalization > 02:57:36.723316 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:36.722975 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.buyer_store_recommendations_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.724174 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:36.627149 [debug] [Thread-8 ]: Compiling model.airbyte_utils.buyer_users_ab1 2022-07-30 02:59:35 normalization > 02:57:36.697119 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.flipper_features_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.738857 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.flipper_features_ab1 2022-07-30 02:59:35 normalization > 02:57:36.764709 [debug] [Thread-2 ]: Compiling model.airbyte_utils.flipper_features_ab1 2022-07-30 02:59:35 normalization > 02:57:36.698436 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.changebase_metadata_ab1 2022-07-30 02:59:35 normalization > 02:57:36.727335 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.faq_ab1 2022-07-30 02:59:35 normalization > 02:57:36.728173 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.buyers_ab1 2022-07-30 02:59:35 normalization > 02:57:36.782048 [debug] [Thread-6 ]: Began running node model.airbyte_utils.freight_partners_ab1 2022-07-30 02:59:35 normalization > 02:57:36.749773 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:36.764367 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.buyer_users_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.726250 [debug] [Thread-1 ]: Compiling model.airbyte_utils.faq_categories_ab1 2022-07-30 02:59:35 normalization > 02:57:36.780704 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.flipper_features_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.781019 [debug] [Thread-7 ]: Compiling model.airbyte_utils.changebase_metadata_ab1 2022-07-30 02:59:35 normalization > 02:57:36.781290 [debug] [Thread-3 ]: Began running node model.airbyte_utils.freight_partner_vehicles_ab1 2022-07-30 02:59:35 normalization > 02:57:36.814682 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_partner_vehicles_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.814896 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.freight_partner_vehicles_ab1 2022-07-30 02:59:35 normalization > 02:57:36.815022 [debug] [Thread-3 ]: Compiling model.airbyte_utils.freight_partner_vehicles_ab1 2022-07-30 02:59:35 normalization > 02:57:36.806823 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:36.808192 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.faq_categories_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.725923 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.flipper_gates_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.821416 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.flipper_gates_ab1 2022-07-30 02:59:35 normalization > 02:57:36.821736 [debug] [Thread-4 ]: Compiling model.airbyte_utils.flipper_gates_ab1 2022-07-30 02:59:35 normalization > 02:57:36.783193 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_partners_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.839012 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.freight_partners_ab1 2022-07-30 02:59:35 normalization > 02:57:36.821101 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.buyer_users_ab1 2022-07-30 02:59:35 normalization > 02:57:36.870906 [debug] [Thread-8 ]: Began running node model.airbyte_utils.freight_product_orders_ab1 2022-07-30 02:59:35 normalization > 02:57:36.784048 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.buyer_store_recommendations_ab1 2022-07-30 02:59:35 normalization > 02:57:36.872392 [debug] [Thread-5 ]: Began running node model.airbyte_utils.freight_route_groupings_ab1 2022-07-30 02:59:35 normalization > 02:57:36.850624 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.flipper_gates_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.850856 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:36.839391 [debug] [Thread-6 ]: Compiling model.airbyte_utils.freight_partners_ab1 2022-07-30 02:59:35 normalization > 02:57:36.871768 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_product_orders_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.843714 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.changebase_metadata_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.914918 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:36.916037 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.changebase_metadata_ab1 2022-07-30 02:59:35 normalization > 02:57:36.891710 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.freight_partner_vehicles_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.894156 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.flipper_features_ab1 2022-07-30 02:59:35 normalization > 02:57:36.940858 [debug] [Thread-2 ]: Began running node model.airbyte_utils.freight_routes_ab1 2022-07-30 02:59:35 normalization > 02:57:36.912816 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.freight_product_orders_ab1 2022-07-30 02:59:35 normalization > 02:57:36.942331 [debug] [Thread-8 ]: Compiling model.airbyte_utils.freight_product_orders_ab1 2022-07-30 02:59:35 normalization > 02:57:36.874371 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:36.971188 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.faq_categories_ab1 2022-07-30 02:59:35 normalization > 02:57:36.990748 [debug] [Thread-1 ]: Began running node model.airbyte_utils.freight_vehicle_types_ab1 2022-07-30 02:59:35 normalization > 02:57:37.016093 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_vehicle_types_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.025751 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.freight_vehicle_types_ab1 2022-07-30 02:59:35 normalization > 02:57:37.025959 [debug] [Thread-1 ]: Compiling model.airbyte_utils.freight_vehicle_types_ab1 2022-07-30 02:59:35 normalization > 02:57:36.874145 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_route_groupings_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.032905 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.freight_route_groupings_ab1 2022-07-30 02:59:35 normalization > 02:57:37.033122 [debug] [Thread-5 ]: Compiling model.airbyte_utils.freight_route_groupings_ab1 2022-07-30 02:59:35 normalization > 02:57:37.024119 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.freight_partners_ab1" 2022-07-30 02:59:35 normalization > 02:57:36.921784 [debug] [Thread-7 ]: Began running node model.airbyte_utils.freight_route_partner_costs_ab1 2022-07-30 02:59:35 normalization > 02:57:37.118361 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_route_partner_costs_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.118557 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.freight_route_partner_costs_ab1 2022-07-30 02:59:35 normalization > 02:57:37.118679 [debug] [Thread-7 ]: Compiling model.airbyte_utils.freight_route_partner_costs_ab1 2022-07-30 02:59:35 normalization > 02:57:36.992681 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.112759 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.141492 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.freight_partners_ab1 2022-07-30 02:59:35 normalization > 02:57:36.913198 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.142348 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.flipper_gates_ab1 2022-07-30 02:59:35 normalization > 02:57:37.142532 [debug] [Thread-4 ]: Began running node model.airbyte_utils.heya_campaign_memberships_ab1 2022-07-30 02:59:35 normalization > 02:57:37.142984 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.heya_campaign_memberships_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.140803 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.freight_partner_vehicles_ab1 2022-07-30 02:59:35 normalization > 02:57:37.117595 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.freight_vehicle_types_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.141737 [debug] [Thread-6 ]: Began running node model.airbyte_utils.freights_ab1 2022-07-30 02:59:35 normalization > 02:57:36.942098 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_routes_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.082840 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.freight_product_orders_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.148834 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.143140 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.heya_campaign_memberships_ab1 2022-07-30 02:59:35 normalization > 02:57:37.149612 [debug] [Thread-4 ]: Compiling model.airbyte_utils.heya_campaign_memberships_ab1 2022-07-30 02:59:35 normalization > 02:57:37.147541 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.freight_route_partner_costs_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.148307 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.freights_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.167735 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.freights_ab1 2022-07-30 02:59:35 normalization > 02:57:37.129136 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.freight_route_groupings_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.168423 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.169017 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.freight_route_groupings_ab1 2022-07-30 02:59:35 normalization > 02:57:37.167183 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.heya_campaign_memberships_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.148504 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.freight_routes_ab1 2022-07-30 02:59:35 normalization > 02:57:37.169977 [debug] [Thread-2 ]: Compiling model.airbyte_utils.freight_routes_ab1 2022-07-30 02:59:35 normalization > 02:57:37.168161 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.169223 [debug] [Thread-5 ]: Began running node model.airbyte_utils.location_store_products_ab1 2022-07-30 02:59:35 normalization > 02:57:37.143346 [debug] [Thread-3 ]: Began running node model.airbyte_utils.heya_campaign_receipts_ab1 2022-07-30 02:59:35 normalization > 02:57:37.182607 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.heya_campaign_receipts_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.169729 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.168023 [debug] [Thread-6 ]: Compiling model.airbyte_utils.freights_ab1 2022-07-30 02:59:35 normalization > 02:57:37.181151 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.freight_route_partner_costs_ab1 2022-07-30 02:59:35 normalization > 02:57:37.219569 [debug] [Thread-7 ]: Began running node model.airbyte_utils.memento_sessions_ab1 2022-07-30 02:59:35 normalization > 02:57:37.220219 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.memento_sessions_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.220379 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.memento_sessions_ab1 2022-07-30 02:59:35 normalization > 02:57:37.220501 [debug] [Thread-7 ]: Compiling model.airbyte_utils.memento_sessions_ab1 2022-07-30 02:59:35 normalization > 02:57:37.181429 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.241292 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.heya_campaign_memberships_ab1 2022-07-30 02:59:35 normalization > 02:57:37.241560 [debug] [Thread-4 ]: Began running node model.airbyte_utils.memento_states_ab1 2022-07-30 02:59:35 normalization > 02:57:37.242040 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.memento_states_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.242186 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.memento_states_ab1 2022-07-30 02:59:35 normalization > 02:57:37.183337 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.freight_vehicle_types_ab1 2022-07-30 02:59:35 normalization > 02:57:37.240176 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.freights_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.182054 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.location_store_products_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.245988 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.location_store_products_ab1 2022-07-30 02:59:35 normalization > 02:57:37.246133 [debug] [Thread-5 ]: Compiling model.airbyte_utils.location_store_products_ab1 2022-07-30 02:59:35 normalization > 02:57:37.204235 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.freight_routes_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.242340 [debug] [Thread-4 ]: Compiling model.airbyte_utils.memento_states_ab1 2022-07-30 02:59:35 normalization > 02:57:37.242569 [debug] [Thread-1 ]: Began running node model.airbyte_utils.oico_radar_products_ab1 2022-07-30 02:59:35 normalization > 02:57:37.245109 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.memento_sessions_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.149414 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.freight_product_orders_ab1 2022-07-30 02:59:35 normalization > 02:57:37.182770 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.heya_campaign_receipts_ab1 2022-07-30 02:59:35 normalization > 02:57:37.252828 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.270919 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.275846 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.location_store_products_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.276604 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.oico_radar_products_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.283896 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.oico_radar_products_ab1 2022-07-30 02:59:35 normalization > 02:57:37.281518 [debug] [Thread-8 ]: Began running node model.airbyte_utils.oico_radars_ab1 2022-07-30 02:59:35 normalization > 02:57:37.284548 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.oico_radars_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.284684 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.oico_radars_ab1 2022-07-30 02:59:35 normalization > 02:57:37.284794 [debug] [Thread-8 ]: Compiling model.airbyte_utils.oico_radars_ab1 2022-07-30 02:59:35 normalization > 02:57:37.282096 [debug] [Thread-3 ]: Compiling model.airbyte_utils.heya_campaign_receipts_ab1 2022-07-30 02:59:35 normalization > 02:57:37.297951 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.284043 [debug] [Thread-1 ]: Compiling model.airbyte_utils.oico_radar_products_ab1 2022-07-30 02:59:35 normalization > 02:57:37.283022 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.282810 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.freight_routes_ab1 2022-07-30 02:59:35 normalization > 02:57:37.283632 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.freights_ab1 2022-07-30 02:59:35 normalization > 02:57:37.335621 [debug] [Thread-6 ]: Began running node model.airbyte_utils.omie_accounts_ab1 2022-07-30 02:59:35 normalization > 02:57:37.314967 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.oico_radars_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.336878 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.319464 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.heya_campaign_receipts_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.333570 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.oico_radar_products_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.334548 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.memento_sessions_ab1 2022-07-30 02:59:35 normalization > 02:57:37.334890 [debug] [Thread-2 ]: Began running node model.airbyte_utils.oico_users_ab1 2022-07-30 02:59:35 normalization > 02:57:37.281082 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.memento_states_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.336532 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.omie_accounts_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.337450 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.oico_radars_ab1 2022-07-30 02:59:35 normalization > 02:57:37.339944 [debug] [Thread-8 ]: Began running node model.airbyte_utils.order_feedbacks_ab1 2022-07-30 02:59:35 normalization > 02:57:37.340415 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.order_feedbacks_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.340546 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.order_feedbacks_ab1 2022-07-30 02:59:35 normalization > 02:57:37.339334 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.341535 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.memento_states_ab1 2022-07-30 02:59:35 normalization > 02:57:37.341718 [debug] [Thread-4 ]: Began running node model.airbyte_utils.order_issues_ab1 2022-07-30 02:59:35 normalization > 02:57:37.342508 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.order_issues_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.340673 [debug] [Thread-8 ]: Compiling model.airbyte_utils.order_feedbacks_ab1 2022-07-30 02:59:35 normalization > 02:57:37.315760 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.location_store_products_ab1 2022-07-30 02:59:35 normalization > 02:57:37.338935 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.oico_users_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.359202 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.oico_users_ab1 2022-07-30 02:59:35 normalization > 02:57:37.359359 [debug] [Thread-2 ]: Compiling model.airbyte_utils.oico_users_ab1 2022-07-30 02:59:35 normalization > 02:57:37.339673 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.342661 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.order_issues_ab1 2022-07-30 02:59:35 normalization > 02:57:37.376866 [debug] [Thread-4 ]: Compiling model.airbyte_utils.order_issues_ab1 2022-07-30 02:59:35 normalization > 02:57:37.358608 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.order_feedbacks_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.399119 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.359001 [debug] [Thread-5 ]: Began running node model.airbyte_utils.orders_ab1 2022-07-30 02:59:35 normalization > 02:57:37.400375 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.orders_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.400516 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.orders_ab1 2022-07-30 02:59:35 normalization > 02:57:37.400639 [debug] [Thread-5 ]: Compiling model.airbyte_utils.orders_ab1 2022-07-30 02:59:35 normalization > 02:57:37.339553 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.omie_accounts_ab1 2022-07-30 02:59:35 normalization > 02:57:37.421993 [debug] [Thread-6 ]: Compiling model.airbyte_utils.omie_accounts_ab1 2022-07-30 02:59:35 normalization > 02:57:37.337930 [debug] [Thread-7 ]: Began running node model.airbyte_utils.order_categories_ab1 2022-07-30 02:59:35 normalization > 02:57:37.399822 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.order_feedbacks_ab1 2022-07-30 02:59:35 normalization > 02:57:37.376596 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.oico_radar_products_ab1 2022-07-30 02:59:35 normalization > 02:57:37.339767 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.384100 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.oico_users_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.474675 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.475249 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.oico_users_ab1 2022-07-30 02:59:35 normalization > 02:57:37.458346 [debug] [Thread-8 ]: Began running node model.airbyte_utils.payer_buyer_locations_ab1 2022-07-30 02:59:35 normalization > 02:57:37.468992 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.orders_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.476705 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.473234 [debug] [Thread-1 ]: Began running node model.airbyte_utils.payers_ab1 2022-07-30 02:59:35 normalization > 02:57:37.477831 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.payers_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.477979 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.payers_ab1 2022-07-30 02:59:35 normalization > 02:57:37.478097 [debug] [Thread-1 ]: Compiling model.airbyte_utils.payers_ab1 2022-07-30 02:59:35 normalization > 02:57:37.398729 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.order_issues_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.489921 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.490687 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.order_issues_ab1 2022-07-30 02:59:35 normalization > 02:57:37.477271 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.orders_ab1 2022-07-30 02:59:35 normalization > 02:57:37.491103 [debug] [Thread-5 ]: Began running node model.airbyte_utils.popular_searches_ab1 2022-07-30 02:59:35 normalization > 02:57:37.474289 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.heya_campaign_receipts_ab1 2022-07-30 02:59:35 normalization > 02:57:37.475493 [debug] [Thread-2 ]: Began running node model.airbyte_utils.payment_installments_ab1 2022-07-30 02:59:35 normalization > 02:57:37.476027 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.payer_buyer_locations_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.493469 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.payer_buyer_locations_ab1 2022-07-30 02:59:35 normalization > 02:57:37.490929 [debug] [Thread-4 ]: Began running node model.airbyte_utils.payments_ab1 2022-07-30 02:59:35 normalization > 02:57:37.494128 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.payments_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.494273 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.payments_ab1 2022-07-30 02:59:35 normalization > 02:57:37.494388 [debug] [Thread-4 ]: Compiling model.airbyte_utils.payments_ab1 2022-07-30 02:59:35 normalization > 02:57:37.492405 [debug] [Thread-3 ]: Began running node model.airbyte_utils.product_canonical_categories_ab1 2022-07-30 02:59:35 normalization > 02:57:37.516393 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.product_canonical_categories_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.516607 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.product_canonical_categories_ab1 2022-07-30 02:59:35 normalization > 02:57:37.491660 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.popular_searches_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.516906 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.popular_searches_ab1 2022-07-30 02:59:35 normalization > 02:57:37.517015 [debug] [Thread-5 ]: Compiling model.airbyte_utils.popular_searches_ab1 2022-07-30 02:59:35 normalization > 02:57:37.493276 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.payment_installments_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.493633 [debug] [Thread-8 ]: Compiling model.airbyte_utils.payer_buyer_locations_ab1 2022-07-30 02:59:35 normalization > 02:57:37.516747 [debug] [Thread-3 ]: Compiling model.airbyte_utils.product_canonical_categories_ab1 2022-07-30 02:59:35 normalization > 02:57:37.448432 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.order_categories_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.582357 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.order_categories_ab1 2022-07-30 02:59:35 normalization > 02:57:37.595826 [debug] [Thread-7 ]: Compiling model.airbyte_utils.order_categories_ab1 2022-07-30 02:59:35 normalization > 02:57:37.534553 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.popular_searches_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.605351 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.606065 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.popular_searches_ab1 2022-07-30 02:59:35 normalization > 02:57:37.472783 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.omie_accounts_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.606944 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.542807 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.payment_installments_ab1 2022-07-30 02:59:35 normalization > 02:57:37.595555 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.payer_buyer_locations_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.582123 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.payments_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.584057 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.payers_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.606300 [debug] [Thread-5 ]: Began running node model.airbyte_utils.product_canonicals_ab1 2022-07-30 02:59:35 normalization > 02:57:37.592222 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.product_canonical_categories_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.607580 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.omie_accounts_ab1 2022-07-30 02:59:35 normalization > 02:57:37.607793 [debug] [Thread-2 ]: Compiling model.airbyte_utils.payment_installments_ab1 2022-07-30 02:59:35 normalization > 02:57:37.608065 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.612772 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.order_categories_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.613276 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.626787 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.payments_ab1 2022-07-30 02:59:35 normalization > 02:57:37.613921 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.product_canonicals_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.644811 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.product_canonicals_ab1 2022-07-30 02:59:35 normalization > 02:57:37.626025 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.payer_buyer_locations_ab1 2022-07-30 02:59:35 normalization > 02:57:37.645163 [debug] [Thread-8 ]: Began running node model.airbyte_utils.products_ab1 2022-07-30 02:59:35 normalization > 02:57:37.645798 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.products_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.646013 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.products_ab1 2022-07-30 02:59:35 normalization > 02:57:37.646128 [debug] [Thread-8 ]: Compiling model.airbyte_utils.products_ab1 2022-07-30 02:59:35 normalization > 02:57:37.614269 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.644586 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.672029 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.payers_ab1 2022-07-30 02:59:35 normalization > 02:57:37.672310 [debug] [Thread-1 ]: Began running node model.airbyte_utils.reports_ab1 2022-07-30 02:59:35 normalization > 02:57:37.672797 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.reports_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.672934 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.reports_ab1 2022-07-30 02:59:35 normalization > 02:57:37.660377 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.661021 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.product_canonical_categories_ab1 2022-07-30 02:59:35 normalization > 02:57:37.688246 [debug] [Thread-3 ]: Began running node model.airbyte_utils.requested_products_ab1 2022-07-30 02:59:35 normalization > 02:57:37.688854 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.requested_products_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.689020 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.requested_products_ab1 2022-07-30 02:59:35 normalization > 02:57:37.689139 [debug] [Thread-3 ]: Compiling model.airbyte_utils.requested_products_ab1 2022-07-30 02:59:35 normalization > 02:57:37.614485 [debug] [Thread-6 ]: Began running node model.airbyte_utils.product_orders_ab1 2022-07-30 02:59:35 normalization > 02:57:37.673986 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.order_categories_ab1 2022-07-30 02:59:35 normalization > 02:57:37.687946 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.products_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.644974 [debug] [Thread-5 ]: Compiling model.airbyte_utils.product_canonicals_ab1 2022-07-30 02:59:35 normalization > 02:57:37.626996 [debug] [Thread-4 ]: Began running node model.airbyte_utils.product_reports_ab1 2022-07-30 02:59:35 normalization > 02:57:37.660063 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.payment_installments_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.673074 [debug] [Thread-1 ]: Compiling model.airbyte_utils.reports_ab1 2022-07-30 02:59:35 normalization > 02:57:37.702335 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.product_orders_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.751473 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.product_orders_ab1 2022-07-30 02:59:35 normalization > 02:57:37.751650 [debug] [Thread-6 ]: Compiling model.airbyte_utils.product_orders_ab1 2022-07-30 02:59:35 normalization > 02:57:37.712421 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.721318 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.product_reports_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.777733 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.product_reports_ab1 2022-07-30 02:59:35 normalization > 02:57:37.737019 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.778641 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.payment_installments_ab1 2022-07-30 02:59:35 normalization > 02:57:37.778843 [debug] [Thread-2 ]: Began running node model.airbyte_utils.roi_products_ab1 2022-07-30 02:59:35 normalization > 02:57:37.779309 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.roi_products_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.785686 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.roi_products_ab1 2022-07-30 02:59:35 normalization > 02:57:37.785886 [debug] [Thread-2 ]: Compiling model.airbyte_utils.roi_products_ab1 2022-07-30 02:59:35 normalization > 02:57:37.777965 [debug] [Thread-4 ]: Compiling model.airbyte_utils.product_reports_ab1 2022-07-30 02:59:35 normalization > 02:57:37.800049 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.roi_products_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.751136 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.reports_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.711916 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.requested_products_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.817024 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.817608 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.requested_products_ab1 2022-07-30 02:59:35 normalization > 02:57:37.793478 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.product_orders_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.818139 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.816272 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.product_reports_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.816763 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.820024 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.reports_ab1 2022-07-30 02:59:35 normalization > 02:57:37.820390 [debug] [Thread-1 ]: Began running node model.airbyte_utils.shortened_urls_ab1 2022-07-30 02:59:35 normalization > 02:57:37.817826 [debug] [Thread-3 ]: Began running node model.airbyte_utils.schema_migrations_ab1 2022-07-30 02:59:35 normalization > 02:57:37.821750 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.schema_migrations_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.818714 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.product_orders_ab1 2022-07-30 02:59:35 normalization > 02:57:37.819230 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.767807 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.products_ab1 2022-07-30 02:59:35 normalization > 02:57:37.820206 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.820927 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.shortened_urls_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.736690 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.product_canonicals_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.821906 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.schema_migrations_ab1 2022-07-30 02:59:35 normalization > 02:57:37.824570 [debug] [Thread-3 ]: Compiling model.airbyte_utils.schema_migrations_ab1 2022-07-30 02:59:35 normalization > 02:57:37.822106 [debug] [Thread-6 ]: Began running node model.airbyte_utils.sidekiq_sequence_records_ab1 2022-07-30 02:59:35 normalization > 02:57:37.822984 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.roi_products_ab1 2022-07-30 02:59:35 normalization > 02:57:37.823227 [debug] [Thread-8 ]: Began running node model.airbyte_utils.spatial_ref_sys_ab1 2022-07-30 02:59:35 normalization > 02:57:37.824094 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.product_reports_ab1 2022-07-30 02:59:35 normalization > 02:57:37.824276 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.shortened_urls_ab1 2022-07-30 02:59:35 normalization > 02:57:37.703065 [debug] [Thread-7 ]: Began running node model.airbyte_utils.responsible_deliveries_ab1 2022-07-30 02:59:35 normalization > 02:57:37.837890 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.responsible_deliveries_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.834899 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.schema_migrations_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.835672 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.sidekiq_sequence_records_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.835971 [debug] [Thread-2 ]: Began running node model.airbyte_utils.stockout_events_ab1 2022-07-30 02:59:35 normalization > 02:57:37.836545 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.spatial_ref_sys_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.839873 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.spatial_ref_sys_ab1 2022-07-30 02:59:35 normalization > 02:57:37.839991 [debug] [Thread-8 ]: Compiling model.airbyte_utils.spatial_ref_sys_ab1 2022-07-30 02:59:35 normalization > 02:57:37.829948 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.849232 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.product_canonicals_ab1 2022-07-30 02:59:35 normalization > 02:57:37.838689 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.sidekiq_sequence_records_ab1 2022-07-30 02:59:35 normalization > 02:57:37.839707 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.stockout_events_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.856200 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.stockout_events_ab1 2022-07-30 02:59:35 normalization > 02:57:37.838045 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.responsible_deliveries_ab1 2022-07-30 02:59:35 normalization > 02:57:37.837370 [debug] [Thread-1 ]: Compiling model.airbyte_utils.shortened_urls_ab1 2022-07-30 02:59:35 normalization > 02:57:37.849507 [debug] [Thread-5 ]: Began running node model.airbyte_utils.store_locations_ab1 2022-07-30 02:59:35 normalization > 02:57:37.849682 [debug] [Thread-6 ]: Compiling model.airbyte_utils.sidekiq_sequence_records_ab1 2022-07-30 02:59:35 normalization > 02:57:37.837176 [debug] [Thread-4 ]: Began running node model.airbyte_utils.store_categories_ab1 2022-07-30 02:59:35 normalization > 02:57:37.856495 [debug] [Thread-2 ]: Compiling model.airbyte_utils.stockout_events_ab1 2022-07-30 02:59:35 normalization > 02:57:37.856629 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.857303 [debug] [Thread-7 ]: Compiling model.airbyte_utils.responsible_deliveries_ab1 2022-07-30 02:59:35 normalization > 02:57:37.857106 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.spatial_ref_sys_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.924405 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.925057 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.spatial_ref_sys_ab1 2022-07-30 02:59:35 normalization > 02:57:37.879654 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.store_categories_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.925773 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.store_categories_ab1 2022-07-30 02:59:35 normalization > 02:57:37.925913 [debug] [Thread-4 ]: Compiling model.airbyte_utils.store_categories_ab1 2022-07-30 02:59:35 normalization > 02:57:37.889435 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.sidekiq_sequence_records_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.923926 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.responsible_deliveries_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.863108 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.store_locations_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.940118 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.store_locations_ab1 2022-07-30 02:59:35 normalization > 02:57:37.925283 [debug] [Thread-8 ]: Began running node model.airbyte_utils.store_order_quotes_ab1 2022-07-30 02:59:35 normalization > 02:57:37.940871 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.store_order_quotes_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.941034 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.store_order_quotes_ab1 2022-07-30 02:59:35 normalization > 02:57:37.941148 [debug] [Thread-8 ]: Compiling model.airbyte_utils.store_order_quotes_ab1 2022-07-30 02:59:35 normalization > 02:57:37.906056 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.schema_migrations_ab1 2022-07-30 02:59:35 normalization > 02:57:37.957621 [debug] [Thread-3 ]: Began running node model.airbyte_utils.store_orders_ab1 2022-07-30 02:59:35 normalization > 02:57:37.886642 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.shortened_urls_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.958959 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.937110 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:37.960343 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.sidekiq_sequence_records_ab1 2022-07-30 02:59:35 normalization > 02:57:37.960516 [debug] [Thread-6 ]: Began running node model.airbyte_utils.store_users_ab1 2022-07-30 02:59:35 normalization > 02:57:37.957280 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.store_order_quotes_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.940294 [debug] [Thread-5 ]: Compiling model.airbyte_utils.store_locations_ab1 2022-07-30 02:59:35 normalization > 02:57:37.958243 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.store_orders_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.939754 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.store_categories_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.959743 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.shortened_urls_ab1 2022-07-30 02:59:35 normalization > 02:57:37.983873 [debug] [Thread-1 ]: Began running node model.airbyte_utils.stores_ab1 2022-07-30 02:59:35 normalization > 02:57:37.984513 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.stores_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.984687 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.stores_ab1 2022-07-30 02:59:35 normalization > 02:57:37.984810 [debug] [Thread-1 ]: Compiling model.airbyte_utils.stores_ab1 2022-07-30 02:59:35 normalization > 02:57:37.968490 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.073896 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.store_order_quotes_ab1 2022-07-30 02:59:35 normalization > 02:57:38.074105 [debug] [Thread-8 ]: Began running node model.airbyte_utils.term_acceptances_ab1 2022-07-30 02:59:35 normalization > 02:57:38.074604 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.term_acceptances_ab1" 2022-07-30 02:59:35 normalization > 02:57:38.074740 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.term_acceptances_ab1 2022-07-30 02:59:35 normalization > 02:57:38.074856 [debug] [Thread-8 ]: Compiling model.airbyte_utils.term_acceptances_ab1 2022-07-30 02:59:35 normalization > 02:57:37.905286 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.stockout_events_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.968301 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.store_orders_ab1 2022-07-30 02:59:35 normalization > 02:57:37.960999 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.store_users_ab1" 2022-07-30 02:59:35 normalization > 02:57:38.111088 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.store_users_ab1 2022-07-30 02:59:35 normalization > 02:57:38.111230 [debug] [Thread-6 ]: Compiling model.airbyte_utils.store_users_ab1 2022-07-30 02:59:35 normalization > 02:57:38.072815 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.132612 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.store_categories_ab1 2022-07-30 02:59:35 normalization > 02:57:38.133281 [debug] [Thread-4 ]: Began running node model.airbyte_utils.terms_ab1 2022-07-30 02:59:35 normalization > 02:57:38.133816 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.terms_ab1" 2022-07-30 02:59:35 normalization > 02:57:38.133967 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.terms_ab1 2022-07-30 02:59:35 normalization > 02:57:38.134084 [debug] [Thread-4 ]: Compiling model.airbyte_utils.terms_ab1 2022-07-30 02:59:35 normalization > 02:57:38.133054 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.stores_ab1" 2022-07-30 02:59:35 normalization > 02:57:38.156925 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.157621 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.stores_ab1 2022-07-30 02:59:35 normalization > 02:57:38.157817 [debug] [Thread-1 ]: Began running node model.airbyte_utils.transfeera_batches_ab1 2022-07-30 02:59:35 normalization > 02:57:38.110780 [debug] [Thread-3 ]: Compiling model.airbyte_utils.store_orders_ab1 2022-07-30 02:59:35 normalization > 02:57:38.148075 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.store_users_ab1" 2022-07-30 02:59:35 normalization > 02:57:38.148485 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.174123 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.stockout_events_ab1 2022-07-30 02:59:35 normalization > 02:57:38.174375 [debug] [Thread-2 ]: Began running node model.airbyte_utils.buyer_contact_rules_ab2 2022-07-30 02:59:35 normalization > 02:57:38.174857 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_contact_rules_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.158337 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.transfeera_batches_ab1" 2022-07-30 02:59:35 normalization > 02:57:38.179149 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.transfeera_batches_ab1 2022-07-30 02:59:35 normalization > 02:57:38.073274 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.store_locations_ab1" 2022-07-30 02:59:35 normalization > 02:57:37.953929 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.180791 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.responsible_deliveries_ab1 2022-07-30 02:59:35 normalization > 02:57:38.180971 [debug] [Thread-7 ]: Began running node model.airbyte_utils.active_storage_attachments_ab2 2022-07-30 02:59:35 normalization > 02:57:38.173177 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.terms_ab1" 2022-07-30 02:59:35 normalization > 02:57:38.182144 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.179549 [debug] [Thread-1 ]: Compiling model.airbyte_utils.transfeera_batches_ab1 2022-07-30 02:59:35 normalization > 02:57:38.179878 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.180199 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.198033 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.store_locations_ab1 2022-07-30 02:59:35 normalization > 02:57:38.099978 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.term_acceptances_ab1" 2022-07-30 02:59:35 normalization > 02:57:38.198611 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.182717 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.terms_ab1 2022-07-30 02:59:35 normalization > 02:57:38.199850 [debug] [Thread-4 ]: Began running node model.airbyte_utils.buyer_contacts_ab2 2022-07-30 02:59:35 normalization > 02:57:38.196598 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.transfeera_batches_ab1" 2022-07-30 02:59:35 normalization > 02:57:38.198263 [debug] [Thread-5 ]: Began running node model.airbyte_utils.buyer_public_informations_ab2 2022-07-30 02:59:35 normalization > 02:57:38.201450 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_public_informations_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.197416 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.store_users_ab1 2022-07-30 02:59:35 normalization > 02:57:38.175028 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.buyer_contact_rules_ab2 2022-07-30 02:59:35 normalization > 02:57:38.202223 [debug] [Thread-2 ]: Compiling model.airbyte_utils.buyer_contact_rules_ab2 2022-07-30 02:59:35 normalization > 02:57:38.199190 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.term_acceptances_ab1 2022-07-30 02:59:35 normalization > 02:57:38.208960 [debug] [Thread-8 ]: Began running node model.airbyte_utils.buyer_locations_ab2 2022-07-30 02:59:35 normalization > 02:57:38.209586 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_locations_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.209745 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.buyer_locations_ab2 2022-07-30 02:59:35 normalization > 02:57:38.209866 [debug] [Thread-8 ]: Compiling model.airbyte_utils.buyer_locations_ab2 2022-07-30 02:59:35 normalization > 02:57:38.181458 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.active_storage_attachments_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.217069 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.active_storage_attachments_ab2 2022-07-30 02:59:35 normalization > 02:57:38.217266 [debug] [Thread-7 ]: Compiling model.airbyte_utils.active_storage_attachments_ab2 2022-07-30 02:59:35 normalization > 02:57:38.201715 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.buyer_public_informations_ab2 2022-07-30 02:59:35 normalization > 02:57:38.201860 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.288569 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.transfeera_batches_ab1 2022-07-30 02:59:35 normalization > 02:57:38.202052 [debug] [Thread-6 ]: Began running node model.airbyte_utils.ar_internal_metadata_ab2 2022-07-30 02:59:35 normalization > 02:57:38.200744 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_contacts_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.290041 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.buyer_contacts_ab2 2022-07-30 02:59:35 normalization > 02:57:38.290183 [debug] [Thread-4 ]: Compiling model.airbyte_utils.buyer_contacts_ab2 2022-07-30 02:59:35 normalization > 02:57:38.275347 [debug] [Thread-5 ]: Compiling model.airbyte_utils.buyer_public_informations_ab2 2022-07-30 02:59:35 normalization > 02:57:38.287700 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.buyer_locations_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.178957 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.store_orders_ab1" 2022-07-30 02:59:35 normalization > 02:57:38.318903 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.288839 [debug] [Thread-1 ]: Began running node model.airbyte_utils.active_storage_variant_records_ab2 2022-07-30 02:59:35 normalization > 02:57:38.340551 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.active_storage_variant_records_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.276370 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.buyer_contact_rules_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.342583 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.343230 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.buyer_contact_rules_ab2 2022-07-30 02:59:35 normalization > 02:57:38.318371 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.buyer_contacts_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.344105 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.344685 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.buyer_contacts_ab2 2022-07-30 02:59:35 normalization > 02:57:38.342229 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.active_storage_variant_records_ab2 2022-07-30 02:59:35 normalization > 02:57:38.345015 [debug] [Thread-1 ]: Compiling model.airbyte_utils.active_storage_variant_records_ab2 2022-07-30 02:59:35 normalization > 02:57:38.319638 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.store_orders_ab1 2022-07-30 02:59:35 normalization > 02:57:38.343479 [debug] [Thread-2 ]: Began running node model.airbyte_utils.buyer_uploads_ab2 2022-07-30 02:59:35 normalization > 02:57:38.359415 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_uploads_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.364817 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.buyer_uploads_ab2 2022-07-30 02:59:35 normalization > 02:57:38.365006 [debug] [Thread-2 ]: Compiling model.airbyte_utils.buyer_uploads_ab2 2022-07-30 02:59:35 normalization > 02:57:38.344877 [debug] [Thread-4 ]: Began running node model.airbyte_utils.active_storage_blobs_ab2 2022-07-30 02:59:35 normalization > 02:57:38.386271 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.active_storage_blobs_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.387556 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.active_storage_blobs_ab2 2022-07-30 02:59:35 normalization > 02:57:38.359641 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.388380 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.buyer_locations_ab2 2022-07-30 02:59:35 normalization > 02:57:38.388577 [debug] [Thread-8 ]: Began running node model.airbyte_utils.faq_ab2 2022-07-30 02:59:35 normalization > 02:57:38.389052 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.faq_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.353116 [debug] [Thread-3 ]: Began running node model.airbyte_utils.categories_ab2 2022-07-30 02:59:35 normalization > 02:57:38.389686 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.categories_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.389820 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.categories_ab2 2022-07-30 02:59:35 normalization > 02:57:38.389936 [debug] [Thread-3 ]: Compiling model.airbyte_utils.categories_ab2 2022-07-30 02:59:35 normalization > 02:57:38.289822 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.ar_internal_metadata_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.397038 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.ar_internal_metadata_ab2 2022-07-30 02:59:35 normalization > 02:57:38.397251 [debug] [Thread-6 ]: Compiling model.airbyte_utils.ar_internal_metadata_ab2 2022-07-30 02:59:35 normalization > 02:57:38.387277 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.buyer_uploads_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.389203 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.faq_ab2 2022-07-30 02:59:35 normalization > 02:57:38.435915 [debug] [Thread-8 ]: Compiling model.airbyte_utils.faq_ab2 2022-07-30 02:59:35 normalization > 02:57:38.342021 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.buyer_public_informations_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.443889 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.387718 [debug] [Thread-4 ]: Compiling model.airbyte_utils.active_storage_blobs_ab2 2022-07-30 02:59:35 normalization > 02:57:38.429831 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.categories_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.435515 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.435704 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.ar_internal_metadata_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.364514 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.active_storage_variant_records_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.269213 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.active_storage_attachments_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.486162 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.486847 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.active_storage_attachments_ab2 2022-07-30 02:59:35 normalization > 02:57:38.487048 [debug] [Thread-7 ]: Began running node model.airbyte_utils.buyers_ab2 2022-07-30 02:59:35 normalization > 02:57:38.478888 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.485406 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.active_storage_blobs_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.485887 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.489340 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.active_storage_variant_records_ab2 2022-07-30 02:59:35 normalization > 02:57:38.489529 [debug] [Thread-1 ]: Began running node model.airbyte_utils.buyer_users_ab2 2022-07-30 02:59:35 normalization > 02:57:38.469222 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.buyer_uploads_ab2 2022-07-30 02:59:35 normalization > 02:57:38.490647 [debug] [Thread-2 ]: Began running node model.airbyte_utils.buyer_store_recommendations_ab2 2022-07-30 02:59:35 normalization > 02:57:38.488543 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.categories_ab2 2022-07-30 02:59:35 normalization > 02:57:38.491840 [debug] [Thread-3 ]: Began running node model.airbyte_utils.changebase_metadata_ab2 2022-07-30 02:59:35 normalization > 02:57:38.444658 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.buyer_public_informations_ab2 2022-07-30 02:59:35 normalization > 02:57:38.492796 [debug] [Thread-5 ]: Began running node model.airbyte_utils.flipper_features_ab2 2022-07-30 02:59:35 normalization > 02:57:38.493271 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.flipper_features_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.472894 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.faq_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.491267 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_store_recommendations_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.494116 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.buyer_store_recommendations_ab2 2022-07-30 02:59:35 normalization > 02:57:38.494254 [debug] [Thread-2 ]: Compiling model.airbyte_utils.buyer_store_recommendations_ab2 2022-07-30 02:59:35 normalization > 02:57:38.487603 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.buyers_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.499572 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.buyers_ab2 2022-07-30 02:59:35 normalization > 02:57:38.499756 [debug] [Thread-7 ]: Compiling model.airbyte_utils.buyers_ab2 2022-07-30 02:59:35 normalization > 02:57:38.493419 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.flipper_features_ab2 2022-07-30 02:59:35 normalization > 02:57:38.562534 [debug] [Thread-5 ]: Compiling model.airbyte_utils.flipper_features_ab2 2022-07-30 02:59:35 normalization > 02:57:38.492339 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.changebase_metadata_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.573790 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.changebase_metadata_ab2 2022-07-30 02:59:35 normalization > 02:57:38.574003 [debug] [Thread-3 ]: Compiling model.airbyte_utils.changebase_metadata_ab2 2022-07-30 02:59:35 normalization > 02:57:38.562116 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.buyer_store_recommendations_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.488709 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.613124 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.ar_internal_metadata_ab2 2022-07-30 02:59:35 normalization > 02:57:38.613363 [debug] [Thread-6 ]: Began running node model.airbyte_utils.faq_categories_ab2 2022-07-30 02:59:35 normalization > 02:57:38.613896 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.faq_categories_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.614038 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.faq_categories_ab2 2022-07-30 02:59:35 normalization > 02:57:38.614166 [debug] [Thread-6 ]: Compiling model.airbyte_utils.faq_categories_ab2 2022-07-30 02:59:35 normalization > 02:57:38.612290 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.buyers_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.493886 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.629274 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.active_storage_blobs_ab2 2022-07-30 02:59:35 normalization > 02:57:38.629506 [debug] [Thread-4 ]: Began running node model.airbyte_utils.flipper_gates_ab2 2022-07-30 02:59:35 normalization > 02:57:38.593765 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.changebase_metadata_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.630346 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.630864 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.changebase_metadata_ab2 2022-07-30 02:59:35 normalization > 02:57:38.631029 [debug] [Thread-3 ]: Began running node model.airbyte_utils.freight_partner_vehicles_ab2 2022-07-30 02:59:35 normalization > 02:57:38.619972 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.630019 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.flipper_gates_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.608256 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.flipper_features_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.640388 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.604497 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.641846 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.faq_ab2 2022-07-30 02:59:35 normalization > 02:57:38.642038 [debug] [Thread-8 ]: Began running node model.airbyte_utils.freight_partners_ab2 2022-07-30 02:59:35 normalization > 02:57:38.642515 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_partners_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.639944 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.faq_categories_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.490398 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_users_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.641087 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.flipper_features_ab2 2022-07-30 02:59:35 normalization > 02:57:38.632633 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.buyer_store_recommendations_ab2 2022-07-30 02:59:35 normalization > 02:57:38.644484 [debug] [Thread-2 ]: Began running node model.airbyte_utils.freight_route_partner_costs_ab2 2022-07-30 02:59:35 normalization > 02:57:38.645276 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_route_partner_costs_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.642669 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.freight_partners_ab2 2022-07-30 02:59:35 normalization > 02:57:38.645609 [debug] [Thread-8 ]: Compiling model.airbyte_utils.freight_partners_ab2 2022-07-30 02:59:35 normalization > 02:57:38.643595 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.643822 [debug] [Thread-5 ]: Began running node model.airbyte_utils.freight_route_groupings_ab2 2022-07-30 02:59:35 normalization > 02:57:38.677094 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_route_groupings_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.631533 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_partner_vehicles_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.677488 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.freight_partner_vehicles_ab2 2022-07-30 02:59:35 normalization > 02:57:38.677611 [debug] [Thread-3 ]: Compiling model.airbyte_utils.freight_partner_vehicles_ab2 2022-07-30 02:59:35 normalization > 02:57:38.632880 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.flipper_gates_ab2 2022-07-30 02:59:35 normalization > 02:57:38.689983 [debug] [Thread-4 ]: Compiling model.airbyte_utils.flipper_gates_ab2 2022-07-30 02:59:35 normalization > 02:57:38.644269 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.677337 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.freight_route_groupings_ab2 2022-07-30 02:59:35 normalization > 02:57:38.645428 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.freight_route_partner_costs_ab2 2022-07-30 02:59:35 normalization > 02:57:38.724363 [debug] [Thread-2 ]: Compiling model.airbyte_utils.freight_route_partner_costs_ab2 2022-07-30 02:59:35 normalization > 02:57:38.643336 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.buyer_users_ab2 2022-07-30 02:59:35 normalization > 02:57:38.694248 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.freight_partners_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.764726 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.765423 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.freight_partners_ab2 2022-07-30 02:59:35 normalization > 02:57:38.724203 [debug] [Thread-5 ]: Compiling model.airbyte_utils.freight_route_groupings_ab2 2022-07-30 02:59:35 normalization > 02:57:38.666913 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.faq_categories_ab2 2022-07-30 02:59:35 normalization > 02:57:38.772585 [debug] [Thread-6 ]: Began running node model.airbyte_utils.heya_campaign_memberships_ab2 2022-07-30 02:59:35 normalization > 02:57:38.773231 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.heya_campaign_memberships_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.773389 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.heya_campaign_memberships_ab2 2022-07-30 02:59:35 normalization > 02:57:38.773509 [debug] [Thread-6 ]: Compiling model.airbyte_utils.heya_campaign_memberships_ab2 2022-07-30 02:59:35 normalization > 02:57:38.715730 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.buyers_ab2 2022-07-30 02:59:35 normalization > 02:57:38.790971 [debug] [Thread-7 ]: Began running node model.airbyte_utils.freight_product_orders_ab2 2022-07-30 02:59:35 normalization > 02:57:38.723875 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.freight_partner_vehicles_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.744442 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.flipper_gates_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.755093 [debug] [Thread-1 ]: Compiling model.airbyte_utils.buyer_users_ab2 2022-07-30 02:59:35 normalization > 02:57:38.764244 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.freight_route_partner_costs_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.765653 [debug] [Thread-8 ]: Began running node model.airbyte_utils.freight_vehicle_types_ab2 2022-07-30 02:59:35 normalization > 02:57:38.791655 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_product_orders_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.863711 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.freight_product_orders_ab2 2022-07-30 02:59:35 normalization > 02:57:38.868273 [debug] [Thread-7 ]: Compiling model.airbyte_utils.freight_product_orders_ab2 2022-07-30 02:59:35 normalization > 02:57:38.820172 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.830711 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.880771 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.freight_partner_vehicles_ab2 2022-07-30 02:59:35 normalization > 02:57:38.880959 [debug] [Thread-3 ]: Began running node model.airbyte_utils.freight_routes_ab2 2022-07-30 02:59:35 normalization > 02:57:38.881433 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_routes_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.867944 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.buyer_users_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.820882 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.freight_route_groupings_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.880136 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.freight_route_partner_costs_ab2 2022-07-30 02:59:35 normalization > 02:57:38.896353 [debug] [Thread-2 ]: Began running node model.airbyte_utils.freights_ab2 2022-07-30 02:59:35 normalization > 02:57:38.845379 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.heya_campaign_memberships_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.808175 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.881592 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.freight_routes_ab2 2022-07-30 02:59:35 normalization > 02:57:38.895668 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.freight_product_orders_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.896035 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.831494 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_vehicle_types_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.897055 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.freights_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.900123 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.freights_ab2 2022-07-30 02:59:35 normalization > 02:57:38.898531 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.898715 [debug] [Thread-3 ]: Compiling model.airbyte_utils.freight_routes_ab2 2022-07-30 02:59:35 normalization > 02:57:38.898939 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.912842 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.heya_campaign_memberships_ab2 2022-07-30 02:59:35 normalization > 02:57:38.913085 [debug] [Thread-6 ]: Began running node model.airbyte_utils.memento_sessions_ab2 2022-07-30 02:59:35 normalization > 02:57:38.899961 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.freight_vehicle_types_ab2 2022-07-30 02:59:35 normalization > 02:57:38.914193 [debug] [Thread-8 ]: Compiling model.airbyte_utils.freight_vehicle_types_ab2 2022-07-30 02:59:35 normalization > 02:57:38.900901 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.freight_route_groupings_ab2 2022-07-30 02:59:35 normalization > 02:57:38.957590 [debug] [Thread-5 ]: Began running node model.airbyte_utils.oico_radars_ab2 2022-07-30 02:59:35 normalization > 02:57:38.962726 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.oico_radars_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.900258 [debug] [Thread-2 ]: Compiling model.airbyte_utils.freights_ab2 2022-07-30 02:59:35 normalization > 02:57:38.898186 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.flipper_gates_ab2 2022-07-30 02:59:35 normalization > 02:57:38.913767 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.969897 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.freight_product_orders_ab2 2022-07-30 02:59:35 normalization > 02:57:38.961990 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.freight_routes_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.913624 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.memento_sessions_ab2" 2022-07-30 02:59:35 normalization > 02:57:38.962967 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.oico_radars_ab2 2022-07-30 02:59:35 normalization > 02:57:39.006677 [debug] [Thread-5 ]: Compiling model.airbyte_utils.oico_radars_ab2 2022-07-30 02:59:35 normalization > 02:57:38.969156 [debug] [Thread-4 ]: Began running node model.airbyte_utils.memento_states_ab2 2022-07-30 02:59:35 normalization > 02:57:38.970116 [debug] [Thread-7 ]: Began running node model.airbyte_utils.location_store_products_ab2 2022-07-30 02:59:35 normalization > 02:57:38.990252 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.freight_vehicle_types_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.055838 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:38.899725 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.buyer_users_ab2 2022-07-30 02:59:35 normalization > 02:57:39.017793 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:39.057862 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.freight_routes_ab2 2022-07-30 02:59:35 normalization > 02:57:39.023769 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.memento_states_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.058457 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.memento_states_ab2 2022-07-30 02:59:35 normalization > 02:57:39.058598 [debug] [Thread-4 ]: Compiling model.airbyte_utils.memento_states_ab2 2022-07-30 02:59:35 normalization > 02:57:39.039409 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.location_store_products_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.079987 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.location_store_products_ab2 2022-07-30 02:59:35 normalization > 02:57:39.080217 [debug] [Thread-7 ]: Compiling model.airbyte_utils.location_store_products_ab2 2022-07-30 02:59:35 normalization > 02:57:39.038661 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.freights_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.058070 [debug] [Thread-3 ]: Began running node model.airbyte_utils.oico_radar_products_ab2 2022-07-30 02:59:35 normalization > 02:57:39.055335 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.oico_radars_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.110834 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:39.006405 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.memento_sessions_ab2 2022-07-30 02:59:35 normalization > 02:57:39.111695 [debug] [Thread-6 ]: Compiling model.airbyte_utils.memento_sessions_ab2 2022-07-30 02:59:35 normalization > 02:57:39.090227 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.memento_states_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.109414 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.location_store_products_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.110295 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.oico_radar_products_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.110559 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:39.132494 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.freights_ab2 2022-07-30 02:59:35 normalization > 02:57:39.056581 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.freight_vehicle_types_ab2 2022-07-30 02:59:35 normalization > 02:57:39.133521 [debug] [Thread-8 ]: Began running node model.airbyte_utils.order_issues_ab2 2022-07-30 02:59:35 normalization > 02:57:39.131004 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.memento_sessions_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.131582 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.oico_radar_products_ab2 2022-07-30 02:59:35 normalization > 02:57:39.134957 [debug] [Thread-3 ]: Compiling model.airbyte_utils.oico_radar_products_ab2 2022-07-30 02:59:35 normalization > 02:57:39.132736 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:39.132930 [debug] [Thread-2 ]: Began running node model.airbyte_utils.oico_users_ab2 2022-07-30 02:59:35 normalization > 02:57:39.152155 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.oico_users_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.152341 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.oico_users_ab2 2022-07-30 02:59:35 normalization > 02:57:39.152466 [debug] [Thread-2 ]: Compiling model.airbyte_utils.oico_users_ab2 2022-07-30 02:59:35 normalization > 02:57:39.056862 [debug] [Thread-1 ]: Began running node model.airbyte_utils.order_feedbacks_ab2 2022-07-30 02:59:35 normalization > 02:57:39.146040 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.location_store_products_ab2 2022-07-30 02:59:35 normalization > 02:57:39.186371 [debug] [Thread-7 ]: Began running node model.airbyte_utils.orders_ab2 2022-07-30 02:59:35 normalization > 02:57:39.187050 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.orders_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.187217 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.orders_ab2 2022-07-30 02:59:35 normalization > 02:57:39.151413 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:39.190551 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.memento_sessions_ab2 2022-07-30 02:59:35 normalization > 02:57:39.190761 [debug] [Thread-6 ]: Began running node model.airbyte_utils.heya_campaign_receipts_ab2 2022-07-30 02:59:35 normalization > 02:57:39.134651 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:39.191936 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.memento_states_ab2 2022-07-30 02:59:35 normalization > 02:57:39.187340 [debug] [Thread-7 ]: Compiling model.airbyte_utils.orders_ab2 2022-07-30 02:59:35 normalization > 02:57:39.111492 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.oico_radars_ab2 2022-07-30 02:59:35 normalization > 02:57:39.200754 [debug] [Thread-5 ]: Began running node model.airbyte_utils.omie_accounts_ab2 2022-07-30 02:59:35 normalization > 02:57:39.176474 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.order_feedbacks_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.213366 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.order_feedbacks_ab2 2022-07-30 02:59:35 normalization > 02:57:39.213494 [debug] [Thread-1 ]: Compiling model.airbyte_utils.order_feedbacks_ab2 2022-07-30 02:59:35 normalization > 02:57:39.177862 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.oico_radar_products_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.192136 [debug] [Thread-4 ]: Began running node model.airbyte_utils.popular_searches_ab2 2022-07-30 02:59:35 normalization > 02:57:39.247186 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.popular_searches_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.213116 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.omie_accounts_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.273536 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.omie_accounts_ab2 2022-07-30 02:59:35 normalization > 02:57:39.273750 [debug] [Thread-5 ]: Compiling model.airbyte_utils.omie_accounts_ab2 2022-07-30 02:59:35 normalization > 02:57:39.191299 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.heya_campaign_receipts_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.321342 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.heya_campaign_receipts_ab2 2022-07-30 02:59:35 normalization > 02:57:39.336889 [debug] [Thread-6 ]: Compiling model.airbyte_utils.heya_campaign_receipts_ab2 2022-07-30 02:59:35 normalization > 02:57:39.246513 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.order_feedbacks_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.134098 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.order_issues_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.350272 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.order_issues_ab2 2022-07-30 02:59:35 normalization > 02:57:39.350493 [debug] [Thread-8 ]: Compiling model.airbyte_utils.order_issues_ab2 2022-07-30 02:59:35 normalization > 02:57:39.243293 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:39.336646 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.orders_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.357774 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:39.310505 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.omie_accounts_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.368443 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:39.357267 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.oico_radar_products_ab2 2022-07-30 02:59:35 normalization > 02:57:39.369434 [debug] [Thread-3 ]: Began running node model.airbyte_utils.payments_ab2 2022-07-30 02:59:35 normalization > 02:57:39.357505 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:39.392751 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.order_feedbacks_ab2 2022-07-30 02:59:35 normalization > 02:57:39.399677 [debug] [Thread-1 ]: Began running node model.airbyte_utils.payer_buyer_locations_ab2 2022-07-30 02:59:35 normalization > 02:57:39.400324 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.payer_buyer_locations_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.263287 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.popular_searches_ab2 2022-07-30 02:59:35 normalization > 02:57:39.400657 [debug] [Thread-4 ]: Compiling model.airbyte_utils.popular_searches_ab2 2022-07-30 02:59:35 normalization > 02:57:39.381212 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.heya_campaign_receipts_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.416423 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:39.399299 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.order_issues_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.422190 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:39.422881 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.order_issues_ab2 2022-07-30 02:59:35 normalization > 02:57:39.400513 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.payer_buyer_locations_ab2 2022-07-30 02:59:35 normalization > 02:57:39.369973 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.payments_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.358388 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.orders_ab2 2022-07-30 02:59:35 normalization > 02:57:39.417185 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.heya_campaign_receipts_ab2 2022-07-30 02:59:35 normalization > 02:57:39.421630 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.popular_searches_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.189720 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.oico_users_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.425163 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:39.423104 [debug] [Thread-8 ]: Began running node model.airbyte_utils.payers_ab2 2022-07-30 02:59:35 normalization > 02:57:39.423565 [debug] [Thread-1 ]: Compiling model.airbyte_utils.payer_buyer_locations_ab2 2022-07-30 02:59:35 normalization > 02:57:39.423742 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.payments_ab2 2022-07-30 02:59:35 normalization > 02:57:39.431910 [debug] [Thread-3 ]: Compiling model.airbyte_utils.payments_ab2 2022-07-30 02:59:35 normalization > 02:57:39.424056 [debug] [Thread-7 ]: Began running node model.airbyte_utils.product_canonical_categories_ab2 2022-07-30 02:59:35 normalization > 02:57:39.425805 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.oico_users_ab2 2022-07-30 02:59:35 normalization > 02:57:39.484492 [debug] [Thread-2 ]: Began running node model.airbyte_utils.payment_installments_ab2 2022-07-30 02:59:35 normalization > 02:57:39.426445 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.payers_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.485420 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.payers_ab2 2022-07-30 02:59:35 normalization > 02:57:39.485553 [debug] [Thread-8 ]: Compiling model.airbyte_utils.payers_ab2 2022-07-30 02:59:35 normalization > 02:57:39.424476 [debug] [Thread-6 ]: Began running node model.airbyte_utils.order_categories_ab2 2022-07-30 02:59:35 normalization > 02:57:39.522914 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.payments_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.369196 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.omie_accounts_ab2 2022-07-30 02:59:35 normalization > 02:57:39.524044 [debug] [Thread-5 ]: Began running node model.airbyte_utils.requested_products_ab2 2022-07-30 02:59:35 normalization > 02:57:39.524558 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.requested_products_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.467542 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.payer_buyer_locations_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.474645 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.product_canonical_categories_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.525596 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.product_canonical_categories_ab2 2022-07-30 02:59:35 normalization > 02:57:39.541197 [debug] [Thread-7 ]: Compiling model.airbyte_utils.product_canonical_categories_ab2 2022-07-30 02:59:35 normalization > 02:57:39.440617 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:39.558553 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.popular_searches_ab2 2022-07-30 02:59:35 normalization > 02:57:39.558781 [debug] [Thread-4 ]: Began running node model.airbyte_utils.reports_ab2 2022-07-30 02:59:35 normalization > 02:57:39.559259 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.reports_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.485203 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.payment_installments_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.559589 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.payment_installments_ab2 2022-07-30 02:59:35 normalization > 02:57:39.559709 [debug] [Thread-2 ]: Compiling model.airbyte_utils.payment_installments_ab2 2022-07-30 02:59:35 normalization > 02:57:39.524710 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.requested_products_ab2 2022-07-30 02:59:35 normalization > 02:57:39.569074 [debug] [Thread-5 ]: Compiling model.airbyte_utils.requested_products_ab2 2022-07-30 02:59:35 normalization > 02:57:39.525757 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:39.523668 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.order_categories_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.723890 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.order_categories_ab2 2022-07-30 02:59:35 normalization > 02:57:39.734435 [debug] [Thread-6 ]: Compiling model.airbyte_utils.order_categories_ab2 2022-07-30 02:59:35 normalization > 02:57:39.559426 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.reports_ab2 2022-07-30 02:59:35 normalization > 02:57:39.750912 [debug] [Thread-4 ]: Compiling model.airbyte_utils.reports_ab2 2022-07-30 02:59:35 normalization > 02:57:39.703983 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.payer_buyer_locations_ab2 2022-07-30 02:59:35 normalization > 02:57:39.557631 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:39.697959 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.payers_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.796356 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:39.796942 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.payers_ab2 2022-07-30 02:59:35 normalization > 02:57:39.767006 [debug] [Thread-1 ]: Began running node model.airbyte_utils.product_orders_ab2 2022-07-30 02:59:35 normalization > 02:57:39.798071 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.product_orders_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.798236 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.product_orders_ab2 2022-07-30 02:59:35 normalization > 02:57:39.795077 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.reports_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.795985 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.payments_ab2 2022-07-30 02:59:35 normalization > 02:57:39.708556 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.product_canonical_categories_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.799203 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:39.797145 [debug] [Thread-8 ]: Began running node model.airbyte_utils.products_ab2 2022-07-30 02:59:35 normalization > 02:57:39.778868 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.order_categories_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.791686 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.payment_installments_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.798377 [debug] [Thread-1 ]: Compiling model.airbyte_utils.product_orders_ab2 2022-07-30 02:59:35 normalization > 02:57:39.798633 [debug] [Thread-3 ]: Began running node model.airbyte_utils.roi_products_ab2 2022-07-30 02:59:35 normalization > 02:57:39.769069 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.requested_products_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.817977 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:39.818582 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.requested_products_ab2 2022-07-30 02:59:35 normalization > 02:57:39.811209 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:39.825292 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.payment_installments_ab2 2022-07-30 02:59:35 normalization > 02:57:39.817467 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.roi_products_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.851765 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.roi_products_ab2 2022-07-30 02:59:35 normalization > 02:57:39.852119 [debug] [Thread-3 ]: Compiling model.airbyte_utils.roi_products_ab2 2022-07-30 02:59:35 normalization > 02:57:39.817632 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:39.861539 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.order_categories_ab2 2022-07-30 02:59:35 normalization > 02:57:39.861850 [debug] [Thread-6 ]: Began running node model.airbyte_utils.spatial_ref_sys_ab2 2022-07-30 02:59:35 normalization > 02:57:39.862936 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.spatial_ref_sys_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.799791 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.product_canonical_categories_ab2 2022-07-30 02:59:35 normalization > 02:57:39.800345 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.products_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.881713 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.products_ab2 2022-07-30 02:59:35 normalization > 02:57:39.881847 [debug] [Thread-8 ]: Compiling model.airbyte_utils.products_ab2 2022-07-30 02:59:35 normalization > 02:57:39.818819 [debug] [Thread-5 ]: Began running node model.airbyte_utils.product_reports_ab2 2022-07-30 02:59:35 normalization > 02:57:39.863211 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.spatial_ref_sys_ab2 2022-07-30 02:59:35 normalization > 02:57:39.868921 [debug] [Thread-7 ]: Began running node model.airbyte_utils.schema_migrations_ab2 2022-07-30 02:59:35 normalization > 02:57:39.880262 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.product_orders_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.881469 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.roi_products_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.939254 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:39.940014 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.roi_products_ab2 2022-07-30 02:59:35 normalization > 02:57:39.940223 [debug] [Thread-3 ]: Began running node model.airbyte_utils.sidekiq_sequence_records_ab2 2022-07-30 02:59:35 normalization > 02:57:39.940701 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.sidekiq_sequence_records_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.940837 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.sidekiq_sequence_records_ab2 2022-07-30 02:59:35 normalization > 02:57:39.938834 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.products_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.816808 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:39.840987 [debug] [Thread-2 ]: Began running node model.airbyte_utils.product_canonicals_ab2 2022-07-30 02:59:35 normalization > 02:57:39.942810 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.product_canonicals_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.942946 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.product_canonicals_ab2 2022-07-30 02:59:35 normalization > 02:57:39.943059 [debug] [Thread-2 ]: Compiling model.airbyte_utils.product_canonicals_ab2 2022-07-30 02:59:35 normalization > 02:57:39.899278 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.product_reports_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.954344 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.product_reports_ab2 2022-07-30 02:59:35 normalization > 02:57:39.942286 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.reports_ab2 2022-07-30 02:59:35 normalization > 02:57:39.954957 [debug] [Thread-4 ]: Began running node model.airbyte_utils.shortened_urls_ab2 2022-07-30 02:59:35 normalization > 02:57:39.920001 [debug] [Thread-6 ]: Compiling model.airbyte_utils.spatial_ref_sys_ab2 2022-07-30 02:59:35 normalization > 02:57:39.940971 [debug] [Thread-3 ]: Compiling model.airbyte_utils.sidekiq_sequence_records_ab2 2022-07-30 02:59:35 normalization > 02:57:39.941608 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:39.954701 [debug] [Thread-5 ]: Compiling model.airbyte_utils.product_reports_ab2 2022-07-30 02:59:35 normalization > 02:57:39.920752 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.schema_migrations_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.030161 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.schema_migrations_ab2 2022-07-30 02:59:35 normalization > 02:57:39.985543 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.product_canonicals_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.030735 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:40.007065 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.product_orders_ab2 2022-07-30 02:59:35 normalization > 02:57:40.031719 [debug] [Thread-1 ]: Began running node model.airbyte_utils.store_order_quotes_ab2 2022-07-30 02:59:35 normalization > 02:57:40.029814 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.sidekiq_sequence_records_ab2" 2022-07-30 02:59:35 normalization > 02:57:39.955610 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.shortened_urls_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.030362 [debug] [Thread-7 ]: Compiling model.airbyte_utils.schema_migrations_ab2 2022-07-30 02:59:35 normalization > 02:57:40.010840 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.spatial_ref_sys_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.031482 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.product_canonicals_ab2 2022-07-30 02:59:35 normalization > 02:57:40.011076 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:40.032285 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.store_order_quotes_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.050811 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.product_reports_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.051143 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.shortened_urls_ab2 2022-07-30 02:59:35 normalization > 02:57:40.065307 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.schema_migrations_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.065797 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:40.066064 [debug] [Thread-2 ]: Began running node model.airbyte_utils.store_categories_ab2 2022-07-30 02:59:35 normalization > 02:57:40.066869 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.products_ab2 2022-07-30 02:59:35 normalization > 02:57:40.067075 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.store_order_quotes_ab2 2022-07-30 02:59:35 normalization > 02:57:40.067837 [debug] [Thread-4 ]: Compiling model.airbyte_utils.shortened_urls_ab2 2022-07-30 02:59:35 normalization > 02:57:40.068089 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:40.068362 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:40.069034 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.spatial_ref_sys_ab2 2022-07-30 02:59:35 normalization > 02:57:40.100079 [debug] [Thread-6 ]: Began running node model.airbyte_utils.stockout_events_ab2 2022-07-30 02:59:35 normalization > 02:57:40.100749 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.stockout_events_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.069702 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.store_categories_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.101193 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.store_categories_ab2 2022-07-30 02:59:35 normalization > 02:57:40.101315 [debug] [Thread-2 ]: Compiling model.airbyte_utils.store_categories_ab2 2022-07-30 02:59:35 normalization > 02:57:40.070673 [debug] [Thread-1 ]: Compiling model.airbyte_utils.store_order_quotes_ab2 2022-07-30 02:59:35 normalization > 02:57:40.099789 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.shortened_urls_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.070025 [debug] [Thread-8 ]: Began running node model.airbyte_utils.stores_ab2 2022-07-30 02:59:35 normalization > 02:57:40.070462 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:40.150649 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.schema_migrations_ab2 2022-07-30 02:59:35 normalization > 02:57:40.150877 [debug] [Thread-7 ]: Began running node model.airbyte_utils.responsible_deliveries_ab2 2022-07-30 02:59:35 normalization > 02:57:40.101043 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.stockout_events_ab2 2022-07-30 02:59:35 normalization > 02:57:40.151568 [debug] [Thread-6 ]: Compiling model.airbyte_utils.stockout_events_ab2 2022-07-30 02:59:35 normalization > 02:57:40.131415 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.store_categories_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.158587 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:40.159294 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.store_categories_ab2 2022-07-30 02:59:35 normalization > 02:57:40.165006 [debug] [Thread-2 ]: Began running node model.airbyte_utils.store_locations_ab2 2022-07-30 02:59:35 normalization > 02:57:40.165571 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.store_locations_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.165721 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.store_locations_ab2 2022-07-30 02:59:35 normalization > 02:57:40.082981 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.product_reports_ab2 2022-07-30 02:59:35 normalization > 02:57:40.149795 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.store_order_quotes_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.164778 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:40.172727 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.shortened_urls_ab2 2022-07-30 02:59:35 normalization > 02:57:40.172953 [debug] [Thread-4 ]: Began running node model.airbyte_utils.store_users_ab2 2022-07-30 02:59:35 normalization > 02:57:40.173433 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.store_users_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.165864 [debug] [Thread-2 ]: Compiling model.airbyte_utils.store_locations_ab2 2022-07-30 02:59:35 normalization > 02:57:40.166056 [debug] [Thread-5 ]: Began running node model.airbyte_utils.terms_ab2 2022-07-30 02:59:35 normalization > 02:57:40.166803 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:40.212903 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.store_order_quotes_ab2 2022-07-30 02:59:35 normalization > 02:57:40.151342 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.responsible_deliveries_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.216674 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.responsible_deliveries_ab2 2022-07-30 02:59:35 normalization > 02:57:40.181055 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.stockout_events_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.217150 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:40.217794 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.stockout_events_ab2 2022-07-30 02:59:35 normalization > 02:57:40.217980 [debug] [Thread-6 ]: Began running node model.airbyte_utils.transfeera_batches_ab2 2022-07-30 02:59:35 normalization > 02:57:40.218460 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.transfeera_batches_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.216376 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.store_locations_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.216837 [debug] [Thread-7 ]: Compiling model.airbyte_utils.responsible_deliveries_ab2 2022-07-30 02:59:35 normalization > 02:57:40.139501 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.stores_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.082291 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.sidekiq_sequence_records_ab2 2022-07-30 02:59:35 normalization > 02:57:40.202595 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.terms_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.244539 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.terms_ab2 2022-07-30 02:59:35 normalization > 02:57:40.244678 [debug] [Thread-5 ]: Compiling model.airbyte_utils.terms_ab2 2022-07-30 02:59:35 normalization > 02:57:40.218608 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.transfeera_batches_ab2 2022-07-30 02:59:35 normalization > 02:57:40.265808 [debug] [Thread-6 ]: Compiling model.airbyte_utils.transfeera_batches_ab2 2022-07-30 02:59:35 normalization > 02:57:40.269625 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.terms_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.290166 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:40.240557 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:40.181289 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.store_users_ab2 2022-07-30 02:59:35 normalization > 02:57:40.291856 [debug] [Thread-4 ]: Compiling model.airbyte_utils.store_users_ab2 2022-07-30 02:59:35 normalization > 02:57:40.213174 [debug] [Thread-1 ]: Began running node model.airbyte_utils.term_acceptances_ab2 2022-07-30 02:59:35 normalization > 02:57:40.322247 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.term_acceptances_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.289736 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.transfeera_batches_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.244257 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.responsible_deliveries_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.291016 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.terms_ab2 2022-07-30 02:59:35 normalization > 02:57:40.229808 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.stores_ab2 2022-07-30 02:59:35 normalization > 02:57:40.324495 [debug] [Thread-8 ]: Compiling model.airbyte_utils.stores_ab2 2022-07-30 02:59:35 normalization > 02:57:40.240839 [debug] [Thread-3 ]: Began running node model.airbyte_utils.buyer_contact_rules_stg 2022-07-30 02:59:35 normalization > 02:57:40.323041 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.store_users_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.323295 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.term_acceptances_ab2 2022-07-30 02:59:35 normalization > 02:57:40.323881 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:40.332053 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.transfeera_batches_ab2 2022-07-30 02:59:35 normalization > 02:57:40.324337 [debug] [Thread-5 ]: Began running node model.airbyte_utils.buyer_contacts_stg 2022-07-30 02:59:35 normalization > 02:57:40.338163 [info ] [Thread-5 ]: 2 of 201 START view model _airbyte_airbyte_cdc.buyer_contacts_stg....................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:40.330794 [info ] [Thread-3 ]: 1 of 201 START view model _airbyte_airbyte_cdc.buyer_contact_rules_stg.................................................. [RUN] 2022-07-30 02:59:35 normalization > 02:57:40.340947 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_contact_rules_stg" 2022-07-30 02:59:35 normalization > 02:57:40.341122 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.buyer_contact_rules_stg 2022-07-30 02:59:35 normalization > 02:57:40.332275 [debug] [Thread-6 ]: Began running node model.airbyte_utils.store_orders_ab2 2022-07-30 02:59:35 normalization > 02:57:40.362489 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.store_orders_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.378166 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.store_orders_ab2 2022-07-30 02:59:35 normalization > 02:57:40.331309 [debug] [Thread-1 ]: Compiling model.airbyte_utils.term_acceptances_ab2 2022-07-30 02:59:35 normalization > 02:57:40.388239 [debug] [Thread-6 ]: Compiling model.airbyte_utils.store_orders_ab2 2022-07-30 02:59:35 normalization > 02:57:40.324103 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:40.341279 [debug] [Thread-3 ]: Compiling model.airbyte_utils.buyer_contact_rules_stg 2022-07-30 02:59:35 normalization > 02:57:40.291676 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.store_locations_ab2 2022-07-30 02:59:35 normalization > 02:57:40.338480 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:40.387923 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.stores_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.461221 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:40.461781 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.stores_ab2 2022-07-30 02:59:35 normalization > 02:57:40.461953 [debug] [Thread-8 ]: Began running node model.airbyte_utils.active_storage_attachments_stg 2022-07-30 02:59:35 normalization > 02:57:40.462178 [info ] [Thread-8 ]: 4 of 201 START view model _airbyte_airbyte_cdc.active_storage_attachments_stg........................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:40.456118 [debug] [Thread-2 ]: Began running node model.airbyte_utils.buyer_locations_stg 2022-07-30 02:59:35 normalization > 02:57:40.415875 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.responsible_deliveries_ab2 2022-07-30 02:59:35 normalization > 02:57:40.463186 [debug] [Thread-7 ]: Began running node model.airbyte_utils.active_storage_variant_records_stg 2022-07-30 02:59:35 normalization > 02:57:40.409796 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.term_acceptances_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.464893 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:40.465443 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.term_acceptances_ab2 2022-07-30 02:59:35 normalization > 02:57:40.465610 [debug] [Thread-1 ]: Began running node model.airbyte_utils.buyer_uploads_stg 2022-07-30 02:59:35 normalization > 02:57:40.459959 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.buyer_contact_rules_stg" 2022-07-30 02:59:35 normalization > 02:57:40.463463 [info ] [Thread-7 ]: 5 of 201 START view model _airbyte_airbyte_cdc.active_storage_variant_records_stg....................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:40.460859 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.store_users_ab2 2022-07-30 02:59:35 normalization > 02:57:40.464555 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.active_storage_attachments_stg" 2022-07-30 02:59:35 normalization > 02:57:40.468136 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.active_storage_attachments_stg 2022-07-30 02:59:35 normalization > 02:57:40.339781 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_contacts_stg" 2022-07-30 02:59:35 normalization > 02:57:40.468399 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.buyer_contacts_stg 2022-07-30 02:59:35 normalization > 02:57:40.468502 [debug] [Thread-5 ]: Compiling model.airbyte_utils.buyer_contacts_stg 2022-07-30 02:59:35 normalization > 02:57:40.462837 [info ] [Thread-2 ]: 3 of 201 START view model _airbyte_airbyte_cdc.buyer_locations_stg...................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:40.475269 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:40.465811 [info ] [Thread-1 ]: 6 of 201 START view model _airbyte_airbyte_cdc.buyer_uploads_stg........................................................ [RUN] 2022-07-30 02:59:35 normalization > 02:57:40.467338 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.active_storage_variant_records_stg" 2022-07-30 02:59:35 normalization > 02:57:40.468280 [debug] [Thread-8 ]: Compiling model.airbyte_utils.active_storage_attachments_stg 2022-07-30 02:59:35 normalization > 02:57:40.433179 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.store_orders_ab2" 2022-07-30 02:59:35 normalization > 02:57:40.486745 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:40.475777 [debug] [Thread-3 ]: Began executing node model.airbyte_utils.buyer_contact_rules_stg 2022-07-30 02:59:35 normalization > 02:57:40.476171 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.active_storage_variant_records_stg 2022-07-30 02:59:35 normalization > 02:57:40.485001 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_locations_stg" 2022-07-30 02:59:35 normalization > 02:57:40.517611 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.buyer_locations_stg 2022-07-30 02:59:35 normalization > 02:57:40.517781 [debug] [Thread-2 ]: Compiling model.airbyte_utils.buyer_locations_stg 2022-07-30 02:59:35 normalization > 02:57:40.487700 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.store_orders_ab2 2022-07-30 02:59:35 normalization > 02:57:40.508504 [debug] [Thread-7 ]: Compiling model.airbyte_utils.active_storage_variant_records_stg 2022-07-30 02:59:35 normalization > 02:57:40.517275 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.buyer_contacts_stg" 2022-07-30 02:59:35 normalization > 02:57:40.486154 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_uploads_stg" 2022-07-30 02:59:35 normalization > 02:57:40.609230 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.buyer_uploads_stg 2022-07-30 02:59:35 normalization > 02:57:40.609390 [debug] [Thread-1 ]: Compiling model.airbyte_utils.buyer_uploads_stg 2022-07-30 02:59:35 normalization > 02:57:40.467725 [debug] [Thread-4 ]: Began running node model.airbyte_utils.categories_stg 2022-07-30 02:59:35 normalization > 02:57:40.633396 [info ] [Thread-4 ]: 7 of 201 START view model _airbyte_airbyte_cdc.categories_stg........................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:40.533496 [debug] [Thread-6 ]: Began running node model.airbyte_utils.buyer_public_informations_stg 2022-07-30 02:59:35 normalization > 02:57:40.635182 [info ] [Thread-6 ]: 8 of 201 START view model _airbyte_airbyte_cdc.buyer_public_informations_stg............................................ [RUN] 2022-07-30 02:59:35 normalization > 02:57:40.608863 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.active_storage_variant_records_stg" 2022-07-30 02:59:35 normalization > 02:57:40.634717 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.categories_stg" 2022-07-30 02:59:35 normalization > 02:57:40.652211 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.categories_stg 2022-07-30 02:59:35 normalization > 02:57:40.652370 [debug] [Thread-4 ]: Compiling model.airbyte_utils.categories_stg 2022-07-30 02:59:35 normalization > 02:57:40.636353 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_public_informations_stg" 2022-07-30 02:59:35 normalization > 02:57:40.643264 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:40.678248 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.buyer_contacts_stg 2022-07-30 02:59:35 normalization > 02:57:40.651832 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.buyer_uploads_stg" 2022-07-30 02:59:35 normalization > 02:57:40.684966 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:40.685120 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.buyer_uploads_stg 2022-07-30 02:59:35 normalization > 02:57:40.632851 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.active_storage_attachments_stg" 2022-07-30 02:59:35 normalization > 02:57:40.689297 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:40.689447 [debug] [Thread-8 ]: Began executing node model.airbyte_utils.active_storage_attachments_stg 2022-07-30 02:59:35 normalization > 02:57:40.688914 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.buyer_uploads_stg" 2022-07-30 02:59:35 normalization > 02:57:40.617963 [debug] [Thread-3 ]: Writing runtime SQL for node "model.airbyte_utils.buyer_contact_rules_stg" 2022-07-30 02:59:35 normalization > 02:57:40.693883 [debug] [Thread-3 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:40.695625 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:40.668128 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.buyer_public_informations_stg 2022-07-30 02:59:35 normalization > 02:57:40.699513 [debug] [Thread-6 ]: Compiling model.airbyte_utils.buyer_public_informations_stg 2022-07-30 02:59:35 normalization > 02:57:40.677882 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.categories_stg" 2022-07-30 02:59:35 normalization > 02:57:40.693253 [debug] [Thread-8 ]: Writing runtime SQL for node "model.airbyte_utils.active_storage_attachments_stg" 2022-07-30 02:59:35 normalization > 02:57:40.684597 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.buyer_contacts_stg" 2022-07-30 02:59:35 normalization > 02:57:40.643044 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.buyer_locations_stg" 2022-07-30 02:59:35 normalization > 02:57:40.732389 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:40.732535 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.buyer_locations_stg 2022-07-30 02:59:35 normalization > 02:57:40.730958 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.buyer_public_informations_stg" 2022-07-30 02:59:35 normalization > 02:57:40.731292 [debug] [Thread-3 ]: On model.airbyte_utils.buyer_contact_rules_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_contact_rules_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`buyer_contact_rules_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__buyer_contact_rules_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_buyer_contact_rules 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['order_id']") as order_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['categories']") as categories, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['buyer_contact_id']") as buyer_contact_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['buyer_location_id']") as buyer_location_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_buyer_contact_rules as table_alias 2022-07-30 02:59:35 normalization > -- buyer_contact_rules 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__buyer_contact_rules_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__buyer_contact_rules_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(order_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as order_id, 2022-07-30 02:59:35 normalization > cast(categories as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as categories, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(buyer_contact_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as buyer_contact_id, 2022-07-30 02:59:35 normalization > cast(buyer_location_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as buyer_location_id, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__buyer_contact_rules_ab1 2022-07-30 02:59:35 normalization > -- buyer_contact_rules 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__buyer_contact_rules_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(order_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(categories as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(buyer_contact_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(buyer_location_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_buyer_contact_rules_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__buyer_contact_rules_ab2 tmp 2022-07-30 02:59:35 normalization > -- buyer_contact_rules 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:40.731514 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:40.732106 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:40.683597 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:40.718712 [debug] [Thread-1 ]: On model.airbyte_utils.buyer_uploads_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_uploads_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`buyer_uploads_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__buyer_uploads_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_buyer_uploads 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['done']") as done, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['buyer_id']") as buyer_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['file_url']") as file_url, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['filename']") as filename, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['file_type']") as file_type, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['buyer_user_id']") as buyer_user_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_buyer_uploads as table_alias 2022-07-30 02:59:35 normalization > -- buyer_uploads 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__buyer_uploads_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__buyer_uploads_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(done as boolean) as done, 2022-07-30 02:59:35 normalization > cast(buyer_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as buyer_id, 2022-07-30 02:59:35 normalization > cast(file_url as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as file_url, 2022-07-30 02:59:35 normalization > cast(filename as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as filename, 2022-07-30 02:59:35 normalization > cast(file_type as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as file_type, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(buyer_user_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as buyer_user_id, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__buyer_uploads_ab1 2022-07-30 02:59:35 normalization > -- buyer_uploads 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__buyer_uploads_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(done as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(buyer_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(file_url as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(filename as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(file_type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(buyer_user_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_buyer_uploads_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__buyer_uploads_ab2 tmp 2022-07-30 02:59:35 normalization > -- buyer_uploads 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:40.736646 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.buyer_locations_stg" 2022-07-30 02:59:35 normalization > 02:57:40.736952 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:40.740160 [debug] [Thread-4 ]: Began executing node model.airbyte_utils.categories_stg 2022-07-30 02:59:35 normalization > 02:57:40.740688 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:40.740919 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.active_storage_variant_records_stg 2022-07-30 02:59:35 normalization > 02:57:40.750045 [debug] [Thread-4 ]: Writing runtime SQL for node "model.airbyte_utils.categories_stg" 2022-07-30 02:59:35 normalization > 02:57:40.762765 [debug] [Thread-4 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:40.763560 [debug] [Thread-8 ]: On model.airbyte_utils.active_storage_attachments_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.active_storage_attachments_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`active_storage_attachments_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__active_storage_attachments_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_active_storage_attachments 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['name']") as name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['blob_id']") as blob_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['record_id']") as record_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['record_type']") as record_type, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_active_storage_attachments as table_alias 2022-07-30 02:59:35 normalization > -- active_storage_attachments 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__active_storage_attachments_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__active_storage_attachments_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as name, 2022-07-30 02:59:35 normalization > cast(blob_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as blob_id, 2022-07-30 02:59:35 normalization > cast(record_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as record_id, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(record_type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as record_type, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__active_storage_attachments_ab1 2022-07-30 02:59:35 normalization > -- active_storage_attachments 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__active_storage_attachments_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(blob_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(record_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(record_type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_active_storage_attachments_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__active_storage_attachments_ab2 tmp 2022-07-30 02:59:35 normalization > -- active_storage_attachments 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:40.757565 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:40.762268 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.active_storage_variant_records_stg" 2022-07-30 02:59:35 normalization > 02:57:40.770878 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:40.753886 [debug] [Thread-6 ]: Began executing node model.airbyte_utils.buyer_public_informations_stg 2022-07-30 02:59:35 normalization > 02:57:40.769999 [debug] [Thread-4 ]: On model.airbyte_utils.categories_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.categories_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`categories_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__categories_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_categories 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['name']") as name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['level']") as level, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['category_id']") as category_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['visible_on_store_sign_up']") as visible_on_store_sign_up, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_categories as table_alias 2022-07-30 02:59:35 normalization > -- categories 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__categories_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__categories_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as name, 2022-07-30 02:59:35 normalization > cast(level as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as level, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(category_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as category_id, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cast(visible_on_store_sign_up as boolean) as visible_on_store_sign_up, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__categories_ab1 2022-07-30 02:59:35 normalization > -- categories 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__categories_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(level as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(category_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(visible_on_store_sign_up as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_categories_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__categories_ab2 tmp 2022-07-30 02:59:35 normalization > -- categories 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:40.753499 [debug] [Thread-5 ]: On model.airbyte_utils.buyer_contacts_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_contacts_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`buyer_contacts_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__buyer_contacts_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_buyer_contacts 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['name']") as name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['email']") as email, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['buyer_id']") as buyer_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['phone_number']") as phone_number, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_buyer_contacts as table_alias 2022-07-30 02:59:35 normalization > -- buyer_contacts 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__buyer_contacts_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__buyer_contacts_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as name, 2022-07-30 02:59:35 normalization > cast(email as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as email, 2022-07-30 02:59:35 normalization > cast(buyer_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as buyer_id, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(phone_number as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as phone_number, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__buyer_contacts_ab1 2022-07-30 02:59:35 normalization > -- buyer_contacts 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__buyer_contacts_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(email as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(buyer_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(phone_number as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_buyer_contacts_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__buyer_contacts_ab2 tmp 2022-07-30 02:59:35 normalization > -- buyer_contacts 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:40.785145 [debug] [Thread-6 ]: Writing runtime SQL for node "model.airbyte_utils.buyer_public_informations_stg" 2022-07-30 02:59:35 normalization > 02:57:40.789184 [debug] [Thread-2 ]: On model.airbyte_utils.buyer_locations_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_locations_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`buyer_locations_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__buyer_locations_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_buyer_locations 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['lat']") as lat, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['lng']") as lng, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['city']") as city, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['name']") as name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['state']") as state, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['street']") as street, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['zipcode']") as zipcode, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['buyer_id']") as buyer_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['location']") as location, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['address_details']") as address_details, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['google_place_id']") as google_place_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_buyer_locations as table_alias 2022-07-30 02:59:35 normalization > -- buyer_locations 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__buyer_locations_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__buyer_locations_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(lat as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as lat, 2022-07-30 02:59:35 normalization > cast(lng as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as lng, 2022-07-30 02:59:35 normalization > cast(city as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as city, 2022-07-30 02:59:35 normalization > cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as name, 2022-07-30 02:59:35 normalization > cast(state as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as state, 2022-07-30 02:59:35 normalization > cast(street as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as street, 2022-07-30 02:59:35 normalization > cast(zipcode as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as zipcode, 2022-07-30 02:59:35 normalization > cast(buyer_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as buyer_id, 2022-07-30 02:59:35 normalization > cast(location as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as location, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(address_details as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as address_details, 2022-07-30 02:59:35 normalization > cast(google_place_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as google_place_id, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__buyer_locations_ab1 2022-07-30 02:59:35 normalization > -- buyer_locations 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__buyer_locations_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(lat as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(lng as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(city as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(state as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(street as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(zipcode as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(buyer_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(location as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(address_details as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(google_place_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_buyer_locations_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__buyer_locations_ab2 tmp 2022-07-30 02:59:35 normalization > -- buyer_locations 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:40.793308 [debug] [Thread-7 ]: On model.airbyte_utils.active_storage_variant_records_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.active_storage_variant_records_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`active_storage_variant_records_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__active_storage_variant_records_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_active_storage_variant_records 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['blob_id']") as blob_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['variation_digest']") as variation_digest, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_active_storage_variant_records as table_alias 2022-07-30 02:59:35 normalization > -- active_storage_variant_records 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__active_storage_variant_records_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__active_storage_variant_records_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(blob_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as blob_id, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(variation_digest as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as variation_digest, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__active_storage_variant_records_ab1 2022-07-30 02:59:35 normalization > -- active_storage_variant_records 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__active_storage_variant_records_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(blob_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(variation_digest as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_active_storage_variant_records_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__active_storage_variant_records_ab2 tmp 2022-07-30 02:59:35 normalization > -- active_storage_variant_records 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:40.812788 [debug] [Thread-6 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:40.840023 [debug] [Thread-6 ]: On model.airbyte_utils.buyer_public_informations_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_public_informations_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`buyer_public_informations_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__buyer_public_informations_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_buyer_public_informations 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['type']") as type, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['score']") as score, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['buyer_id']") as buyer_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['response']") as response, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['recommended_term_limit']") as recommended_term_limit, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['recommended_spend_limit']") as recommended_spend_limit, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_buyer_public_informations as table_alias 2022-07-30 02:59:35 normalization > -- buyer_public_informations 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__buyer_public_informations_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__buyer_public_informations_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(type as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as type, 2022-07-30 02:59:35 normalization > cast(score as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as score, 2022-07-30 02:59:35 normalization > cast(buyer_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as buyer_id, 2022-07-30 02:59:35 normalization > cast(response as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as response, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cast(recommended_term_limit as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as recommended_term_limit, 2022-07-30 02:59:35 normalization > cast(recommended_spend_limit as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as recommended_spend_limit, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__buyer_public_informations_ab1 2022-07-30 02:59:35 normalization > -- buyer_public_informations 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__buyer_public_informations_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(score as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(buyer_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(response as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(recommended_term_limit as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(recommended_spend_limit as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_buyer_public_informations_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__buyer_public_informations_ab2 tmp 2022-07-30 02:59:35 normalization > -- buyer_public_informations 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:41.436856 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:41.437734 [info ] [Thread-1 ]: 6 of 201 OK created view model _airbyte_airbyte_cdc.buyer_uploads_stg................................................... [OK in 0.95s] 2022-07-30 02:59:35 normalization > 02:57:41.438386 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.buyer_uploads_stg 2022-07-30 02:59:35 normalization > 02:57:41.438708 [debug] [Thread-1 ]: Began running node model.airbyte_utils.ar_internal_metadata_stg 2022-07-30 02:59:35 normalization > 02:57:41.439404 [info ] [Thread-1 ]: 9 of 201 START view model _airbyte_airbyte_cdc.ar_internal_metadata_stg................................................. [RUN] 2022-07-30 02:59:35 normalization > 02:57:41.440348 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.ar_internal_metadata_stg" 2022-07-30 02:59:35 normalization > 02:57:41.440533 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.ar_internal_metadata_stg 2022-07-30 02:59:35 normalization > 02:57:41.440669 [debug] [Thread-1 ]: Compiling model.airbyte_utils.ar_internal_metadata_stg 2022-07-30 02:59:35 normalization > 02:57:41.462076 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.ar_internal_metadata_stg" 2022-07-30 02:59:35 normalization > 02:57:41.462530 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:41.462683 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.ar_internal_metadata_stg 2022-07-30 02:59:35 normalization > 02:57:41.466843 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.ar_internal_metadata_stg" 2022-07-30 02:59:35 normalization > 02:57:41.467320 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:41.471819 [debug] [Thread-1 ]: On model.airbyte_utils.ar_internal_metadata_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.ar_internal_metadata_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`ar_internal_metadata_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__ar_internal_metadata_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_ar_internal_metadata 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['key']") as key, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['value']") as value, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_ar_internal_metadata as table_alias 2022-07-30 02:59:35 normalization > -- ar_internal_metadata 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__ar_internal_metadata_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__ar_internal_metadata_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as key, 2022-07-30 02:59:35 normalization > cast(value as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as value, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__ar_internal_metadata_ab1 2022-07-30 02:59:35 normalization > -- ar_internal_metadata 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__ar_internal_metadata_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(value as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_ar_internal_metadata_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__ar_internal_metadata_ab2 tmp 2022-07-30 02:59:35 normalization > -- ar_internal_metadata 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:41.657244 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:41.659828 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:41.660738 [info ] [Thread-7 ]: 5 of 201 OK created view model _airbyte_airbyte_cdc.active_storage_variant_records_stg.................................. [OK in 1.19s] 2022-07-30 02:59:35 normalization > 02:57:41.661527 [info ] [Thread-2 ]: 3 of 201 OK created view model _airbyte_airbyte_cdc.buyer_locations_stg................................................. [OK in 1.18s] 2022-07-30 02:59:35 normalization > 02:57:41.662265 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.active_storage_variant_records_stg 2022-07-30 02:59:35 normalization > 02:57:41.662573 [debug] [Thread-7 ]: Began running node model.airbyte_utils.active_storage_blobs_stg 2022-07-30 02:59:35 normalization > 02:57:41.662925 [info ] [Thread-7 ]: 10 of 201 START view model _airbyte_airbyte_cdc.active_storage_blobs_stg................................................ [RUN] 2022-07-30 02:59:35 normalization > 02:57:41.663888 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.buyer_locations_stg 2022-07-30 02:59:35 normalization > 02:57:41.664226 [debug] [Thread-2 ]: Began running node model.airbyte_utils.changebase_metadata_stg 2022-07-30 02:59:35 normalization > 02:57:41.664832 [info ] [Thread-2 ]: 11 of 201 START view model _airbyte_airbyte_cdc.changebase_metadata_stg................................................. [RUN] 2022-07-30 02:59:35 normalization > 02:57:41.667736 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:41.668485 [info ] [Thread-8 ]: 4 of 201 OK created view model _airbyte_airbyte_cdc.active_storage_attachments_stg...................................... [OK in 1.20s] 2022-07-30 02:59:35 normalization > 02:57:41.669474 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.active_storage_blobs_stg" 2022-07-30 02:59:35 normalization > 02:57:41.669741 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.active_storage_blobs_stg 2022-07-30 02:59:35 normalization > 02:57:41.670043 [debug] [Thread-7 ]: Compiling model.airbyte_utils.active_storage_blobs_stg 2022-07-30 02:59:35 normalization > 02:57:41.670677 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.changebase_metadata_stg" 2022-07-30 02:59:35 normalization > 02:57:41.670969 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.active_storage_attachments_stg 2022-07-30 02:59:35 normalization > 02:57:41.701598 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.active_storage_blobs_stg" 2022-07-30 02:59:35 normalization > 02:57:41.710778 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:41.709731 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:41.710037 [debug] [Thread-8 ]: Began running node model.airbyte_utils.faq_stg 2022-07-30 02:59:35 normalization > 02:57:41.710958 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.active_storage_blobs_stg 2022-07-30 02:59:35 normalization > 02:57:41.707562 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.changebase_metadata_stg 2022-07-30 02:59:35 normalization > 02:57:41.712109 [info ] [Thread-8 ]: 12 of 201 START view model _airbyte_airbyte_cdc.faq_stg................................................................. [RUN] 2022-07-30 02:59:35 normalization > 02:57:41.718043 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.faq_stg" 2022-07-30 02:59:35 normalization > 02:57:41.716442 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.active_storage_blobs_stg" 2022-07-30 02:59:35 normalization > 02:57:41.718263 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.faq_stg 2022-07-30 02:59:35 normalization > 02:57:41.711812 [info ] [Thread-6 ]: 8 of 201 OK created view model _airbyte_airbyte_cdc.buyer_public_informations_stg....................................... [OK in 1.08s] 2022-07-30 02:59:35 normalization > 02:57:41.716726 [debug] [Thread-2 ]: Compiling model.airbyte_utils.changebase_metadata_stg 2022-07-30 02:59:35 normalization > 02:57:41.718527 [debug] [Thread-8 ]: Compiling model.airbyte_utils.faq_stg 2022-07-30 02:59:35 normalization > 02:57:41.739532 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:41.739915 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.buyer_public_informations_stg 2022-07-30 02:59:35 normalization > 02:57:41.758039 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.changebase_metadata_stg" 2022-07-30 02:59:35 normalization > 02:57:41.777336 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:41.777490 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.changebase_metadata_stg 2022-07-30 02:59:35 normalization > 02:57:41.770779 [debug] [Thread-6 ]: Began running node model.airbyte_utils.flipper_features_stg 2022-07-30 02:59:35 normalization > 02:57:41.782739 [info ] [Thread-6 ]: 13 of 201 START view model _airbyte_airbyte_cdc.flipper_features_stg.................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:41.774545 [debug] [Thread-7 ]: On model.airbyte_utils.active_storage_blobs_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.active_storage_blobs_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`active_storage_blobs_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__active_storage_blobs_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_active_storage_blobs 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['key']") as key, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['checksum']") as checksum, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['filename']") as filename, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['metadata']") as metadata, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['byte_size']") as byte_size, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['content_type']") as content_type, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['service_name']") as service_name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_active_storage_blobs as table_alias 2022-07-30 02:59:35 normalization > -- active_storage_blobs 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__active_storage_blobs_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__active_storage_blobs_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as key, 2022-07-30 02:59:35 normalization > cast(checksum as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as checksum, 2022-07-30 02:59:35 normalization > cast(filename as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as filename, 2022-07-30 02:59:35 normalization > cast(metadata as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as metadata, 2022-07-30 02:59:35 normalization > cast(byte_size as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as byte_size, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(content_type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as content_type, 2022-07-30 02:59:35 normalization > cast(service_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as service_name, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__active_storage_blobs_ab1 2022-07-30 02:59:35 normalization > -- active_storage_blobs 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__active_storage_blobs_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(checksum as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(filename as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(metadata as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(byte_size as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(content_type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(service_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_active_storage_blobs_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__active_storage_blobs_ab2 tmp 2022-07-30 02:59:35 normalization > -- active_storage_blobs 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:41.776963 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:41.770398 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:41.786070 [info ] [Thread-3 ]: 1 of 201 OK created view model _airbyte_airbyte_cdc.buyer_contact_rules_stg............................................. [OK in 1.45s] 2022-07-30 02:59:35 normalization > 02:57:41.782346 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.changebase_metadata_stg" 2022-07-30 02:59:35 normalization > 02:57:41.773457 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:41.783757 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.flipper_features_stg" 2022-07-30 02:59:35 normalization > 02:57:41.787842 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.flipper_features_stg 2022-07-30 02:59:35 normalization > 02:57:41.787972 [debug] [Thread-6 ]: Compiling model.airbyte_utils.flipper_features_stg 2022-07-30 02:59:35 normalization > 02:57:41.784789 [info ] [Thread-5 ]: 2 of 201 OK created view model _airbyte_airbyte_cdc.buyer_contacts_stg.................................................. [OK in 1.45s] 2022-07-30 02:59:35 normalization > 02:57:41.787602 [info ] [Thread-4 ]: 7 of 201 OK created view model _airbyte_airbyte_cdc.categories_stg...................................................... [OK in 1.15s] 2022-07-30 02:59:35 normalization > 02:57:41.786550 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.buyer_contact_rules_stg 2022-07-30 02:59:35 normalization > 02:57:41.766694 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.faq_stg" 2022-07-30 02:59:35 normalization > 02:57:41.797200 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.buyer_contacts_stg 2022-07-30 02:59:35 normalization > 02:57:41.798452 [debug] [Thread-3 ]: Began running node model.airbyte_utils.buyer_store_recommendations_stg 2022-07-30 02:59:35 normalization > 02:57:41.799021 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.categories_stg 2022-07-30 02:59:35 normalization > 02:57:41.799600 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:41.802415 [debug] [Thread-5 ]: Began running node model.airbyte_utils.freight_partners_stg 2022-07-30 02:59:35 normalization > 02:57:41.802960 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:41.811957 [info ] [Thread-3 ]: 14 of 201 START view model _airbyte_airbyte_cdc.buyer_store_recommendations_stg......................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:41.822486 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_store_recommendations_stg" 2022-07-30 02:59:35 normalization > 02:57:41.822710 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.buyer_store_recommendations_stg 2022-07-30 02:59:35 normalization > 02:57:41.822888 [debug] [Thread-3 ]: Compiling model.airbyte_utils.buyer_store_recommendations_stg 2022-07-30 02:59:35 normalization > 02:57:41.820630 [debug] [Thread-8 ]: Began executing node model.airbyte_utils.faq_stg 2022-07-30 02:59:35 normalization > 02:57:41.816755 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.flipper_features_stg" 2022-07-30 02:59:35 normalization > 02:57:41.819036 [debug] [Thread-4 ]: Began running node model.airbyte_utils.buyers_stg 2022-07-30 02:59:35 normalization > 02:57:41.935309 [info ] [Thread-4 ]: 16 of 201 START view model _airbyte_airbyte_cdc.buyers_stg.............................................................. [RUN] 2022-07-30 02:59:35 normalization > 02:57:41.829051 [debug] [Thread-2 ]: On model.airbyte_utils.changebase_metadata_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.changebase_metadata_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`changebase_metadata_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__changebase_metadata_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_changebase_metadata 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['data']") as data, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['version']") as version, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_changebase_metadata as table_alias 2022-07-30 02:59:35 normalization > -- changebase_metadata 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__changebase_metadata_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__changebase_metadata_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(data as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as data, 2022-07-30 02:59:35 normalization > cast(version as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as version, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__changebase_metadata_ab1 2022-07-30 02:59:35 normalization > -- changebase_metadata 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__changebase_metadata_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(data as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(version as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_changebase_metadata_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__changebase_metadata_ab2 tmp 2022-07-30 02:59:35 normalization > -- changebase_metadata 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:41.933868 [debug] [Thread-8 ]: Writing runtime SQL for node "model.airbyte_utils.faq_stg" 2022-07-30 02:59:35 normalization > 02:57:41.819693 [info ] [Thread-5 ]: 15 of 201 START view model _airbyte_airbyte_cdc.freight_partners_stg.................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:41.938924 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:41.942662 [debug] [Thread-6 ]: Began executing node model.airbyte_utils.flipper_features_stg 2022-07-30 02:59:35 normalization > 02:57:41.947034 [debug] [Thread-6 ]: Writing runtime SQL for node "model.airbyte_utils.flipper_features_stg" 2022-07-30 02:59:35 normalization > 02:57:41.939925 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.buyers_stg" 2022-07-30 02:59:35 normalization > 02:57:41.947698 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_partners_stg" 2022-07-30 02:59:35 normalization > 02:57:41.948899 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:41.949453 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.buyers_stg 2022-07-30 02:59:35 normalization > 02:57:41.949679 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.freight_partners_stg 2022-07-30 02:59:35 normalization > 02:57:41.951012 [debug] [Thread-5 ]: Compiling model.airbyte_utils.freight_partners_stg 2022-07-30 02:59:35 normalization > 02:57:41.950666 [debug] [Thread-4 ]: Compiling model.airbyte_utils.buyers_stg 2022-07-30 02:59:35 normalization > 02:57:41.950440 [debug] [Thread-6 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:41.980317 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.buyer_store_recommendations_stg" 2022-07-30 02:59:35 normalization > 02:57:42.004849 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:42.005079 [debug] [Thread-3 ]: Began executing node model.airbyte_utils.buyer_store_recommendations_stg 2022-07-30 02:59:35 normalization > 02:57:42.010404 [debug] [Thread-3 ]: Writing runtime SQL for node "model.airbyte_utils.buyer_store_recommendations_stg" 2022-07-30 02:59:35 normalization > 02:57:42.011029 [debug] [Thread-3 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:42.013900 [debug] [Thread-6 ]: On model.airbyte_utils.flipper_features_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.flipper_features_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`flipper_features_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__flipper_features_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_flipper_features 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['key']") as key, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_flipper_features as table_alias 2022-07-30 02:59:35 normalization > -- flipper_features 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__flipper_features_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__flipper_features_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as key, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__flipper_features_ab1 2022-07-30 02:59:35 normalization > -- flipper_features 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__flipper_features_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_flipper_features_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__flipper_features_ab2 tmp 2022-07-30 02:59:35 normalization > -- flipper_features 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:42.030082 [debug] [Thread-8 ]: On model.airbyte_utils.faq_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.faq_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`faq_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__faq_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_faq 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['title']") as title, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['description']") as description, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['faq_category_id']") as faq_category_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_faq as table_alias 2022-07-30 02:59:35 normalization > -- faq 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__faq_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__faq_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(title as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as title, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(description as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as description, 2022-07-30 02:59:35 normalization > cast(faq_category_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as faq_category_id, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__faq_ab1 2022-07-30 02:59:35 normalization > -- faq 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__faq_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(title as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(description as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(faq_category_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_faq_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__faq_ab2 tmp 2022-07-30 02:59:35 normalization > -- faq 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:42.052408 [debug] [Thread-3 ]: On model.airbyte_utils.buyer_store_recommendations_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_store_recommendations_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`buyer_store_recommendations_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__buyer_store_recommendations_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_buyer_store_recommendations 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['buyer_id']") as buyer_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['store_id']") as store_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['store_name']") as store_name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['store_email']") as store_email, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['store_phone']") as store_phone, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['contact_name']") as contact_name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['buyer_user_id']") as buyer_user_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_buyer_store_recommendations as table_alias 2022-07-30 02:59:35 normalization > -- buyer_store_recommendations 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__buyer_store_recommendations_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__buyer_store_recommendations_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(buyer_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as buyer_id, 2022-07-30 02:59:35 normalization > cast(store_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as store_id, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(store_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as store_name, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(store_email as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as store_email, 2022-07-30 02:59:35 normalization > cast(store_phone as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as store_phone, 2022-07-30 02:59:35 normalization > cast(contact_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as contact_name, 2022-07-30 02:59:35 normalization > cast(buyer_user_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as buyer_user_id, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__buyer_store_recommendations_ab1 2022-07-30 02:59:35 normalization > -- buyer_store_recommendations 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__buyer_store_recommendations_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(buyer_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(store_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(store_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(store_email as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(store_phone as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(contact_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(buyer_user_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_buyer_store_recommendations_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__buyer_store_recommendations_ab2 tmp 2022-07-30 02:59:35 normalization > -- buyer_store_recommendations 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:42.154482 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.freight_partners_stg" 2022-07-30 02:59:35 normalization > 02:57:42.155142 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.buyers_stg" 2022-07-30 02:59:35 normalization > 02:57:42.159981 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:42.160170 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:42.160361 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.freight_partners_stg 2022-07-30 02:59:35 normalization > 02:57:42.160568 [debug] [Thread-4 ]: Began executing node model.airbyte_utils.buyers_stg 2022-07-30 02:59:35 normalization > 02:57:42.170855 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.freight_partners_stg" 2022-07-30 02:59:35 normalization > 02:57:42.179910 [debug] [Thread-4 ]: Writing runtime SQL for node "model.airbyte_utils.buyers_stg" 2022-07-30 02:59:35 normalization > 02:57:42.180545 [debug] [Thread-4 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:42.180947 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:42.199315 [debug] [Thread-4 ]: On model.airbyte_utils.buyers_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyers_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`buyers_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__buyers_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_buyers 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['cnpj']") as cnpj, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['wholesale']") as wholesale, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['conta_azul']") as conta_azul, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['spend_limit']") as spend_limit, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['truora_size']") as truora_size, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['trading_name']") as trading_name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['type_company']") as type_company, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['business_name']") as business_name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['financing_fee']") as financing_fee, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['location_city']") as location_city, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['max_term_days']") as max_term_days, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['location_state']") as location_state, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['truora_address']") as truora_address, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['truora_check_id']") as truora_check_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['default_payer_id']") as default_payer_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['truora_legal_type']") as truora_legal_type, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['truora_started_on']") as truora_started_on, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['new_orders_blocked']") as new_orders_blocked, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['state_registration']") as state_registration, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['truora_trading_name']") as truora_trading_name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['truora_business_name']") as truora_business_name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['average_monthly_spend']") as average_monthly_spend, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['municipal_registration']") as municipal_registration, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['truora_main_activities']") as truora_main_activities, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['truora_unfiltered_data']") as truora_unfiltered_data, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['truora_current_irs_status']") as truora_current_irs_status, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_buyers as table_alias 2022-07-30 02:59:35 normalization > -- buyers 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__buyers_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__buyers_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(cnpj as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as cnpj, 2022-07-30 02:59:35 normalization > cast(wholesale as boolean) as wholesale, 2022-07-30 02:59:35 normalization > cast(conta_azul as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as conta_azul, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(spend_limit as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as spend_limit, 2022-07-30 02:59:35 normalization > cast(truora_size as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as truora_size, 2022-07-30 02:59:35 normalization > cast(trading_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as trading_name, 2022-07-30 02:59:35 normalization > cast(type_company as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as type_company, 2022-07-30 02:59:35 normalization > cast(business_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as business_name, 2022-07-30 02:59:35 normalization > cast(financing_fee as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as financing_fee, 2022-07-30 02:59:35 normalization > cast(location_city as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as location_city, 2022-07-30 02:59:35 normalization > cast(max_term_days as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as max_term_days, 2022-07-30 02:59:35 normalization > cast(location_state as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as location_state, 2022-07-30 02:59:35 normalization > cast(truora_address as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as truora_address, 2022-07-30 02:59:35 normalization > cast(truora_check_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as truora_check_id, 2022-07-30 02:59:35 normalization > cast(default_payer_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as default_payer_id, 2022-07-30 02:59:35 normalization > cast(truora_legal_type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as truora_legal_type, 2022-07-30 02:59:35 normalization > cast(nullif(truora_started_on, '') as 2022-07-30 02:59:35 normalization > date 2022-07-30 02:59:35 normalization > ) as truora_started_on, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cast(new_orders_blocked as boolean) as new_orders_blocked, 2022-07-30 02:59:35 normalization > cast(state_registration as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as state_registration, 2022-07-30 02:59:35 normalization > cast(truora_trading_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as truora_trading_name, 2022-07-30 02:59:35 normalization > cast(truora_business_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as truora_business_name, 2022-07-30 02:59:35 normalization > cast(average_monthly_spend as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as average_monthly_spend, 2022-07-30 02:59:35 normalization > cast(municipal_registration as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as municipal_registration, 2022-07-30 02:59:35 normalization > cast(truora_main_activities as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as truora_main_activities, 2022-07-30 02:59:35 normalization > cast(truora_unfiltered_data as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as truora_unfiltered_data, 2022-07-30 02:59:35 normalization > cast(truora_current_irs_status as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as truora_current_irs_status, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__buyers_ab1 2022-07-30 02:59:35 normalization > -- buyers 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__buyers_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(cnpj as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(wholesale as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(conta_azul as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(spend_limit as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(truora_size as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(trading_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(type_company as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(business_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(financing_fee as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(location_city as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(max_term_days as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(location_state as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(truora_address as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(truora_check_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(default_payer_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(truora_legal_type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(truora_started_on as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(new_orders_blocked as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(state_registration as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(truora_trading_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(truora_business_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(average_monthly_spend as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(municipal_registration as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(truora_main_activities as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(truora_unfiltered_data as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(truora_current_irs_status as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_buyers_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__buyers_ab2 tmp 2022-07-30 02:59:35 normalization > -- buyers 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:42.208802 [debug] [Thread-5 ]: On model.airbyte_utils.freight_partners_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_partners_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`freight_partners_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__freight_partners_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_freight_partners 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['cpf']") as cpf, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['cnpj']") as cnpj, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['email']") as email, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['active']") as active, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['website']") as website, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['whatsapp']") as whatsapp, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['daily_fee']") as daily_fee, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['is_dedicated']") as is_dedicated, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['payment_type']") as payment_type, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['trading_name']") as trading_name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['business_name']") as business_name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['point_of_contact']") as point_of_contact, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_freight_partners as table_alias 2022-07-30 02:59:35 normalization > -- freight_partners 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__freight_partners_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__freight_partners_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(cpf as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as cpf, 2022-07-30 02:59:35 normalization > cast(cnpj as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as cnpj, 2022-07-30 02:59:35 normalization > cast(email as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as email, 2022-07-30 02:59:35 normalization > cast(active as boolean) as active, 2022-07-30 02:59:35 normalization > cast(website as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as website, 2022-07-30 02:59:35 normalization > cast(whatsapp as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as whatsapp, 2022-07-30 02:59:35 normalization > cast(daily_fee as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as daily_fee, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(is_dedicated as boolean) as is_dedicated, 2022-07-30 02:59:35 normalization > cast(payment_type as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as payment_type, 2022-07-30 02:59:35 normalization > cast(trading_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as trading_name, 2022-07-30 02:59:35 normalization > cast(business_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as business_name, 2022-07-30 02:59:35 normalization > cast(point_of_contact as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as point_of_contact, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__freight_partners_ab1 2022-07-30 02:59:35 normalization > -- freight_partners 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__freight_partners_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(cpf as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(cnpj as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(email as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(active as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(website as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(whatsapp as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(daily_fee as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(is_dedicated as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(payment_type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(trading_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(business_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(point_of_contact as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_freight_partners_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__freight_partners_ab2 tmp 2022-07-30 02:59:35 normalization > -- freight_partners 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:42.251822 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:42.253292 [info ] [Thread-1 ]: 9 of 201 OK created view model _airbyte_airbyte_cdc.ar_internal_metadata_stg............................................ [OK in 0.81s] 2022-07-30 02:59:35 normalization > 02:57:42.253973 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.ar_internal_metadata_stg 2022-07-30 02:59:35 normalization > 02:57:42.254307 [debug] [Thread-1 ]: Began running node model.airbyte_utils.faq_categories_stg 2022-07-30 02:59:35 normalization > 02:57:42.255231 [info ] [Thread-1 ]: 17 of 201 START view model _airbyte_airbyte_cdc.faq_categories_stg...................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:42.257306 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.faq_categories_stg" 2022-07-30 02:59:35 normalization > 02:57:42.257556 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.faq_categories_stg 2022-07-30 02:59:35 normalization > 02:57:42.257773 [debug] [Thread-1 ]: Compiling model.airbyte_utils.faq_categories_stg 2022-07-30 02:59:35 normalization > 02:57:42.282714 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.faq_categories_stg" 2022-07-30 02:59:35 normalization > 02:57:42.283358 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:42.283611 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.faq_categories_stg 2022-07-30 02:59:35 normalization > 02:57:42.287815 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.faq_categories_stg" 2022-07-30 02:59:35 normalization > 02:57:42.288719 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:42.293386 [debug] [Thread-1 ]: On model.airbyte_utils.faq_categories_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.faq_categories_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`faq_categories_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__faq_categories_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_faq_categories 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['name']") as name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_faq_categories as table_alias 2022-07-30 02:59:35 normalization > -- faq_categories 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__faq_categories_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__faq_categories_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as name, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__faq_categories_ab1 2022-07-30 02:59:35 normalization > -- faq_categories 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__faq_categories_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_faq_categories_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__faq_categories_ab2 tmp 2022-07-30 02:59:35 normalization > -- faq_categories 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:42.704704 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:42.706629 [info ] [Thread-8 ]: 12 of 201 OK created view model _airbyte_airbyte_cdc.faq_stg............................................................ [OK in 0.99s] 2022-07-30 02:59:35 normalization > 02:57:42.709256 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:42.710214 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.faq_stg 2022-07-30 02:59:35 normalization > 02:57:42.711341 [info ] [Thread-7 ]: 10 of 201 OK created view model _airbyte_airbyte_cdc.active_storage_blobs_stg........................................... [OK in 1.04s] 2022-07-30 02:59:35 normalization > 02:57:42.711671 [debug] [Thread-8 ]: Began running node model.airbyte_utils.freight_partner_vehicles_stg 2022-07-30 02:59:35 normalization > 02:57:42.712636 [info ] [Thread-8 ]: 18 of 201 START view model _airbyte_airbyte_cdc.freight_partner_vehicles_stg............................................ [RUN] 2022-07-30 02:59:35 normalization > 02:57:42.713516 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.active_storage_blobs_stg 2022-07-30 02:59:35 normalization > 02:57:42.714500 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_partner_vehicles_stg" 2022-07-30 02:59:35 normalization > 02:57:42.715110 [debug] [Thread-7 ]: Began running node model.airbyte_utils.freight_route_partner_costs_stg 2022-07-30 02:59:35 normalization > 02:57:42.715695 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.freight_partner_vehicles_stg 2022-07-30 02:59:35 normalization > 02:57:42.716273 [info ] [Thread-7 ]: 19 of 201 START view model _airbyte_airbyte_cdc.freight_route_partner_costs_stg......................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:42.716482 [debug] [Thread-8 ]: Compiling model.airbyte_utils.freight_partner_vehicles_stg 2022-07-30 02:59:35 normalization > 02:57:42.723513 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_route_partner_costs_stg" 2022-07-30 02:59:35 normalization > 02:57:42.755021 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.freight_partner_vehicles_stg" 2022-07-30 02:59:35 normalization > 02:57:42.755353 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.freight_route_partner_costs_stg 2022-07-30 02:59:35 normalization > 02:57:42.756545 [debug] [Thread-7 ]: Compiling model.airbyte_utils.freight_route_partner_costs_stg 2022-07-30 02:59:35 normalization > 02:57:42.772315 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:42.788204 [debug] [Thread-8 ]: Began executing node model.airbyte_utils.freight_partner_vehicles_stg 2022-07-30 02:59:35 normalization > 02:57:42.790965 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.freight_route_partner_costs_stg" 2022-07-30 02:59:35 normalization > 02:57:42.801795 [debug] [Thread-8 ]: Writing runtime SQL for node "model.airbyte_utils.freight_partner_vehicles_stg" 2022-07-30 02:59:35 normalization > 02:57:42.802377 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:42.802577 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.freight_route_partner_costs_stg 2022-07-30 02:59:35 normalization > 02:57:42.807141 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.freight_route_partner_costs_stg" 2022-07-30 02:59:35 normalization > 02:57:42.807673 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:42.808140 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:42.816279 [debug] [Thread-8 ]: On model.airbyte_utils.freight_partner_vehicles_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_partner_vehicles_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`freight_partner_vehicles_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__freight_partner_vehicles_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_freight_partner_vehicles 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['plate']") as plate, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['start_lat']") as start_lat, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['start_lng']") as start_lng, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['start_location']") as start_location, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['freight_partner_id']") as freight_partner_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['freight_vehicle_type_id']") as freight_vehicle_type_id, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_freight_partner_vehicles as table_alias 2022-07-30 02:59:35 normalization > -- freight_partner_vehicles 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__freight_partner_vehicles_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__freight_partner_vehicles_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(plate as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as plate, 2022-07-30 02:59:35 normalization > cast(start_lat as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as start_lat, 2022-07-30 02:59:35 normalization > cast(start_lng as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as start_lng, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(start_location as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as start_location, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cast(freight_partner_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as freight_partner_id, 2022-07-30 02:59:35 normalization > cast(freight_vehicle_type_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as freight_vehicle_type_id, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__freight_partner_vehicles_ab1 2022-07-30 02:59:35 normalization > -- freight_partner_vehicles 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__freight_partner_vehicles_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(plate as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(start_lat as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(start_lng as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(start_location as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(freight_partner_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(freight_vehicle_type_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_freight_partner_vehicles_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__freight_partner_vehicles_ab2 tmp 2022-07-30 02:59:35 normalization > -- freight_partner_vehicles 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:42.816576 [debug] [Thread-7 ]: On model.airbyte_utils.freight_route_partner_costs_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_route_partner_costs_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`freight_route_partner_costs_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__freight_route_partner_costs_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_freight_route_partner_costs 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['cost']") as cost, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['extra_cost']") as extra_cost, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['total_cost']") as total_cost, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['is_dedicated']") as is_dedicated, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['extra_cost_details']") as extra_cost_details, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['freight_partner_id']") as freight_partner_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['delivery_work_end_at']") as delivery_work_end_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['delivery_work_start_at']") as delivery_work_start_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_freight_route_partner_costs as table_alias 2022-07-30 02:59:35 normalization > -- freight_route_partner_costs 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__freight_route_partner_costs_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__freight_route_partner_costs_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(cost as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as cost, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(extra_cost as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as extra_cost, 2022-07-30 02:59:35 normalization > cast(total_cost as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as total_cost, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(is_dedicated as boolean) as is_dedicated, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cast(extra_cost_details as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as extra_cost_details, 2022-07-30 02:59:35 normalization > cast(freight_partner_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as freight_partner_id, 2022-07-30 02:59:35 normalization > cast(nullif(delivery_work_end_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as delivery_work_end_at, 2022-07-30 02:59:35 normalization > cast(nullif(delivery_work_start_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as delivery_work_start_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__freight_route_partner_costs_ab1 2022-07-30 02:59:35 normalization > -- freight_route_partner_costs 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__freight_route_partner_costs_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(cost as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(extra_cost as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(total_cost as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(is_dedicated as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(extra_cost_details as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(freight_partner_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(delivery_work_end_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(delivery_work_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_freight_route_partner_costs_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__freight_route_partner_costs_ab2 tmp 2022-07-30 02:59:35 normalization > -- freight_route_partner_costs 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:42.849293 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:42.850529 [info ] [Thread-2 ]: 11 of 201 OK created view model _airbyte_airbyte_cdc.changebase_metadata_stg............................................ [OK in 1.18s] 2022-07-30 02:59:35 normalization > 02:57:42.851054 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.changebase_metadata_stg 2022-07-30 02:59:35 normalization > 02:57:42.851360 [debug] [Thread-2 ]: Began running node model.airbyte_utils.heya_campaign_memberships_stg 2022-07-30 02:59:35 normalization > 02:57:42.852262 [info ] [Thread-2 ]: 20 of 201 START view model _airbyte_airbyte_cdc.heya_campaign_memberships_stg........................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:42.853396 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.heya_campaign_memberships_stg" 2022-07-30 02:59:35 normalization > 02:57:42.853568 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.heya_campaign_memberships_stg 2022-07-30 02:59:35 normalization > 02:57:42.853688 [debug] [Thread-2 ]: Compiling model.airbyte_utils.heya_campaign_memberships_stg 2022-07-30 02:59:35 normalization > 02:57:42.884173 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:42.885486 [info ] [Thread-6 ]: 13 of 201 OK created view model _airbyte_airbyte_cdc.flipper_features_stg............................................... [OK in 1.10s] 2022-07-30 02:59:35 normalization > 02:57:42.885991 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.flipper_features_stg 2022-07-30 02:59:35 normalization > 02:57:42.886420 [debug] [Thread-6 ]: Began running node model.airbyte_utils.flipper_gates_stg 2022-07-30 02:59:35 normalization > 02:57:42.886912 [info ] [Thread-6 ]: 21 of 201 START view model _airbyte_airbyte_cdc.flipper_gates_stg....................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:42.887926 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.flipper_gates_stg" 2022-07-30 02:59:35 normalization > 02:57:42.888103 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.flipper_gates_stg 2022-07-30 02:59:35 normalization > 02:57:42.888235 [debug] [Thread-6 ]: Compiling model.airbyte_utils.flipper_gates_stg 2022-07-30 02:59:35 normalization > 02:57:42.901078 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.heya_campaign_memberships_stg" 2022-07-30 02:59:35 normalization > 02:57:42.906198 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:42.906488 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.heya_campaign_memberships_stg 2022-07-30 02:59:35 normalization > 02:57:42.916883 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.heya_campaign_memberships_stg" 2022-07-30 02:59:35 normalization > 02:57:42.928840 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:42.947709 [debug] [Thread-2 ]: On model.airbyte_utils.heya_campaign_memberships_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.heya_campaign_memberships_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`heya_campaign_memberships_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__heya_campaign_memberships_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_heya_campaign_memberships 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['user_id']") as user_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['step_gid']") as step_gid, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['user_type']") as user_type, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['concurrent']") as concurrent, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['campaign_gid']") as campaign_gid, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['last_sent_at']") as last_sent_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_heya_campaign_memberships as table_alias 2022-07-30 02:59:35 normalization > -- heya_campaign_memberships 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__heya_campaign_memberships_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__heya_campaign_memberships_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(user_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as user_id, 2022-07-30 02:59:35 normalization > cast(step_gid as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as step_gid, 2022-07-30 02:59:35 normalization > cast(user_type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as user_type, 2022-07-30 02:59:35 normalization > cast(concurrent as boolean) as concurrent, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(campaign_gid as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as campaign_gid, 2022-07-30 02:59:35 normalization > cast(nullif(last_sent_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as last_sent_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__heya_campaign_memberships_ab1 2022-07-30 02:59:35 normalization > -- heya_campaign_memberships 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__heya_campaign_memberships_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(user_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(step_gid as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(user_type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(concurrent as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(campaign_gid as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(last_sent_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_heya_campaign_memberships_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__heya_campaign_memberships_ab2 tmp 2022-07-30 02:59:35 normalization > -- heya_campaign_memberships 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:42.950967 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.flipper_gates_stg" 2022-07-30 02:59:35 normalization > 02:57:42.954693 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:42.956271 [debug] [Thread-6 ]: Began executing node model.airbyte_utils.flipper_gates_stg 2022-07-30 02:59:35 normalization > 02:57:42.961066 [debug] [Thread-6 ]: Writing runtime SQL for node "model.airbyte_utils.flipper_gates_stg" 2022-07-30 02:59:35 normalization > 02:57:42.964584 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:42.965982 [info ] [Thread-3 ]: 14 of 201 OK created view model _airbyte_airbyte_cdc.buyer_store_recommendations_stg.................................... [OK in 1.14s] 2022-07-30 02:59:35 normalization > 02:57:42.966764 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.buyer_store_recommendations_stg 2022-07-30 02:59:35 normalization > 02:57:42.967091 [debug] [Thread-3 ]: Began running node model.airbyte_utils.freight_product_orders_stg 2022-07-30 02:59:35 normalization > 02:57:42.972550 [info ] [Thread-3 ]: 22 of 201 START view model _airbyte_airbyte_cdc.freight_product_orders_stg.............................................. [RUN] 2022-07-30 02:59:35 normalization > 02:57:42.974160 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_product_orders_stg" 2022-07-30 02:59:35 normalization > 02:57:42.974450 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.freight_product_orders_stg 2022-07-30 02:59:35 normalization > 02:57:42.974785 [debug] [Thread-3 ]: Compiling model.airbyte_utils.freight_product_orders_stg 2022-07-30 02:59:35 normalization > 02:57:42.971640 [debug] [Thread-6 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:43.015267 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.freight_product_orders_stg" 2022-07-30 02:59:35 normalization > 02:57:43.021620 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:43.022873 [info ] [Thread-1 ]: 17 of 201 OK created view model _airbyte_airbyte_cdc.faq_categories_stg................................................. [OK in 0.77s] 2022-07-30 02:59:35 normalization > 02:57:43.024179 [debug] [Thread-6 ]: On model.airbyte_utils.flipper_gates_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.flipper_gates_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`flipper_gates_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__flipper_gates_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_flipper_gates 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['key']") as key, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['value']") as value, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['feature_key']") as feature_key, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_flipper_gates as table_alias 2022-07-30 02:59:35 normalization > -- flipper_gates 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__flipper_gates_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__flipper_gates_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as key, 2022-07-30 02:59:35 normalization > cast(value as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as value, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(feature_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as feature_key, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__flipper_gates_ab1 2022-07-30 02:59:35 normalization > -- flipper_gates 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__flipper_gates_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(value as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(feature_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_flipper_gates_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__flipper_gates_ab2 tmp 2022-07-30 02:59:35 normalization > -- flipper_gates 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:43.025947 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.faq_categories_stg 2022-07-30 02:59:35 normalization > 02:57:43.026297 [debug] [Thread-1 ]: Began running node model.airbyte_utils.freight_route_groupings_stg 2022-07-30 02:59:35 normalization > 02:57:43.027289 [info ] [Thread-1 ]: 23 of 201 START view model _airbyte_airbyte_cdc.freight_route_groupings_stg............................................. [RUN] 2022-07-30 02:59:35 normalization > 02:57:43.029472 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_route_groupings_stg" 2022-07-30 02:59:35 normalization > 02:57:43.030273 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.freight_route_groupings_stg 2022-07-30 02:59:35 normalization > 02:57:43.030468 [debug] [Thread-1 ]: Compiling model.airbyte_utils.freight_route_groupings_stg 2022-07-30 02:59:35 normalization > 02:57:43.030044 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:43.036294 [debug] [Thread-3 ]: Began executing node model.airbyte_utils.freight_product_orders_stg 2022-07-30 02:59:35 normalization > 02:57:43.041191 [debug] [Thread-3 ]: Writing runtime SQL for node "model.airbyte_utils.freight_product_orders_stg" 2022-07-30 02:59:35 normalization > 02:57:43.053243 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:43.067132 [info ] [Thread-4 ]: 16 of 201 OK created view model _airbyte_airbyte_cdc.buyers_stg......................................................... [OK in 1.13s] 2022-07-30 02:59:35 normalization > 02:57:43.067490 [debug] [Thread-3 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:43.079655 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.freight_route_groupings_stg" 2022-07-30 02:59:35 normalization > 02:57:43.083822 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:43.084813 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.buyers_stg 2022-07-30 02:59:35 normalization > 02:57:43.086542 [info ] [Thread-5 ]: 15 of 201 OK created view model _airbyte_airbyte_cdc.freight_partners_stg............................................... [OK in 1.14s] 2022-07-30 02:59:35 normalization > 02:57:43.087072 [debug] [Thread-4 ]: Began running node model.airbyte_utils.buyer_users_stg 2022-07-30 02:59:35 normalization > 02:57:43.088222 [info ] [Thread-4 ]: 24 of 201 START view model _airbyte_airbyte_cdc.buyer_users_stg......................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:43.089496 [debug] [Thread-3 ]: On model.airbyte_utils.freight_product_orders_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_product_orders_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`freight_product_orders_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__freight_product_orders_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_freight_product_orders 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['freight_id']") as freight_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['product_order_id']") as product_order_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['quantity_in_freight']") as quantity_in_freight, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['internal_product_freight_note']") as internal_product_freight_note, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_freight_product_orders as table_alias 2022-07-30 02:59:35 normalization > -- freight_product_orders 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__freight_product_orders_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__freight_product_orders_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(freight_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as freight_id, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(product_order_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as product_order_id, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cast(quantity_in_freight as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as quantity_in_freight, 2022-07-30 02:59:35 normalization > cast(internal_product_freight_note as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as internal_product_freight_note, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__freight_product_orders_ab1 2022-07-30 02:59:35 normalization > -- freight_product_orders 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__freight_product_orders_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(freight_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(product_order_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(quantity_in_freight as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(internal_product_freight_note as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_freight_product_orders_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__freight_product_orders_ab2 tmp 2022-07-30 02:59:35 normalization > -- freight_product_orders 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:43.090010 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.freight_partners_stg 2022-07-30 02:59:35 normalization > 02:57:43.090964 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_users_stg" 2022-07-30 02:59:35 normalization > 02:57:43.091881 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:43.093108 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.freight_route_groupings_stg 2022-07-30 02:59:35 normalization > 02:57:43.092788 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.buyer_users_stg 2022-07-30 02:59:35 normalization > 02:57:43.097912 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.freight_route_groupings_stg" 2022-07-30 02:59:35 normalization > 02:57:43.092203 [debug] [Thread-5 ]: Began running node model.airbyte_utils.freight_routes_stg 2022-07-30 02:59:35 normalization > 02:57:43.098198 [debug] [Thread-4 ]: Compiling model.airbyte_utils.buyer_users_stg 2022-07-30 02:59:35 normalization > 02:57:43.100313 [info ] [Thread-5 ]: 25 of 201 START view model _airbyte_airbyte_cdc.freight_routes_stg...................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:43.112371 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_routes_stg" 2022-07-30 02:59:35 normalization > 02:57:43.127967 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:43.128636 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.freight_routes_stg 2022-07-30 02:59:35 normalization > 02:57:43.153106 [debug] [Thread-5 ]: Compiling model.airbyte_utils.freight_routes_stg 2022-07-30 02:59:35 normalization > 02:57:43.175449 [debug] [Thread-1 ]: On model.airbyte_utils.freight_route_groupings_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_route_groupings_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`freight_route_groupings_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__freight_route_groupings_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_freight_route_groupings 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['freight_id']") as freight_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['freight_route_id']") as freight_route_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['delivery_note_link']") as delivery_note_link, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_freight_route_groupings as table_alias 2022-07-30 02:59:35 normalization > -- freight_route_groupings 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__freight_route_groupings_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__freight_route_groupings_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(freight_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as freight_id, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(freight_route_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as freight_route_id, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cast(delivery_note_link as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as delivery_note_link, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__freight_route_groupings_ab1 2022-07-30 02:59:35 normalization > -- freight_route_groupings 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__freight_route_groupings_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(freight_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(freight_route_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(delivery_note_link as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_freight_route_groupings_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__freight_route_groupings_ab2 tmp 2022-07-30 02:59:35 normalization > -- freight_route_groupings 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:43.205941 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.buyer_users_stg" 2022-07-30 02:59:35 normalization > 02:57:43.226183 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:43.226560 [debug] [Thread-4 ]: Began executing node model.airbyte_utils.buyer_users_stg 2022-07-30 02:59:35 normalization > 02:57:43.245760 [debug] [Thread-4 ]: Writing runtime SQL for node "model.airbyte_utils.buyer_users_stg" 2022-07-30 02:59:35 normalization > 02:57:43.255894 [debug] [Thread-4 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:43.264701 [debug] [Thread-4 ]: On model.airbyte_utils.buyer_users_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_users_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`buyer_users_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__buyer_users_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_buyer_users 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['name']") as name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['email']") as email, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['active']") as active, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['profile']") as profile, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['buyer_id']") as buyer_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['whatsapp']") as whatsapp, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['spend_limit']") as spend_limit, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['confirmed_at']") as confirmed_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['referral_code']") as referral_code, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['stytch_user_id']") as stytch_user_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['own_referral_code']") as own_referral_code, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['unconfirmed_email']") as unconfirmed_email, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['confirmation_token']") as confirmation_token, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['encrypted_password']") as encrypted_password, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['remember_created_at']") as remember_created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['confirmation_sent_at']") as confirmation_sent_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['reset_password_token']") as reset_password_token, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['reset_password_sent_at']") as reset_password_sent_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_buyer_users as table_alias 2022-07-30 02:59:35 normalization > -- buyer_users 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__buyer_users_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__buyer_users_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as name, 2022-07-30 02:59:35 normalization > cast(email as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as email, 2022-07-30 02:59:35 normalization > cast(active as boolean) as active, 2022-07-30 02:59:35 normalization > cast(profile as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as profile, 2022-07-30 02:59:35 normalization > cast(buyer_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as buyer_id, 2022-07-30 02:59:35 normalization > cast(whatsapp as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as whatsapp, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(spend_limit as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as spend_limit, 2022-07-30 02:59:35 normalization > cast(nullif(confirmed_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as confirmed_at, 2022-07-30 02:59:35 normalization > cast(referral_code as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as referral_code, 2022-07-30 02:59:35 normalization > cast(stytch_user_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as stytch_user_id, 2022-07-30 02:59:35 normalization > cast(own_referral_code as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as own_referral_code, 2022-07-30 02:59:35 normalization > cast(unconfirmed_email as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as unconfirmed_email, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cast(confirmation_token as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as confirmation_token, 2022-07-30 02:59:35 normalization > cast(encrypted_password as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as encrypted_password, 2022-07-30 02:59:35 normalization > cast(nullif(remember_created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as remember_created_at, 2022-07-30 02:59:35 normalization > cast(nullif(confirmation_sent_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as confirmation_sent_at, 2022-07-30 02:59:35 normalization > cast(reset_password_token as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as reset_password_token, 2022-07-30 02:59:35 normalization > cast(nullif(reset_password_sent_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as reset_password_sent_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__buyer_users_ab1 2022-07-30 02:59:35 normalization > -- buyer_users 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__buyer_users_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(email as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(active as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(profile as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(buyer_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(whatsapp as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(spend_limit as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(confirmed_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(referral_code as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(stytch_user_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(own_referral_code as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(unconfirmed_email as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(confirmation_token as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(encrypted_password as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(remember_created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(confirmation_sent_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(reset_password_token as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(reset_password_sent_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_buyer_users_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__buyer_users_ab2 tmp 2022-07-30 02:59:35 normalization > -- buyer_users 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:43.317642 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.freight_routes_stg" 2022-07-30 02:59:35 normalization > 02:57:43.319645 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:43.321322 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.freight_routes_stg 2022-07-30 02:59:35 normalization > 02:57:43.336329 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.freight_routes_stg" 2022-07-30 02:59:35 normalization > 02:57:43.337008 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:43.349102 [debug] [Thread-5 ]: On model.airbyte_utils.freight_routes_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_routes_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`freight_routes_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__freight_routes_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_freight_routes 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['sequence']") as sequence, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['pipefy_id']") as pipefy_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['freight_price']") as freight_price, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['total_distance']") as total_distance, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['product_problems']") as product_problems, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['delivery_problems']") as delivery_problems, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['shareable_link_hash']") as shareable_link_hash, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['client_delivery_notes']") as client_delivery_notes, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['freight_tracking_link']") as freight_tracking_link, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['freight_delivery_poc_phone']") as freight_delivery_poc_phone, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['freight_partner_vehicle_id']") as freight_partner_vehicle_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['freight_partner_external_id']") as freight_partner_external_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['freight_route_partner_cost_id']") as freight_route_partner_cost_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['freight_actual_delivery_datetime']") as freight_actual_delivery_datetime, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['freight_delivery_point_of_contact']") as freight_delivery_point_of_contact, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['freight_scheduled_delivery_datetime']") as freight_scheduled_delivery_datetime, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['freight_partner_dedicated_when_associated']") as freight_partner_dedicated_when_associated, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_freight_routes as table_alias 2022-07-30 02:59:35 normalization > -- freight_routes 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__freight_routes_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__freight_routes_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(sequence as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as sequence, 2022-07-30 02:59:35 normalization > cast(pipefy_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as pipefy_id, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(freight_price as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as freight_price, 2022-07-30 02:59:35 normalization > cast(total_distance as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as total_distance, 2022-07-30 02:59:35 normalization > cast(product_problems as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as product_problems, 2022-07-30 02:59:35 normalization > cast(delivery_problems as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as delivery_problems, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cast(shareable_link_hash as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as shareable_link_hash, 2022-07-30 02:59:35 normalization > cast(client_delivery_notes as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as client_delivery_notes, 2022-07-30 02:59:35 normalization > cast(freight_tracking_link as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as freight_tracking_link, 2022-07-30 02:59:35 normalization > cast(freight_delivery_poc_phone as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as freight_delivery_poc_phone, 2022-07-30 02:59:35 normalization > cast(freight_partner_vehicle_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as freight_partner_vehicle_id, 2022-07-30 02:59:35 normalization > cast(freight_partner_external_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as freight_partner_external_id, 2022-07-30 02:59:35 normalization > cast(freight_route_partner_cost_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as freight_route_partner_cost_id, 2022-07-30 02:59:35 normalization > cast(nullif(freight_actual_delivery_datetime, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as freight_actual_delivery_datetime, 2022-07-30 02:59:35 normalization > cast(freight_delivery_point_of_contact as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as freight_delivery_point_of_contact, 2022-07-30 02:59:35 normalization > cast(nullif(freight_scheduled_delivery_datetime, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as freight_scheduled_delivery_datetime, 2022-07-30 02:59:35 normalization > cast(freight_partner_dedicated_when_associated as boolean) as freight_partner_dedicated_when_associated, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__freight_routes_ab1 2022-07-30 02:59:35 normalization > -- freight_routes 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__freight_routes_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(sequence as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(pipefy_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(freight_price as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(total_distance as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(product_problems as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(delivery_problems as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(shareable_link_hash as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(client_delivery_notes as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(freight_tracking_link as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(freight_delivery_poc_phone as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(freight_partner_vehicle_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(freight_partner_external_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(freight_route_partner_cost_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(freight_actual_delivery_datetime as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(freight_delivery_point_of_contact as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(freight_scheduled_delivery_datetime as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(freight_partner_dedicated_when_associated as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_freight_routes_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__freight_routes_ab2 tmp 2022-07-30 02:59:35 normalization > -- freight_routes 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:43.596577 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:43.597482 [info ] [Thread-2 ]: 20 of 201 OK created view model _airbyte_airbyte_cdc.heya_campaign_memberships_stg...................................... [OK in 0.74s] 2022-07-30 02:59:35 normalization > 02:57:43.598140 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.heya_campaign_memberships_stg 2022-07-30 02:59:35 normalization > 02:57:43.598454 [debug] [Thread-2 ]: Began running node model.airbyte_utils.freights_stg 2022-07-30 02:59:35 normalization > 02:57:43.599079 [info ] [Thread-2 ]: 26 of 201 START view model _airbyte_airbyte_cdc.freights_stg............................................................ [RUN] 2022-07-30 02:59:35 normalization > 02:57:43.603837 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.freights_stg" 2022-07-30 02:59:35 normalization > 02:57:43.604031 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.freights_stg 2022-07-30 02:59:35 normalization > 02:57:43.604155 [debug] [Thread-2 ]: Compiling model.airbyte_utils.freights_stg 2022-07-30 02:59:35 normalization > 02:57:43.617590 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:43.634196 [info ] [Thread-7 ]: 19 of 201 OK created view model _airbyte_airbyte_cdc.freight_route_partner_costs_stg.................................... [OK in 0.91s] 2022-07-30 02:59:35 normalization > 02:57:43.655433 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.freight_route_partner_costs_stg 2022-07-30 02:59:35 normalization > 02:57:43.655869 [debug] [Thread-7 ]: Began running node model.airbyte_utils.freight_vehicle_types_stg 2022-07-30 02:59:35 normalization > 02:57:43.656629 [info ] [Thread-7 ]: 27 of 201 START view model _airbyte_airbyte_cdc.freight_vehicle_types_stg............................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:43.657666 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_vehicle_types_stg" 2022-07-30 02:59:35 normalization > 02:57:43.668972 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.freights_stg" 2022-07-30 02:59:35 normalization > 02:57:43.672199 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:43.673432 [info ] [Thread-8 ]: 18 of 201 OK created view model _airbyte_airbyte_cdc.freight_partner_vehicles_stg....................................... [OK in 0.96s] 2022-07-30 02:59:35 normalization > 02:57:43.673917 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:43.672482 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.freight_vehicle_types_stg 2022-07-30 02:59:35 normalization > 02:57:43.674148 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.freights_stg 2022-07-30 02:59:35 normalization > 02:57:43.674337 [debug] [Thread-7 ]: Compiling model.airbyte_utils.freight_vehicle_types_stg 2022-07-30 02:59:35 normalization > 02:57:43.679245 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.freights_stg" 2022-07-30 02:59:35 normalization > 02:57:43.687050 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:43.687476 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.freight_partner_vehicles_stg 2022-07-30 02:59:35 normalization > 02:57:43.715644 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.freight_vehicle_types_stg" 2022-07-30 02:59:35 normalization > 02:57:43.718271 [debug] [Thread-8 ]: Began running node model.airbyte_utils.location_store_products_stg 2022-07-30 02:59:35 normalization > 02:57:43.722820 [info ] [Thread-8 ]: 28 of 201 START view model _airbyte_airbyte_cdc.location_store_products_stg............................................. [RUN] 2022-07-30 02:59:35 normalization > 02:57:43.725824 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.location_store_products_stg" 2022-07-30 02:59:35 normalization > 02:57:43.726188 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.location_store_products_stg 2022-07-30 02:59:35 normalization > 02:57:43.726427 [debug] [Thread-8 ]: Compiling model.airbyte_utils.location_store_products_stg 2022-07-30 02:59:35 normalization > 02:57:43.731796 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:43.732120 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.freight_vehicle_types_stg 2022-07-30 02:59:35 normalization > 02:57:43.736865 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.freight_vehicle_types_stg" 2022-07-30 02:59:35 normalization > 02:57:43.742556 [debug] [Thread-2 ]: On model.airbyte_utils.freights_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freights_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`freights_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__freights_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_freights 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['distance']") as distance, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['order_id']") as order_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['delivered']") as delivered, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['notified_at']") as notified_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['received_by']") as received_by, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['picked_up_at']") as picked_up_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['freight_weight']") as freight_weight, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['store_quote_id']") as store_quote_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['reverse_freight']") as reverse_freight, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['buyer_location_id']") as buyer_location_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['store_location_id']") as store_location_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['client_delivery_notes']") as client_delivery_notes, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['internal_delivery_notes']") as internal_delivery_notes, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['actual_delivery_datetime']") as actual_delivery_datetime, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['target_delivery_datetime']") as target_delivery_datetime, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['freight_actual_pickup_time']") as freight_actual_pickup_time, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['freight_scheduled_pickup_time']") as freight_scheduled_pickup_time, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['arrived_at_pick_up_location_at']") as arrived_at_pick_up_location_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['arrived_at_drop_off_location_at']") as arrived_at_drop_off_location_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['estimated_arrival_delivery_datetime']") as estimated_arrival_delivery_datetime, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_freights as table_alias 2022-07-30 02:59:35 normalization > -- freights 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__freights_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__freights_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(distance as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as distance, 2022-07-30 02:59:35 normalization > cast(order_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as order_id, 2022-07-30 02:59:35 normalization > cast(delivered as boolean) as delivered, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(nullif(notified_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as notified_at, 2022-07-30 02:59:35 normalization > cast(received_by as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as received_by, 2022-07-30 02:59:35 normalization > cast(nullif(picked_up_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as picked_up_at, 2022-07-30 02:59:35 normalization > cast(freight_weight as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as freight_weight, 2022-07-30 02:59:35 normalization > cast(store_quote_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as store_quote_id, 2022-07-30 02:59:35 normalization > cast(reverse_freight as boolean) as reverse_freight, 2022-07-30 02:59:35 normalization > cast(buyer_location_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as buyer_location_id, 2022-07-30 02:59:35 normalization > cast(store_location_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as store_location_id, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cast(client_delivery_notes as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as client_delivery_notes, 2022-07-30 02:59:35 normalization > cast(internal_delivery_notes as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as internal_delivery_notes, 2022-07-30 02:59:35 normalization > cast(nullif(actual_delivery_datetime, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as actual_delivery_datetime, 2022-07-30 02:59:35 normalization > cast(nullif(target_delivery_datetime, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as target_delivery_datetime, 2022-07-30 02:59:35 normalization > cast(nullif(freight_actual_pickup_time, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as freight_actual_pickup_time, 2022-07-30 02:59:35 normalization > cast(nullif(freight_scheduled_pickup_time, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as freight_scheduled_pickup_time, 2022-07-30 02:59:35 normalization > cast(nullif(arrived_at_pick_up_location_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as arrived_at_pick_up_location_at, 2022-07-30 02:59:35 normalization > cast(nullif(arrived_at_drop_off_location_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as arrived_at_drop_off_location_at, 2022-07-30 02:59:35 normalization > cast(nullif(estimated_arrival_delivery_datetime, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as estimated_arrival_delivery_datetime, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__freights_ab1 2022-07-30 02:59:35 normalization > -- freights 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__freights_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(distance as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(order_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(delivered as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(notified_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(received_by as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(picked_up_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(freight_weight as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(store_quote_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(reverse_freight as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(buyer_location_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(store_location_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(client_delivery_notes as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(internal_delivery_notes as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(actual_delivery_datetime as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(target_delivery_datetime as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(freight_actual_pickup_time as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(freight_scheduled_pickup_time as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(arrived_at_pick_up_location_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(arrived_at_drop_off_location_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(estimated_arrival_delivery_datetime as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_freights_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__freights_ab2 tmp 2022-07-30 02:59:35 normalization > -- freights 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:43.754527 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:43.765966 [debug] [Thread-7 ]: On model.airbyte_utils.freight_vehicle_types_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_vehicle_types_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`freight_vehicle_types_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__freight_vehicle_types_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_freight_vehicle_types 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['name']") as name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['max_width']") as max_width, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['max_height']") as max_height, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['max_lenght']") as max_lenght, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['description']") as description, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['capacity_in_kg']") as capacity_in_kg, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_freight_vehicle_types as table_alias 2022-07-30 02:59:35 normalization > -- freight_vehicle_types 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__freight_vehicle_types_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__freight_vehicle_types_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as name, 2022-07-30 02:59:35 normalization > cast(max_width as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as max_width, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(max_height as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as max_height, 2022-07-30 02:59:35 normalization > cast(max_lenght as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as max_lenght, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(description as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as description, 2022-07-30 02:59:35 normalization > cast(capacity_in_kg as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as capacity_in_kg, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__freight_vehicle_types_ab1 2022-07-30 02:59:35 normalization > -- freight_vehicle_types 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__freight_vehicle_types_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(max_width as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(max_height as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(max_lenght as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(description as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(capacity_in_kg as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_freight_vehicle_types_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__freight_vehicle_types_ab2 tmp 2022-07-30 02:59:35 normalization > -- freight_vehicle_types 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:43.777482 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.location_store_products_stg" 2022-07-30 02:59:35 normalization > 02:57:43.778186 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:43.778390 [debug] [Thread-8 ]: Began executing node model.airbyte_utils.location_store_products_stg 2022-07-30 02:59:35 normalization > 02:57:43.783071 [debug] [Thread-8 ]: Writing runtime SQL for node "model.airbyte_utils.location_store_products_stg" 2022-07-30 02:59:35 normalization > 02:57:43.784161 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:43.792846 [debug] [Thread-8 ]: On model.airbyte_utils.location_store_products_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.location_store_products_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`location_store_products_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__location_store_products_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_location_store_products 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['pipefy_id']") as pipefy_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['product_id']") as product_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['store_location_id']") as store_location_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['pipefy_product_store_id']") as pipefy_product_store_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['pipefy_store_location_id']") as pipefy_store_location_id, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_location_store_products as table_alias 2022-07-30 02:59:35 normalization > -- location_store_products 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__location_store_products_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__location_store_products_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(pipefy_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as pipefy_id, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(product_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as product_id, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(store_location_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as store_location_id, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cast(pipefy_product_store_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as pipefy_product_store_id, 2022-07-30 02:59:35 normalization > cast(pipefy_store_location_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as pipefy_store_location_id, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__location_store_products_ab1 2022-07-30 02:59:35 normalization > -- location_store_products 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__location_store_products_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(pipefy_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(product_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(store_location_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(pipefy_product_store_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(pipefy_store_location_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_location_store_products_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__location_store_products_ab2 tmp 2022-07-30 02:59:35 normalization > -- location_store_products 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:43.949222 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:43.950163 [info ] [Thread-3 ]: 22 of 201 OK created view model _airbyte_airbyte_cdc.freight_product_orders_stg......................................... [OK in 0.98s] 2022-07-30 02:59:35 normalization > 02:57:43.951012 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.freight_product_orders_stg 2022-07-30 02:59:35 normalization > 02:57:43.951356 [debug] [Thread-3 ]: Began running node model.airbyte_utils.memento_sessions_stg 2022-07-30 02:59:35 normalization > 02:57:43.952124 [info ] [Thread-3 ]: 29 of 201 START view model _airbyte_airbyte_cdc.memento_sessions_stg.................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:43.953354 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.memento_sessions_stg" 2022-07-30 02:59:35 normalization > 02:57:43.953521 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.memento_sessions_stg 2022-07-30 02:59:35 normalization > 02:57:43.953640 [debug] [Thread-3 ]: Compiling model.airbyte_utils.memento_sessions_stg 2022-07-30 02:59:35 normalization > 02:57:43.962862 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:43.963810 [info ] [Thread-6 ]: 21 of 201 OK created view model _airbyte_airbyte_cdc.flipper_gates_stg.................................................. [OK in 1.08s] 2022-07-30 02:59:35 normalization > 02:57:43.985355 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.memento_sessions_stg" 2022-07-30 02:59:35 normalization > 02:57:43.989751 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.flipper_gates_stg 2022-07-30 02:59:35 normalization > 02:57:43.990090 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:43.990307 [debug] [Thread-6 ]: Began running node model.airbyte_utils.memento_states_stg 2022-07-30 02:59:35 normalization > 02:57:43.990883 [debug] [Thread-3 ]: Began executing node model.airbyte_utils.memento_sessions_stg 2022-07-30 02:59:35 normalization > 02:57:43.991226 [info ] [Thread-6 ]: 30 of 201 START view model _airbyte_airbyte_cdc.memento_states_stg...................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:43.997129 [debug] [Thread-3 ]: Writing runtime SQL for node "model.airbyte_utils.memento_sessions_stg" 2022-07-30 02:59:35 normalization > 02:57:43.997924 [debug] [Thread-3 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:44.000114 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.memento_states_stg" 2022-07-30 02:59:35 normalization > 02:57:44.000349 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.memento_states_stg 2022-07-30 02:59:35 normalization > 02:57:44.000519 [debug] [Thread-6 ]: Compiling model.airbyte_utils.memento_states_stg 2022-07-30 02:59:35 normalization > 02:57:44.024677 [debug] [Thread-3 ]: On model.airbyte_utils.memento_sessions_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.memento_sessions_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`memento_sessions_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__memento_sessions_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_memento_sessions 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['user_id']") as user_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_memento_sessions as table_alias 2022-07-30 02:59:35 normalization > -- memento_sessions 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__memento_sessions_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__memento_sessions_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(user_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as user_id, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__memento_sessions_ab1 2022-07-30 02:59:35 normalization > -- memento_sessions 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__memento_sessions_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(user_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_memento_sessions_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__memento_sessions_ab2 tmp 2022-07-30 02:59:35 normalization > -- memento_sessions 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:44.054850 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:44.060220 [info ] [Thread-1 ]: 23 of 201 OK created view model _airbyte_airbyte_cdc.freight_route_groupings_stg........................................ [OK in 1.03s] 2022-07-30 02:59:35 normalization > 02:57:44.070164 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.memento_states_stg" 2022-07-30 02:59:35 normalization > 02:57:44.071185 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:44.071702 [debug] [Thread-6 ]: Began executing node model.airbyte_utils.memento_states_stg 2022-07-30 02:59:35 normalization > 02:57:44.077260 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.freight_route_groupings_stg 2022-07-30 02:59:35 normalization > 02:57:44.077102 [debug] [Thread-6 ]: Writing runtime SQL for node "model.airbyte_utils.memento_states_stg" 2022-07-30 02:59:35 normalization > 02:57:44.077763 [debug] [Thread-1 ]: Began running node model.airbyte_utils.oico_radars_stg 2022-07-30 02:59:35 normalization > 02:57:44.081291 [info ] [Thread-1 ]: 31 of 201 START view model _airbyte_airbyte_cdc.oico_radars_stg......................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:44.082681 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.oico_radars_stg" 2022-07-30 02:59:35 normalization > 02:57:44.082923 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.oico_radars_stg 2022-07-30 02:59:35 normalization > 02:57:44.083046 [debug] [Thread-1 ]: Compiling model.airbyte_utils.oico_radars_stg 2022-07-30 02:59:35 normalization > 02:57:44.124188 [debug] [Thread-6 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:44.139615 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.oico_radars_stg" 2022-07-30 02:59:35 normalization > 02:57:44.150941 [debug] [Thread-6 ]: On model.airbyte_utils.memento_states_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.memento_states_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`memento_states_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__memento_states_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_memento_states 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['record_id']") as record_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['session_id']") as session_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['action_type']") as action_type, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['record_data']") as record_data, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['record_type']") as record_type, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_memento_states as table_alias 2022-07-30 02:59:35 normalization > -- memento_states 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__memento_states_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__memento_states_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(record_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as record_id, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(session_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as session_id, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(action_type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as action_type, 2022-07-30 02:59:35 normalization > cast(record_data as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as record_data, 2022-07-30 02:59:35 normalization > cast(record_type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as record_type, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__memento_states_ab1 2022-07-30 02:59:35 normalization > -- memento_states 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__memento_states_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(record_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(session_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(action_type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(record_data as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(record_type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_memento_states_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__memento_states_ab2 tmp 2022-07-30 02:59:35 normalization > -- memento_states 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:44.153625 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:44.153852 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.oico_radars_stg 2022-07-30 02:59:35 normalization > 02:57:44.158343 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.oico_radars_stg" 2022-07-30 02:59:35 normalization > 02:57:44.161183 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:44.169377 [debug] [Thread-1 ]: On model.airbyte_utils.oico_radars_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.oico_radars_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`oico_radars_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__oico_radars_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_oico_radars 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['name']") as name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['email']") as email, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['document']") as document, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['notify_terms']") as notify_terms, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['phone_number']") as phone_number, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['buyer_user_id']") as buyer_user_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['shareable_link_hash']") as shareable_link_hash, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_oico_radars as table_alias 2022-07-30 02:59:35 normalization > -- oico_radars 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__oico_radars_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__oico_radars_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as name, 2022-07-30 02:59:35 normalization > cast(email as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as email, 2022-07-30 02:59:35 normalization > cast(document as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as document, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(notify_terms as boolean) as notify_terms, 2022-07-30 02:59:35 normalization > cast(phone_number as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as phone_number, 2022-07-30 02:59:35 normalization > cast(buyer_user_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as buyer_user_id, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cast(shareable_link_hash as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as shareable_link_hash, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__oico_radars_ab1 2022-07-30 02:59:35 normalization > -- oico_radars 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__oico_radars_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(email as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(document as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(notify_terms as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(phone_number as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(buyer_user_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(shareable_link_hash as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_oico_radars_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__oico_radars_ab2 tmp 2022-07-30 02:59:35 normalization > -- oico_radars 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:44.193724 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:44.195664 [info ] [Thread-4 ]: 24 of 201 OK created view model _airbyte_airbyte_cdc.buyer_users_stg.................................................... [OK in 1.11s] 2022-07-30 02:59:35 normalization > 02:57:44.198431 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.buyer_users_stg 2022-07-30 02:59:35 normalization > 02:57:44.198704 [debug] [Thread-4 ]: Began running node model.airbyte_utils.oico_radar_products_stg 2022-07-30 02:59:35 normalization > 02:57:44.199591 [info ] [Thread-4 ]: 32 of 201 START view model _airbyte_airbyte_cdc.oico_radar_products_stg................................................. [RUN] 2022-07-30 02:59:35 normalization > 02:57:44.201700 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.oico_radar_products_stg" 2022-07-30 02:59:35 normalization > 02:57:44.201949 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.oico_radar_products_stg 2022-07-30 02:59:35 normalization > 02:57:44.203031 [debug] [Thread-4 ]: Compiling model.airbyte_utils.oico_radar_products_stg 2022-07-30 02:59:35 normalization > 02:57:44.208365 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:44.219962 [info ] [Thread-5 ]: 25 of 201 OK created view model _airbyte_airbyte_cdc.freight_routes_stg................................................. [OK in 1.11s] 2022-07-30 02:59:35 normalization > 02:57:44.241093 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.freight_routes_stg 2022-07-30 02:59:35 normalization > 02:57:44.241489 [debug] [Thread-5 ]: Began running node model.airbyte_utils.order_feedbacks_stg 2022-07-30 02:59:35 normalization > 02:57:44.242431 [info ] [Thread-5 ]: 33 of 201 START view model _airbyte_airbyte_cdc.order_feedbacks_stg..................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:44.244352 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.order_feedbacks_stg" 2022-07-30 02:59:35 normalization > 02:57:44.244594 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.order_feedbacks_stg 2022-07-30 02:59:35 normalization > 02:57:44.244790 [debug] [Thread-5 ]: Compiling model.airbyte_utils.order_feedbacks_stg 2022-07-30 02:59:35 normalization > 02:57:44.265822 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.oico_radar_products_stg" 2022-07-30 02:59:35 normalization > 02:57:44.278161 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.order_feedbacks_stg" 2022-07-30 02:59:35 normalization > 02:57:44.278769 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:44.279030 [debug] [Thread-4 ]: Began executing node model.airbyte_utils.oico_radar_products_stg 2022-07-30 02:59:35 normalization > 02:57:44.286346 [debug] [Thread-4 ]: Writing runtime SQL for node "model.airbyte_utils.oico_radar_products_stg" 2022-07-30 02:59:35 normalization > 02:57:44.292705 [debug] [Thread-4 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:44.291633 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:44.295584 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.order_feedbacks_stg 2022-07-30 02:59:35 normalization > 02:57:44.302536 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.order_feedbacks_stg" 2022-07-30 02:59:35 normalization > 02:57:44.304057 [debug] [Thread-4 ]: On model.airbyte_utils.oico_radar_products_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.oico_radar_products_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`oico_radar_products_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__oico_radar_products_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_oico_radar_products 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['price']") as price, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['oico_radar_id']") as oico_radar_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['product_canonical_id']") as product_canonical_id, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_oico_radar_products as table_alias 2022-07-30 02:59:35 normalization > -- oico_radar_products 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__oico_radar_products_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__oico_radar_products_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(price as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as price, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(oico_radar_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as oico_radar_id, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cast(product_canonical_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as product_canonical_id, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__oico_radar_products_ab1 2022-07-30 02:59:35 normalization > -- oico_radar_products 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__oico_radar_products_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(price as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(oico_radar_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(product_canonical_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_oico_radar_products_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__oico_radar_products_ab2 tmp 2022-07-30 02:59:35 normalization > -- oico_radar_products 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:44.305265 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:44.312477 [debug] [Thread-5 ]: On model.airbyte_utils.order_feedbacks_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.order_feedbacks_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`order_feedbacks_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__order_feedbacks_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_order_feedbacks 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['type']") as type, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['liked']") as liked, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['order_id']") as order_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_order_feedbacks as table_alias 2022-07-30 02:59:35 normalization > -- order_feedbacks 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__order_feedbacks_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__order_feedbacks_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(type as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as type, 2022-07-30 02:59:35 normalization > cast(liked as boolean) as liked, 2022-07-30 02:59:35 normalization > cast(order_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as order_id, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__order_feedbacks_ab1 2022-07-30 02:59:35 normalization > -- order_feedbacks 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__order_feedbacks_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(liked as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(order_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_order_feedbacks_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__order_feedbacks_ab2 tmp 2022-07-30 02:59:35 normalization > -- order_feedbacks 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:44.396836 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:44.399119 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:44.400798 [info ] [Thread-7 ]: 27 of 201 OK created view model _airbyte_airbyte_cdc.freight_vehicle_types_stg.......................................... [OK in 0.74s] 2022-07-30 02:59:35 normalization > 02:57:44.401164 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.freight_vehicle_types_stg 2022-07-30 02:59:35 normalization > 02:57:44.400035 [info ] [Thread-8 ]: 28 of 201 OK created view model _airbyte_airbyte_cdc.location_store_products_stg........................................ [OK in 0.67s] 2022-07-30 02:59:35 normalization > 02:57:44.402734 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.location_store_products_stg 2022-07-30 02:59:35 normalization > 02:57:44.402995 [debug] [Thread-8 ]: Began running node model.airbyte_utils.orders_stg 2022-07-30 02:59:35 normalization > 02:57:44.404054 [info ] [Thread-8 ]: 35 of 201 START view model _airbyte_airbyte_cdc.orders_stg.............................................................. [RUN] 2022-07-30 02:59:35 normalization > 02:57:44.401424 [debug] [Thread-7 ]: Began running node model.airbyte_utils.order_issues_stg 2022-07-30 02:59:35 normalization > 02:57:44.405377 [info ] [Thread-7 ]: 34 of 201 START view model _airbyte_airbyte_cdc.order_issues_stg........................................................ [RUN] 2022-07-30 02:59:35 normalization > 02:57:44.405091 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.orders_stg" 2022-07-30 02:59:35 normalization > 02:57:44.406465 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.orders_stg 2022-07-30 02:59:35 normalization > 02:57:44.406603 [debug] [Thread-8 ]: Compiling model.airbyte_utils.orders_stg 2022-07-30 02:59:35 normalization > 02:57:44.406287 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.order_issues_stg" 2022-07-30 02:59:35 normalization > 02:57:44.429000 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.order_issues_stg 2022-07-30 02:59:35 normalization > 02:57:44.444700 [debug] [Thread-7 ]: Compiling model.airbyte_utils.order_issues_stg 2022-07-30 02:59:35 normalization > 02:57:44.734729 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.orders_stg" 2022-07-30 02:59:35 normalization > 02:57:44.739714 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:44.740076 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:44.741484 [info ] [Thread-2 ]: 26 of 201 OK created view model _airbyte_airbyte_cdc.freights_stg....................................................... [OK in 1.14s] 2022-07-30 02:59:35 normalization > 02:57:44.742300 [debug] [Thread-8 ]: Began executing node model.airbyte_utils.orders_stg 2022-07-30 02:59:35 normalization > 02:57:44.819272 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:44.833247 [info ] [Thread-1 ]: 31 of 201 OK created view model _airbyte_airbyte_cdc.oico_radars_stg.................................................... [OK in 0.75s] 2022-07-30 02:59:35 normalization > 02:57:44.824225 [debug] [Thread-8 ]: Writing runtime SQL for node "model.airbyte_utils.orders_stg" 2022-07-30 02:59:35 normalization > 02:57:44.854270 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:44.853373 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.order_issues_stg" 2022-07-30 02:59:35 normalization > 02:57:44.854927 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:44.855152 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.order_issues_stg 2022-07-30 02:59:35 normalization > 02:57:44.835820 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.freights_stg 2022-07-30 02:59:35 normalization > 02:57:44.861112 [debug] [Thread-2 ]: Began running node model.airbyte_utils.heya_campaign_receipts_stg 2022-07-30 02:59:35 normalization > 02:57:44.861558 [info ] [Thread-2 ]: 36 of 201 START view model _airbyte_airbyte_cdc.heya_campaign_receipts_stg.............................................. [RUN] 2022-07-30 02:59:35 normalization > 02:57:44.861810 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.oico_radars_stg 2022-07-30 02:59:35 normalization > 02:57:44.864689 [debug] [Thread-1 ]: Began running node model.airbyte_utils.oico_users_stg 2022-07-30 02:59:35 normalization > 02:57:44.864432 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.heya_campaign_receipts_stg" 2022-07-30 02:59:35 normalization > 02:57:44.865494 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.heya_campaign_receipts_stg 2022-07-30 02:59:35 normalization > 02:57:44.865637 [debug] [Thread-2 ]: Compiling model.airbyte_utils.heya_campaign_receipts_stg 2022-07-30 02:59:35 normalization > 02:57:44.863066 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.order_issues_stg" 2022-07-30 02:59:35 normalization > 02:57:44.865015 [info ] [Thread-1 ]: 37 of 201 START view model _airbyte_airbyte_cdc.oico_users_stg.......................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:44.883355 [debug] [Thread-8 ]: On model.airbyte_utils.orders_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.orders_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`orders_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__orders_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_orders 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['type']") as type, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['quote']") as quote, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['value']") as value, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['events']") as events, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['origin']") as origin, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['status']") as status, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['comment']") as comment, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['buyer_id']") as buyer_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['discount']") as discount, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['identify']") as identify, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['payer_id']") as payer_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['po_value']") as po_value, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['pipefy_id']") as pipefy_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['conta_azul']") as conta_azul, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['last_quote']") as last_quote, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['order_form']") as order_form, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['approved_at']") as approved_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['canceled_at']") as canceled_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['final_value']") as final_value, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['po_file_url']") as po_file_url, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['client_notes']") as client_notes, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['freight_code']") as freight_code, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['freight_link']") as freight_link, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['money_saving']") as money_saving, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['oico_invoice']") as oico_invoice, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['buyer_user_id']") as buyer_user_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['expected_date']") as expected_date, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['expected_time']") as expected_time, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['fast_delivery']") as fast_delivery, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['freight_value']") as freight_value, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['internal_notes']") as internal_notes, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['payment_method']") as payment_method, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['quote_estimate']") as quote_estimate, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['automatic_quote']") as automatic_quote, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['expected_period']") as expected_period, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['financing_value']") as financing_value, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['parent_order_id']") as parent_order_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['user_preference']") as user_preference, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['quote_expires_at']") as quote_expires_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['buyer_location_id']") as buyer_location_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['client_order_form']") as client_order_form, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['flexible_delivery']") as flexible_delivery, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['shopping_list_url']") as shopping_list_url, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['cancelation_reason']") as cancelation_reason, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['client_internal_id']") as client_internal_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['more_payment_terms']") as more_payment_terms, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['cancelation_comment']") as cancelation_comment, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['first_quote_sent_at']") as first_quote_sent_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['shareable_link_hash']") as shareable_link_hash, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['internal_delivery_notes']") as internal_delivery_notes, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['expected_billing_due_date']") as expected_billing_due_date, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['last_rdo_scheduling_message_sent_at']") as last_rdo_scheduling_message_sent_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_orders as table_alias 2022-07-30 02:59:35 normalization > -- orders 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__orders_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__orders_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(type as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as type, 2022-07-30 02:59:35 normalization > cast(quote as boolean) as quote, 2022-07-30 02:59:35 normalization > cast(value as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as value, 2022-07-30 02:59:35 normalization > cast(events as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as events, 2022-07-30 02:59:35 normalization > cast(origin as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as origin, 2022-07-30 02:59:35 normalization > cast(status as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as status, 2022-07-30 02:59:35 normalization > cast(comment as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as comment, 2022-07-30 02:59:35 normalization > cast(buyer_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as buyer_id, 2022-07-30 02:59:35 normalization > cast(discount as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as discount, 2022-07-30 02:59:35 normalization > cast(identify as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as identify, 2022-07-30 02:59:35 normalization > cast(payer_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as payer_id, 2022-07-30 02:59:35 normalization > cast(po_value as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as po_value, 2022-07-30 02:59:35 normalization > cast(pipefy_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as pipefy_id, 2022-07-30 02:59:35 normalization > cast(conta_azul as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as conta_azul, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(last_quote as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as last_quote, 2022-07-30 02:59:35 normalization > cast(order_form as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as order_form, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(nullif(approved_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as approved_at, 2022-07-30 02:59:35 normalization > cast(nullif(canceled_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as canceled_at, 2022-07-30 02:59:35 normalization > cast(final_value as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as final_value, 2022-07-30 02:59:35 normalization > cast(po_file_url as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as po_file_url, 2022-07-30 02:59:35 normalization > cast(client_notes as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as client_notes, 2022-07-30 02:59:35 normalization > cast(freight_code as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as freight_code, 2022-07-30 02:59:35 normalization > cast(freight_link as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as freight_link, 2022-07-30 02:59:35 normalization > cast(money_saving as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as money_saving, 2022-07-30 02:59:35 normalization > cast(oico_invoice as boolean) as oico_invoice, 2022-07-30 02:59:35 normalization > cast(buyer_user_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as buyer_user_id, 2022-07-30 02:59:35 normalization > cast(nullif(expected_date, '') as 2022-07-30 02:59:35 normalization > date 2022-07-30 02:59:35 normalization > ) as expected_date, 2022-07-30 02:59:35 normalization > cast(expected_time as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as expected_time, 2022-07-30 02:59:35 normalization > cast(fast_delivery as boolean) as fast_delivery, 2022-07-30 02:59:35 normalization > cast(freight_value as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as freight_value, 2022-07-30 02:59:35 normalization > cast(internal_notes as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as internal_notes, 2022-07-30 02:59:35 normalization > cast(payment_method as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as payment_method, 2022-07-30 02:59:35 normalization > cast(quote_estimate as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as quote_estimate, 2022-07-30 02:59:35 normalization > cast(automatic_quote as boolean) as automatic_quote, 2022-07-30 02:59:35 normalization > cast(expected_period as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as expected_period, 2022-07-30 02:59:35 normalization > cast(financing_value as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as financing_value, 2022-07-30 02:59:35 normalization > cast(parent_order_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as parent_order_id, 2022-07-30 02:59:35 normalization > cast(user_preference as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as user_preference, 2022-07-30 02:59:35 normalization > cast(nullif(quote_expires_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as quote_expires_at, 2022-07-30 02:59:35 normalization > cast(buyer_location_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as buyer_location_id, 2022-07-30 02:59:35 normalization > cast(client_order_form as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as client_order_form, 2022-07-30 02:59:35 normalization > cast(flexible_delivery as boolean) as flexible_delivery, 2022-07-30 02:59:35 normalization > cast(shopping_list_url as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as shopping_list_url, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cast(cancelation_reason as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as cancelation_reason, 2022-07-30 02:59:35 normalization > cast(client_internal_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as client_internal_id, 2022-07-30 02:59:35 normalization > cast(more_payment_terms as boolean) as more_payment_terms, 2022-07-30 02:59:35 normalization > cast(cancelation_comment as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as cancelation_comment, 2022-07-30 02:59:35 normalization > cast(nullif(first_quote_sent_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as first_quote_sent_at, 2022-07-30 02:59:35 normalization > cast(shareable_link_hash as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as shareable_link_hash, 2022-07-30 02:59:35 normalization > cast(internal_delivery_notes as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as internal_delivery_notes, 2022-07-30 02:59:35 normalization > cast(nullif(expected_billing_due_date, '') as 2022-07-30 02:59:35 normalization > date 2022-07-30 02:59:35 normalization > ) as expected_billing_due_date, 2022-07-30 02:59:35 normalization > cast(nullif(last_rdo_scheduling_message_sent_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as last_rdo_scheduling_message_sent_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__orders_ab1 2022-07-30 02:59:35 normalization > -- orders 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__orders_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(quote as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(value as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(events as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(origin as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(status as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(comment as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(buyer_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(discount as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(identify as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(payer_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(po_value as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(pipefy_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(conta_azul as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(last_quote as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(order_form as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(approved_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(canceled_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(final_value as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(po_file_url as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(client_notes as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(freight_code as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(freight_link as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(money_saving as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(oico_invoice as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(buyer_user_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(expected_date as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(expected_time as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(fast_delivery as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(freight_value as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(internal_notes as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(payment_method as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(quote_estimate as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(automatic_quote as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(expected_period as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(financing_value as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(parent_order_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(user_preference as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(quote_expires_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(buyer_location_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(client_order_form as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(flexible_delivery as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(shopping_list_url as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(cancelation_reason as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(client_internal_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(more_payment_terms as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(cancelation_comment as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(first_quote_sent_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(shareable_link_hash as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(internal_delivery_notes as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(expected_billing_due_date as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(last_rdo_scheduling_message_sent_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_orders_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__orders_ab2 tmp 2022-07-30 02:59:35 normalization > -- orders 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:44.890698 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.oico_users_stg" 2022-07-30 02:59:35 normalization > 02:57:44.893999 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.heya_campaign_receipts_stg" 2022-07-30 02:59:35 normalization > 02:57:44.895002 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.oico_users_stg 2022-07-30 02:59:35 normalization > 02:57:44.895279 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:44.897587 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:44.907531 [info ] [Thread-6 ]: 30 of 201 OK created view model _airbyte_airbyte_cdc.memento_states_stg................................................. [OK in 0.91s] 2022-07-30 02:59:35 normalization > 02:57:44.905979 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:44.900267 [debug] [Thread-1 ]: Compiling model.airbyte_utils.oico_users_stg 2022-07-30 02:59:35 normalization > 02:57:44.907736 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:44.908591 [debug] [Thread-7 ]: On model.airbyte_utils.order_issues_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.order_issues_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`order_issues_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__order_issues_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_order_issues 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['type']") as type, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['status']") as status, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['order_id']") as order_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['canceled_at']") as canceled_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['description']") as description, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['confirmed_at']") as confirmed_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['buyer_user_id']") as buyer_user_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['product_problems']") as product_problems, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['delivery_problems']") as delivery_problems, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_order_issues as table_alias 2022-07-30 02:59:35 normalization > -- order_issues 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__order_issues_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__order_issues_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(type as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as type, 2022-07-30 02:59:35 normalization > cast(status as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as status, 2022-07-30 02:59:35 normalization > cast(order_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as order_id, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(nullif(canceled_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as canceled_at, 2022-07-30 02:59:35 normalization > cast(description as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as description, 2022-07-30 02:59:35 normalization > cast(nullif(confirmed_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as confirmed_at, 2022-07-30 02:59:35 normalization > cast(buyer_user_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as buyer_user_id, 2022-07-30 02:59:35 normalization > cast(product_problems as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as product_problems, 2022-07-30 02:59:35 normalization > cast(delivery_problems as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as delivery_problems, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__order_issues_ab1 2022-07-30 02:59:35 normalization > -- order_issues 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__order_issues_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(status as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(order_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(canceled_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(description as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(confirmed_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(buyer_user_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(product_problems as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(delivery_problems as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_order_issues_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__order_issues_ab2 tmp 2022-07-30 02:59:35 normalization > -- order_issues 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:44.909247 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.memento_states_stg 2022-07-30 02:59:35 normalization > 02:57:44.947631 [debug] [Thread-6 ]: Began running node model.airbyte_utils.omie_accounts_stg 2022-07-30 02:59:35 normalization > 02:57:44.931268 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.heya_campaign_receipts_stg 2022-07-30 02:59:35 normalization > 02:57:44.947212 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.oico_users_stg" 2022-07-30 02:59:35 normalization > 02:57:44.910094 [info ] [Thread-3 ]: 29 of 201 OK created view model _airbyte_airbyte_cdc.memento_sessions_stg............................................... [OK in 0.96s] 2022-07-30 02:59:35 normalization > 02:57:44.947956 [info ] [Thread-6 ]: 38 of 201 START view model _airbyte_airbyte_cdc.omie_accounts_stg....................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:44.957697 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.omie_accounts_stg" 2022-07-30 02:59:35 normalization > 02:57:44.955839 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.memento_sessions_stg 2022-07-30 02:59:35 normalization > 02:57:44.963603 [debug] [Thread-3 ]: Began running node model.airbyte_utils.popular_searches_stg 2022-07-30 02:59:35 normalization > 02:57:44.963146 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.omie_accounts_stg 2022-07-30 02:59:35 normalization > 02:57:44.964269 [debug] [Thread-6 ]: Compiling model.airbyte_utils.omie_accounts_stg 2022-07-30 02:59:35 normalization > 02:57:44.964028 [info ] [Thread-3 ]: 39 of 201 START view model _airbyte_airbyte_cdc.popular_searches_stg.................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:44.952699 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.heya_campaign_receipts_stg" 2022-07-30 02:59:35 normalization > 02:57:44.971204 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.popular_searches_stg" 2022-07-30 02:59:35 normalization > 02:57:44.971423 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:44.998386 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.oico_users_stg 2022-07-30 02:59:35 normalization > 02:57:44.991156 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:44.997967 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.popular_searches_stg 2022-07-30 02:59:35 normalization > 02:57:45.003653 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.oico_users_stg" 2022-07-30 02:59:35 normalization > 02:57:44.990749 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.omie_accounts_stg" 2022-07-30 02:59:35 normalization > 02:57:45.005958 [debug] [Thread-3 ]: Compiling model.airbyte_utils.popular_searches_stg 2022-07-30 02:59:35 normalization > 02:57:45.010744 [debug] [Thread-2 ]: On model.airbyte_utils.heya_campaign_receipts_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.heya_campaign_receipts_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`heya_campaign_receipts_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__heya_campaign_receipts_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_heya_campaign_receipts 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['sent_at']") as sent_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['user_id']") as user_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['step_gid']") as step_gid, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['user_type']") as user_type, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_heya_campaign_receipts as table_alias 2022-07-30 02:59:35 normalization > -- heya_campaign_receipts 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__heya_campaign_receipts_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__heya_campaign_receipts_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(nullif(sent_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as sent_at, 2022-07-30 02:59:35 normalization > cast(user_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as user_id, 2022-07-30 02:59:35 normalization > cast(step_gid as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as step_gid, 2022-07-30 02:59:35 normalization > cast(user_type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as user_type, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__heya_campaign_receipts_ab1 2022-07-30 02:59:35 normalization > -- heya_campaign_receipts 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__heya_campaign_receipts_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(sent_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(user_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(step_gid as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(user_type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_heya_campaign_receipts_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__heya_campaign_receipts_ab2 tmp 2022-07-30 02:59:35 normalization > -- heya_campaign_receipts 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:45.012018 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:45.024946 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:45.043647 [debug] [Thread-6 ]: Began executing node model.airbyte_utils.omie_accounts_stg 2022-07-30 02:59:35 normalization > 02:57:45.051612 [debug] [Thread-6 ]: Writing runtime SQL for node "model.airbyte_utils.omie_accounts_stg" 2022-07-30 02:59:35 normalization > 02:57:45.062140 [debug] [Thread-6 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:45.058985 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:45.067728 [info ] [Thread-4 ]: 32 of 201 OK created view model _airbyte_airbyte_cdc.oico_radar_products_stg............................................ [OK in 0.87s] 2022-07-30 02:59:35 normalization > 02:57:45.066304 [debug] [Thread-1 ]: On model.airbyte_utils.oico_users_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.oico_users_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`oico_users_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__oico_users_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_oico_users 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['email']") as email, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['active']") as active, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['encrypted_password']") as encrypted_password, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['remember_created_at']") as remember_created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['reset_password_token']") as reset_password_token, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['reset_password_sent_at']") as reset_password_sent_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_oico_users as table_alias 2022-07-30 02:59:35 normalization > -- oico_users 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__oico_users_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__oico_users_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(email as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as email, 2022-07-30 02:59:35 normalization > cast(active as boolean) as active, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cast(encrypted_password as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as encrypted_password, 2022-07-30 02:59:35 normalization > cast(nullif(remember_created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as remember_created_at, 2022-07-30 02:59:35 normalization > cast(reset_password_token as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as reset_password_token, 2022-07-30 02:59:35 normalization > cast(nullif(reset_password_sent_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as reset_password_sent_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__oico_users_ab1 2022-07-30 02:59:35 normalization > -- oico_users 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__oico_users_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(email as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(active as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(encrypted_password as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(remember_created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(reset_password_token as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(reset_password_sent_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_oico_users_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__oico_users_ab2 tmp 2022-07-30 02:59:35 normalization > -- oico_users 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:45.055750 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.popular_searches_stg" 2022-07-30 02:59:35 normalization > 02:57:45.072667 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.oico_radar_products_stg 2022-07-30 02:59:35 normalization > 02:57:45.077007 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:45.079976 [info ] [Thread-5 ]: 33 of 201 OK created view model _airbyte_airbyte_cdc.order_feedbacks_stg................................................ [OK in 0.84s] 2022-07-30 02:59:35 normalization > 02:57:45.077836 [debug] [Thread-4 ]: Began running node model.airbyte_utils.payer_buyer_locations_stg 2022-07-30 02:59:35 normalization > 02:57:45.080718 [info ] [Thread-4 ]: 40 of 201 START view model _airbyte_airbyte_cdc.payer_buyer_locations_stg............................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:45.077544 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:45.081459 [debug] [Thread-3 ]: Began executing node model.airbyte_utils.popular_searches_stg 2022-07-30 02:59:35 normalization > 02:57:45.088796 [debug] [Thread-3 ]: Writing runtime SQL for node "model.airbyte_utils.popular_searches_stg" 2022-07-30 02:59:35 normalization > 02:57:45.089618 [debug] [Thread-6 ]: On model.airbyte_utils.omie_accounts_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.omie_accounts_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`omie_accounts_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__omie_accounts_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_omie_accounts 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['name']") as name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['document']") as document, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['credential']") as credential, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_omie_accounts as table_alias 2022-07-30 02:59:35 normalization > -- omie_accounts 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__omie_accounts_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__omie_accounts_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as name, 2022-07-30 02:59:35 normalization > cast(document as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as document, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(credential as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as credential, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__omie_accounts_ab1 2022-07-30 02:59:35 normalization > -- omie_accounts 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__omie_accounts_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(document as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(credential as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_omie_accounts_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__omie_accounts_ab2 tmp 2022-07-30 02:59:35 normalization > -- omie_accounts 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:45.089970 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.order_feedbacks_stg 2022-07-30 02:59:35 normalization > 02:57:45.093585 [debug] [Thread-5 ]: Began running node model.airbyte_utils.payers_stg 2022-07-30 02:59:35 normalization > 02:57:45.093964 [info ] [Thread-5 ]: 41 of 201 START view model _airbyte_airbyte_cdc.payers_stg.............................................................. [RUN] 2022-07-30 02:59:35 normalization > 02:57:45.091216 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.payer_buyer_locations_stg" 2022-07-30 02:59:35 normalization > 02:57:45.095864 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.payer_buyer_locations_stg 2022-07-30 02:59:35 normalization > 02:57:45.099635 [debug] [Thread-4 ]: Compiling model.airbyte_utils.payer_buyer_locations_stg 2022-07-30 02:59:35 normalization > 02:57:45.095282 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.payers_stg" 2022-07-30 02:59:35 normalization > 02:57:45.105946 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.payers_stg 2022-07-30 02:59:35 normalization > 02:57:45.106246 [debug] [Thread-5 ]: Compiling model.airbyte_utils.payers_stg 2022-07-30 02:59:35 normalization > 02:57:45.128324 [debug] [Thread-3 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:45.164326 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.payer_buyer_locations_stg" 2022-07-30 02:59:35 normalization > 02:57:45.173602 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:45.173789 [debug] [Thread-4 ]: Began executing node model.airbyte_utils.payer_buyer_locations_stg 2022-07-30 02:59:35 normalization > 02:57:45.172888 [debug] [Thread-3 ]: On model.airbyte_utils.popular_searches_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.popular_searches_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`popular_searches_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__popular_searches_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_popular_searches 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['name']") as name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_popular_searches as table_alias 2022-07-30 02:59:35 normalization > -- popular_searches 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__popular_searches_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__popular_searches_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as name, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__popular_searches_ab1 2022-07-30 02:59:35 normalization > -- popular_searches 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__popular_searches_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_popular_searches_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__popular_searches_ab2 tmp 2022-07-30 02:59:35 normalization > -- popular_searches 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:45.178239 [debug] [Thread-4 ]: Writing runtime SQL for node "model.airbyte_utils.payer_buyer_locations_stg" 2022-07-30 02:59:35 normalization > 02:57:45.193644 [debug] [Thread-4 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:45.223597 [debug] [Thread-4 ]: On model.airbyte_utils.payer_buyer_locations_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.payer_buyer_locations_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`payer_buyer_locations_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__payer_buyer_locations_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_payer_buyer_locations 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['buyer_id']") as buyer_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['payer_id']") as payer_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['buyer_location_id']") as buyer_location_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_payer_buyer_locations as table_alias 2022-07-30 02:59:35 normalization > -- payer_buyer_locations 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__payer_buyer_locations_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__payer_buyer_locations_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(buyer_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as buyer_id, 2022-07-30 02:59:35 normalization > cast(payer_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as payer_id, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(buyer_location_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as buyer_location_id, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__payer_buyer_locations_ab1 2022-07-30 02:59:35 normalization > -- payer_buyer_locations 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__payer_buyer_locations_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(buyer_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(payer_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(buyer_location_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_payer_buyer_locations_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__payer_buyer_locations_ab2 tmp 2022-07-30 02:59:35 normalization > -- payer_buyer_locations 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:45.261315 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.payers_stg" 2022-07-30 02:59:35 normalization > 02:57:45.262539 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:45.262831 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.payers_stg 2022-07-30 02:59:35 normalization > 02:57:45.270184 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.payers_stg" 2022-07-30 02:59:35 normalization > 02:57:45.270831 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:45.276444 [debug] [Thread-5 ]: On model.airbyte_utils.payers_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.payers_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`payers_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__payers_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_payers 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['cpf']") as cpf, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['cnae']") as cnae, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['cnpj']") as cnpj, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['name']") as name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['email']") as email, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['omie_id']") as omie_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['activity']") as activity, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['bank_code']") as bank_code, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['conta_azul']") as conta_azul, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['bank_branch']") as bank_branch, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['bank_account']") as bank_account, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['credit_limit']") as credit_limit, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['phone_number']") as phone_number, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['final_consumer']") as final_consumer, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['internal_notes']") as internal_notes, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['billing_address']") as billing_address, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['national_simple']") as national_simple, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['payer_confirmed']") as payer_confirmed, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['tax_mode_simples']") as tax_mode_simples, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['payer_confirmed_at']") as payer_confirmed_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['payment_terms_days']") as payment_terms_days, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['state_registration']") as state_registration, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['billing_address_city']") as billing_address_city, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['billing_address_state']") as billing_address_state, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['billing_address_street']") as billing_address_street, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['billing_address_zipcode']") as billing_address_zipcode, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['bank_account_check_digit']") as bank_account_check_digit, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['bank_account_holder_name']") as bank_account_holder_name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['billing_address_district']") as billing_address_district, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['bank_account_holder_document']") as bank_account_holder_document, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_payers as table_alias 2022-07-30 02:59:35 normalization > -- payers 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__payers_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__payers_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(cpf as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as cpf, 2022-07-30 02:59:35 normalization > cast(cnae as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as cnae, 2022-07-30 02:59:35 normalization > cast(cnpj as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as cnpj, 2022-07-30 02:59:35 normalization > cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as name, 2022-07-30 02:59:35 normalization > cast(email as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as email, 2022-07-30 02:59:35 normalization > cast(omie_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as omie_id, 2022-07-30 02:59:35 normalization > cast(activity as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as activity, 2022-07-30 02:59:35 normalization > cast(bank_code as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as bank_code, 2022-07-30 02:59:35 normalization > cast(conta_azul as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as conta_azul, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(bank_branch as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as bank_branch, 2022-07-30 02:59:35 normalization > cast(bank_account as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as bank_account, 2022-07-30 02:59:35 normalization > cast(credit_limit as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as credit_limit, 2022-07-30 02:59:35 normalization > cast(phone_number as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as phone_number, 2022-07-30 02:59:35 normalization > cast(final_consumer as boolean) as final_consumer, 2022-07-30 02:59:35 normalization > cast(internal_notes as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as internal_notes, 2022-07-30 02:59:35 normalization > cast(billing_address as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as billing_address, 2022-07-30 02:59:35 normalization > cast(national_simple as boolean) as national_simple, 2022-07-30 02:59:35 normalization > cast(payer_confirmed as boolean) as payer_confirmed, 2022-07-30 02:59:35 normalization > cast(tax_mode_simples as boolean) as tax_mode_simples, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cast(nullif(payer_confirmed_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as payer_confirmed_at, 2022-07-30 02:59:35 normalization > cast(payment_terms_days as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as payment_terms_days, 2022-07-30 02:59:35 normalization > cast(state_registration as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as state_registration, 2022-07-30 02:59:35 normalization > cast(billing_address_city as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as billing_address_city, 2022-07-30 02:59:35 normalization > cast(billing_address_state as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as billing_address_state, 2022-07-30 02:59:35 normalization > cast(billing_address_street as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as billing_address_street, 2022-07-30 02:59:35 normalization > cast(billing_address_zipcode as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as billing_address_zipcode, 2022-07-30 02:59:35 normalization > cast(bank_account_check_digit as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as bank_account_check_digit, 2022-07-30 02:59:35 normalization > cast(bank_account_holder_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as bank_account_holder_name, 2022-07-30 02:59:35 normalization > cast(billing_address_district as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as billing_address_district, 2022-07-30 02:59:35 normalization > cast(bank_account_holder_document as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as bank_account_holder_document, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__payers_ab1 2022-07-30 02:59:35 normalization > -- payers 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__payers_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(cpf as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(cnae as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(cnpj as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(email as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(omie_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(activity as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(bank_code as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(conta_azul as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(bank_branch as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(bank_account as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(credit_limit as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(phone_number as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(final_consumer as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(internal_notes as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(billing_address as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(national_simple as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(payer_confirmed as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(tax_mode_simples as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(payer_confirmed_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(payment_terms_days as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(state_registration as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(billing_address_city as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(billing_address_state as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(billing_address_street as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(billing_address_zipcode as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(bank_account_check_digit as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(bank_account_holder_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(billing_address_district as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(bank_account_holder_document as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_payers_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__payers_ab2 tmp 2022-07-30 02:59:35 normalization > -- payers 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:45.750675 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:45.751593 [info ] [Thread-8 ]: 35 of 201 OK created view model _airbyte_airbyte_cdc.orders_stg......................................................... [OK in 1.35s] 2022-07-30 02:59:35 normalization > 02:57:45.752248 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.orders_stg 2022-07-30 02:59:35 normalization > 02:57:45.752594 [debug] [Thread-8 ]: Began running node model.airbyte_utils.payments_stg 2022-07-30 02:59:35 normalization > 02:57:45.753267 [info ] [Thread-8 ]: 42 of 201 START view model _airbyte_airbyte_cdc.payments_stg............................................................ [RUN] 2022-07-30 02:59:35 normalization > 02:57:45.754297 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.payments_stg" 2022-07-30 02:59:35 normalization > 02:57:45.754464 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.payments_stg 2022-07-30 02:59:35 normalization > 02:57:45.754607 [debug] [Thread-8 ]: Compiling model.airbyte_utils.payments_stg 2022-07-30 02:59:35 normalization > 02:57:45.804551 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:45.814091 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:45.821713 [info ] [Thread-4 ]: 40 of 201 OK created view model _airbyte_airbyte_cdc.payer_buyer_locations_stg.......................................... [OK in 0.73s] 2022-07-30 02:59:35 normalization > 02:57:45.815618 [info ] [Thread-2 ]: 36 of 201 OK created view model _airbyte_airbyte_cdc.heya_campaign_receipts_stg......................................... [OK in 0.95s] 2022-07-30 02:59:35 normalization > 02:57:45.823104 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.payments_stg" 2022-07-30 02:59:35 normalization > 02:57:45.825003 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:45.825171 [debug] [Thread-8 ]: Began executing node model.airbyte_utils.payments_stg 2022-07-30 02:59:35 normalization > 02:57:45.824446 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.payer_buyer_locations_stg 2022-07-30 02:59:35 normalization > 02:57:45.830265 [debug] [Thread-4 ]: Began running node model.airbyte_utils.requested_products_stg 2022-07-30 02:59:35 normalization > 02:57:45.830508 [info ] [Thread-4 ]: 43 of 201 START view model _airbyte_airbyte_cdc.requested_products_stg.................................................. [RUN] 2022-07-30 02:59:35 normalization > 02:57:45.829924 [debug] [Thread-8 ]: Writing runtime SQL for node "model.airbyte_utils.payments_stg" 2022-07-30 02:59:35 normalization > 02:57:45.832674 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:45.832282 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.requested_products_stg" 2022-07-30 02:59:35 normalization > 02:57:45.832916 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.requested_products_stg 2022-07-30 02:59:35 normalization > 02:57:45.833037 [debug] [Thread-4 ]: Compiling model.airbyte_utils.requested_products_stg 2022-07-30 02:59:35 normalization > 02:57:45.831223 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.heya_campaign_receipts_stg 2022-07-30 02:59:35 normalization > 02:57:45.840924 [debug] [Thread-2 ]: Began running node model.airbyte_utils.payment_installments_stg 2022-07-30 02:59:35 normalization > 02:57:45.841743 [info ] [Thread-2 ]: 44 of 201 START view model _airbyte_airbyte_cdc.payment_installments_stg................................................ [RUN] 2022-07-30 02:59:35 normalization > 02:57:45.843285 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.payment_installments_stg" 2022-07-30 02:59:35 normalization > 02:57:45.844063 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.payment_installments_stg 2022-07-30 02:59:35 normalization > 02:57:45.844278 [debug] [Thread-2 ]: Compiling model.airbyte_utils.payment_installments_stg 2022-07-30 02:59:35 normalization > 02:57:45.868543 [debug] [Thread-8 ]: On model.airbyte_utils.payments_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.payments_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`payments_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__payments_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_payments 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['type']") as type, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['status']") as status, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['omie_id']") as omie_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['discount']") as discount, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['order_id']") as order_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['payer_id']") as payer_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['store_id']") as store_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['xml_link']") as xml_link, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_by']") as created_by, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['extra_fees']") as extra_fees, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['paid_value']") as paid_value, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['canceled_at']") as canceled_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['payment_value']") as payment_value, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['omie_account_id']") as omie_account_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['postmark_read_at']") as postmark_read_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['purchase_order_id']") as purchase_order_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['tax_document_link']") as tax_document_link, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['freight_partner_id']") as freight_partner_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['tax_note_issued_at']") as tax_note_issued_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['postmark_message_id']") as postmark_message_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['purchase_order_link']") as purchase_order_link, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['tax_document_number']") as tax_document_number, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_payments as table_alias 2022-07-30 02:59:35 normalization > -- payments 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__payments_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__payments_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as type, 2022-07-30 02:59:35 normalization > cast(status as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as status, 2022-07-30 02:59:35 normalization > cast(omie_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as omie_id, 2022-07-30 02:59:35 normalization > cast(discount as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as discount, 2022-07-30 02:59:35 normalization > cast(order_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as order_id, 2022-07-30 02:59:35 normalization > cast(payer_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as payer_id, 2022-07-30 02:59:35 normalization > cast(store_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as store_id, 2022-07-30 02:59:35 normalization > cast(xml_link as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as xml_link, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(created_by as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as created_by, 2022-07-30 02:59:35 normalization > cast(extra_fees as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as extra_fees, 2022-07-30 02:59:35 normalization > cast(paid_value as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as paid_value, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(nullif(canceled_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as canceled_at, 2022-07-30 02:59:35 normalization > cast(payment_value as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as payment_value, 2022-07-30 02:59:35 normalization > cast(omie_account_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as omie_account_id, 2022-07-30 02:59:35 normalization > cast(nullif(postmark_read_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as postmark_read_at, 2022-07-30 02:59:35 normalization > cast(purchase_order_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as purchase_order_id, 2022-07-30 02:59:35 normalization > cast(tax_document_link as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as tax_document_link, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cast(freight_partner_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as freight_partner_id, 2022-07-30 02:59:35 normalization > cast(nullif(tax_note_issued_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as tax_note_issued_at, 2022-07-30 02:59:35 normalization > cast(postmark_message_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as postmark_message_id, 2022-07-30 02:59:35 normalization > cast(purchase_order_link as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as purchase_order_link, 2022-07-30 02:59:35 normalization > cast(tax_document_number as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as tax_document_number, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__payments_ab1 2022-07-30 02:59:35 normalization > -- payments 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__payments_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(status as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(omie_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(discount as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(order_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(payer_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(store_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(xml_link as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_by as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(extra_fees as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(paid_value as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(canceled_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(payment_value as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(omie_account_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(postmark_read_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(purchase_order_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(tax_document_link as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(freight_partner_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(tax_note_issued_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(postmark_message_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(purchase_order_link as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(tax_document_number as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_payments_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__payments_ab2 tmp 2022-07-30 02:59:35 normalization > -- payments 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:45.898735 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:45.921048 [info ] [Thread-7 ]: 34 of 201 OK created view model _airbyte_airbyte_cdc.order_issues_stg................................................... [OK in 1.52s] 2022-07-30 02:59:35 normalization > 02:57:45.920059 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.payment_installments_stg" 2022-07-30 02:59:35 normalization > 02:57:45.930619 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.order_issues_stg 2022-07-30 02:59:35 normalization > 02:57:45.939887 [debug] [Thread-7 ]: Began running node model.airbyte_utils.order_categories_stg 2022-07-30 02:59:35 normalization > 02:57:45.940845 [info ] [Thread-7 ]: 45 of 201 START view model _airbyte_airbyte_cdc.order_categories_stg.................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:45.942322 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.order_categories_stg" 2022-07-30 02:59:35 normalization > 02:57:45.942591 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.order_categories_stg 2022-07-30 02:59:35 normalization > 02:57:45.942784 [debug] [Thread-7 ]: Compiling model.airbyte_utils.order_categories_stg 2022-07-30 02:59:35 normalization > 02:57:45.951013 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.requested_products_stg" 2022-07-30 02:59:35 normalization > 02:57:45.951594 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:45.951858 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.payment_installments_stg 2022-07-30 02:59:35 normalization > 02:57:45.956515 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.payment_installments_stg" 2022-07-30 02:59:35 normalization > 02:57:45.962656 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:45.962066 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:45.963653 [debug] [Thread-4 ]: Began executing node model.airbyte_utils.requested_products_stg 2022-07-30 02:59:35 normalization > 02:57:45.970051 [debug] [Thread-4 ]: Writing runtime SQL for node "model.airbyte_utils.requested_products_stg" 2022-07-30 02:59:35 normalization > 02:57:45.982885 [debug] [Thread-2 ]: On model.airbyte_utils.payment_installments_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.payment_installments_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`payment_installments_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__payment_installments_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_payment_installments 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['link']") as link, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['type']") as type, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['status']") as status, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['paid_at']") as paid_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['due_date']") as due_date, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['metadata']") as metadata, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['paid_value']") as paid_value, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['payment_id']") as payment_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['canceled_at']") as canceled_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['receipt_url']") as receipt_url, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['advance_payment']") as advance_payment, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['bank_receipt_url']") as bank_receipt_url, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['external_identify']") as external_identify, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['installment_value']") as installment_value, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['original_due_date']") as original_due_date, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['installment_number']") as installment_number, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['transfeera_batch_id']") as transfeera_batch_id, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_payment_installments as table_alias 2022-07-30 02:59:35 normalization > -- payment_installments 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__payment_installments_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__payment_installments_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(link as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as link, 2022-07-30 02:59:35 normalization > cast(type as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as type, 2022-07-30 02:59:35 normalization > cast(status as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as status, 2022-07-30 02:59:35 normalization > cast(nullif(paid_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as paid_at, 2022-07-30 02:59:35 normalization > cast(nullif(due_date, '') as 2022-07-30 02:59:35 normalization > date 2022-07-30 02:59:35 normalization > ) as due_date, 2022-07-30 02:59:35 normalization > cast(metadata as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as metadata, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(paid_value as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as paid_value, 2022-07-30 02:59:35 normalization > cast(payment_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as payment_id, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(nullif(canceled_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as canceled_at, 2022-07-30 02:59:35 normalization > cast(receipt_url as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as receipt_url, 2022-07-30 02:59:35 normalization > cast(advance_payment as boolean) as advance_payment, 2022-07-30 02:59:35 normalization > cast(bank_receipt_url as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as bank_receipt_url, 2022-07-30 02:59:35 normalization > cast(external_identify as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as external_identify, 2022-07-30 02:59:35 normalization > cast(installment_value as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as installment_value, 2022-07-30 02:59:35 normalization > cast(nullif(original_due_date, '') as 2022-07-30 02:59:35 normalization > date 2022-07-30 02:59:35 normalization > ) as original_due_date, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cast(installment_number as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as installment_number, 2022-07-30 02:59:35 normalization > cast(transfeera_batch_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as transfeera_batch_id, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__payment_installments_ab1 2022-07-30 02:59:35 normalization > -- payment_installments 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__payment_installments_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(link as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(status as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(paid_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(due_date as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(metadata as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(paid_value as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(payment_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(canceled_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(receipt_url as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(advance_payment as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(bank_receipt_url as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(external_identify as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(installment_value as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(original_due_date as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(installment_number as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(transfeera_batch_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_payment_installments_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__payment_installments_ab2 tmp 2022-07-30 02:59:35 normalization > -- payment_installments 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:45.985323 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:45.988412 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.order_categories_stg" 2022-07-30 02:59:35 normalization > 02:57:45.988956 [debug] [Thread-4 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:45.996618 [info ] [Thread-1 ]: 37 of 201 OK created view model _airbyte_airbyte_cdc.oico_users_stg..................................................... [OK in 1.11s] 2022-07-30 02:59:35 normalization > 02:57:45.997363 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:46.000439 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.oico_users_stg 2022-07-30 02:59:35 normalization > 02:57:46.006437 [debug] [Thread-1 ]: Began running node model.airbyte_utils.product_canonical_categories_stg 2022-07-30 02:59:35 normalization > 02:57:46.007338 [info ] [Thread-1 ]: 46 of 201 START view model _airbyte_airbyte_cdc.product_canonical_categories_stg........................................ [RUN] 2022-07-30 02:59:35 normalization > 02:57:46.009471 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.product_canonical_categories_stg" 2022-07-30 02:59:35 normalization > 02:57:46.009707 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.product_canonical_categories_stg 2022-07-30 02:59:35 normalization > 02:57:46.009899 [debug] [Thread-1 ]: Compiling model.airbyte_utils.product_canonical_categories_stg 2022-07-30 02:59:35 normalization > 02:57:46.005972 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.order_categories_stg 2022-07-30 02:59:35 normalization > 02:57:46.023115 [debug] [Thread-4 ]: On model.airbyte_utils.requested_products_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.requested_products_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`requested_products_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__requested_products_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_requested_products 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['comment']") as comment, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['order_id']") as order_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['quantity']") as quantity, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['deleted_at']") as deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['description']") as description, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['unavailable']") as unavailable, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['done_by_client']") as done_by_client, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['user_preference']") as user_preference, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['product_order_id']") as product_order_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['original_description']") as original_description, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['product_canonical_id']") as product_canonical_id, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_requested_products as table_alias 2022-07-30 02:59:35 normalization > -- requested_products 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__requested_products_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__requested_products_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(comment as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as comment, 2022-07-30 02:59:35 normalization > cast(order_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as order_id, 2022-07-30 02:59:35 normalization > cast(quantity as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as quantity, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(deleted_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as deleted_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(description as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as description, 2022-07-30 02:59:35 normalization > cast(unavailable as boolean) as unavailable, 2022-07-30 02:59:35 normalization > cast(done_by_client as boolean) as done_by_client, 2022-07-30 02:59:35 normalization > cast(user_preference as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as user_preference, 2022-07-30 02:59:35 normalization > cast(product_order_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as product_order_id, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cast(original_description as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as original_description, 2022-07-30 02:59:35 normalization > cast(product_canonical_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as product_canonical_id, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__requested_products_ab1 2022-07-30 02:59:35 normalization > -- requested_products 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__requested_products_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(comment as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(order_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(quantity as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(description as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(unavailable as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(done_by_client as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(user_preference as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(product_order_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(original_description as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(product_canonical_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_requested_products_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__requested_products_ab2 tmp 2022-07-30 02:59:35 normalization > -- requested_products 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:46.033605 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.order_categories_stg" 2022-07-30 02:59:35 normalization > 02:57:46.049763 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.product_canonical_categories_stg" 2022-07-30 02:59:35 normalization > 02:57:46.053482 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:46.058038 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:46.058499 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:46.059460 [info ] [Thread-6 ]: 38 of 201 OK created view model _airbyte_airbyte_cdc.omie_accounts_stg.................................................. [OK in 1.10s] 2022-07-30 02:59:35 normalization > 02:57:46.059764 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:46.060481 [info ] [Thread-5 ]: 41 of 201 OK created view model _airbyte_airbyte_cdc.payers_stg......................................................... [OK in 0.97s] 2022-07-30 02:59:35 normalization > 02:57:46.071361 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.omie_accounts_stg 2022-07-30 02:59:35 normalization > 02:57:46.071875 [debug] [Thread-6 ]: Began running node model.airbyte_utils.roi_products_stg 2022-07-30 02:59:35 normalization > 02:57:46.073009 [info ] [Thread-6 ]: 47 of 201 START view model _airbyte_airbyte_cdc.roi_products_stg........................................................ [RUN] 2022-07-30 02:59:35 normalization > 02:57:46.067013 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.product_canonical_categories_stg 2022-07-30 02:59:35 normalization > 02:57:46.075977 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.payers_stg 2022-07-30 02:59:35 normalization > 02:57:46.087015 [debug] [Thread-5 ]: Began running node model.airbyte_utils.reports_stg 2022-07-30 02:59:35 normalization > 02:57:46.086724 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.product_canonical_categories_stg" 2022-07-30 02:59:35 normalization > 02:57:46.083776 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.roi_products_stg" 2022-07-30 02:59:35 normalization > 02:57:46.087328 [debug] [Thread-7 ]: On model.airbyte_utils.order_categories_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.order_categories_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`order_categories_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__order_categories_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_order_categories 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['order_id']") as order_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['category_id']") as category_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_order_categories as table_alias 2022-07-30 02:59:35 normalization > -- order_categories 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__order_categories_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__order_categories_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(order_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as order_id, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(category_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as category_id, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__order_categories_ab1 2022-07-30 02:59:35 normalization > -- order_categories 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__order_categories_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(order_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(category_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_order_categories_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__order_categories_ab2 tmp 2022-07-30 02:59:35 normalization > -- order_categories 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:46.088002 [info ] [Thread-5 ]: 48 of 201 START view model _airbyte_airbyte_cdc.reports_stg............................................................. [RUN] 2022-07-30 02:59:35 normalization > 02:57:46.096604 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.reports_stg" 2022-07-30 02:59:35 normalization > 02:57:46.091360 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.roi_products_stg 2022-07-30 02:59:35 normalization > 02:57:46.093017 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:46.090720 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:46.096868 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.reports_stg 2022-07-30 02:59:35 normalization > 02:57:46.099105 [debug] [Thread-5 ]: Compiling model.airbyte_utils.reports_stg 2022-07-30 02:59:35 normalization > 02:57:46.098760 [info ] [Thread-3 ]: 39 of 201 OK created view model _airbyte_airbyte_cdc.popular_searches_stg............................................... [OK in 1.13s] 2022-07-30 02:59:35 normalization > 02:57:46.097677 [debug] [Thread-6 ]: Compiling model.airbyte_utils.roi_products_stg 2022-07-30 02:59:35 normalization > 02:57:46.125147 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.popular_searches_stg 2022-07-30 02:59:35 normalization > 02:57:46.130655 [debug] [Thread-3 ]: Began running node model.airbyte_utils.product_orders_stg 2022-07-30 02:59:35 normalization > 02:57:46.131283 [info ] [Thread-3 ]: 49 of 201 START view model _airbyte_airbyte_cdc.product_orders_stg...................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:46.132589 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.product_orders_stg" 2022-07-30 02:59:35 normalization > 02:57:46.145199 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.product_orders_stg 2022-07-30 02:59:35 normalization > 02:57:46.150740 [debug] [Thread-3 ]: Compiling model.airbyte_utils.product_orders_stg 2022-07-30 02:59:35 normalization > 02:57:46.173666 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.roi_products_stg" 2022-07-30 02:59:35 normalization > 02:57:46.173963 [debug] [Thread-1 ]: On model.airbyte_utils.product_canonical_categories_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.product_canonical_categories_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`product_canonical_categories_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__product_canonical_categories_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_product_canonical_categories 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['category_id']") as category_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['product_canonical_id']") as product_canonical_id, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_product_canonical_categories as table_alias 2022-07-30 02:59:35 normalization > -- product_canonical_categories 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__product_canonical_categories_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__product_canonical_categories_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(category_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as category_id, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cast(product_canonical_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as product_canonical_id, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__product_canonical_categories_ab1 2022-07-30 02:59:35 normalization > -- product_canonical_categories 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__product_canonical_categories_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(category_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(product_canonical_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_product_canonical_categories_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__product_canonical_categories_ab2 tmp 2022-07-30 02:59:35 normalization > -- product_canonical_categories 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:46.176172 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.reports_stg" 2022-07-30 02:59:35 normalization > 02:57:46.185550 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:46.186136 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:46.209842 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.reports_stg 2022-07-30 02:59:35 normalization > 02:57:46.202745 [debug] [Thread-6 ]: Began executing node model.airbyte_utils.roi_products_stg 2022-07-30 02:59:35 normalization > 02:57:46.214542 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.reports_stg" 2022-07-30 02:59:35 normalization > 02:57:46.230806 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:46.224771 [debug] [Thread-6 ]: Writing runtime SQL for node "model.airbyte_utils.roi_products_stg" 2022-07-30 02:59:35 normalization > 02:57:46.239091 [debug] [Thread-6 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:46.251509 [debug] [Thread-5 ]: On model.airbyte_utils.reports_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.reports_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`reports_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__reports_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_reports 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['sended']") as sended, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['message']") as message, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['buyer_user_id']") as buyer_user_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_reports as table_alias 2022-07-30 02:59:35 normalization > -- reports 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__reports_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__reports_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(sended as boolean) as sended, 2022-07-30 02:59:35 normalization > cast(message as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as message, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(buyer_user_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as buyer_user_id, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__reports_ab1 2022-07-30 02:59:35 normalization > -- reports 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__reports_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(sended as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(message as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(buyer_user_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_reports_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__reports_ab2 tmp 2022-07-30 02:59:35 normalization > -- reports 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:46.252807 [debug] [Thread-6 ]: On model.airbyte_utils.roi_products_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.roi_products_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`roi_products_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__roi_products_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_roi_products 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['name']") as name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['price']") as price, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_roi_products as table_alias 2022-07-30 02:59:35 normalization > -- roi_products 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__roi_products_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__roi_products_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as name, 2022-07-30 02:59:35 normalization > cast(price as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as price, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__roi_products_ab1 2022-07-30 02:59:35 normalization > -- roi_products 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__roi_products_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(price as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_roi_products_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__roi_products_ab2 tmp 2022-07-30 02:59:35 normalization > -- roi_products 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:46.281335 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.product_orders_stg" 2022-07-30 02:59:35 normalization > 02:57:46.283421 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:46.286367 [debug] [Thread-3 ]: Began executing node model.airbyte_utils.product_orders_stg 2022-07-30 02:59:35 normalization > 02:57:46.294865 [debug] [Thread-3 ]: Writing runtime SQL for node "model.airbyte_utils.product_orders_stg" 2022-07-30 02:59:35 normalization > 02:57:46.303940 [debug] [Thread-3 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:46.311525 [debug] [Thread-3 ]: On model.airbyte_utils.product_orders_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.product_orders_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`product_orders_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__product_orders_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_product_orders 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['order_id']") as order_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['quantity']") as quantity, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['low_stock']") as low_stock, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['oversized']") as oversized, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['dispatched']") as dispatched, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['product_id']") as product_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['quote_link']") as quote_link, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['returned_to']") as returned_to, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['confirmed_by']") as confirmed_by, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['under_review']") as under_review, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['type_quantity']") as type_quantity, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['custom_product']") as custom_product, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['store_quote_id']") as store_quote_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['pipefy_order_id']") as pipefy_order_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['canceled_by_store']") as canceled_by_store, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['pipefy_product_id']") as pipefy_product_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['store_location_id']") as store_location_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['fits_in_motorcycle']") as fits_in_motorcycle, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['trusted_when_associated']") as trusted_when_associated, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['pipefy_location_store_id']") as pipefy_location_store_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['store_cancelation_reason']") as store_cancelation_reason, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['location_store_product_id']") as location_store_product_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['product_cost_when_associated']") as product_cost_when_associated, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['product_price_when_associated']") as product_price_when_associated, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_product_orders as table_alias 2022-07-30 02:59:35 normalization > -- product_orders 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__product_orders_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__product_orders_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(order_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as order_id, 2022-07-30 02:59:35 normalization > cast(quantity as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as quantity, 2022-07-30 02:59:35 normalization > cast(low_stock as boolean) as low_stock, 2022-07-30 02:59:35 normalization > cast(oversized as boolean) as oversized, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(dispatched as boolean) as dispatched, 2022-07-30 02:59:35 normalization > cast(product_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as product_id, 2022-07-30 02:59:35 normalization > cast(quote_link as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as quote_link, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(returned_to as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as returned_to, 2022-07-30 02:59:35 normalization > cast(confirmed_by as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as confirmed_by, 2022-07-30 02:59:35 normalization > cast(under_review as boolean) as under_review, 2022-07-30 02:59:35 normalization > cast(type_quantity as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as type_quantity, 2022-07-30 02:59:35 normalization > cast(custom_product as boolean) as custom_product, 2022-07-30 02:59:35 normalization > cast(store_quote_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as store_quote_id, 2022-07-30 02:59:35 normalization > cast(pipefy_order_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as pipefy_order_id, 2022-07-30 02:59:35 normalization > cast(canceled_by_store as boolean) as canceled_by_store, 2022-07-30 02:59:35 normalization > cast(pipefy_product_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as pipefy_product_id, 2022-07-30 02:59:35 normalization > cast(store_location_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as store_location_id, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cast(fits_in_motorcycle as boolean) as fits_in_motorcycle, 2022-07-30 02:59:35 normalization > cast(trusted_when_associated as boolean) as trusted_when_associated, 2022-07-30 02:59:35 normalization > cast(pipefy_location_store_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as pipefy_location_store_id, 2022-07-30 02:59:35 normalization > cast(store_cancelation_reason as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as store_cancelation_reason, 2022-07-30 02:59:35 normalization > cast(location_store_product_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as location_store_product_id, 2022-07-30 02:59:35 normalization > cast(product_cost_when_associated as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as product_cost_when_associated, 2022-07-30 02:59:35 normalization > cast(product_price_when_associated as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as product_price_when_associated, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__product_orders_ab1 2022-07-30 02:59:35 normalization > -- product_orders 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__product_orders_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(order_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(quantity as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(low_stock as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(oversized as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(dispatched as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(product_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(quote_link as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(returned_to as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(confirmed_by as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(under_review as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(type_quantity as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(custom_product as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(store_quote_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(pipefy_order_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(canceled_by_store as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(pipefy_product_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(store_location_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(fits_in_motorcycle as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(trusted_when_associated as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(pipefy_location_store_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(store_cancelation_reason as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(location_store_product_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(product_cost_when_associated as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(product_price_when_associated as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_product_orders_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__product_orders_ab2 tmp 2022-07-30 02:59:35 normalization > -- product_orders 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:46.699514 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:46.700933 [info ] [Thread-2 ]: 44 of 201 OK created view model _airbyte_airbyte_cdc.payment_installments_stg........................................... [OK in 0.86s] 2022-07-30 02:59:35 normalization > 02:57:46.701478 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.payment_installments_stg 2022-07-30 02:59:35 normalization > 02:57:46.701912 [debug] [Thread-2 ]: Began running node model.airbyte_utils.product_canonicals_stg 2022-07-30 02:59:35 normalization > 02:57:46.702638 [info ] [Thread-2 ]: 50 of 201 START view model _airbyte_airbyte_cdc.product_canonicals_stg.................................................. [RUN] 2022-07-30 02:59:35 normalization > 02:57:46.703719 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.product_canonicals_stg" 2022-07-30 02:59:35 normalization > 02:57:46.703889 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.product_canonicals_stg 2022-07-30 02:59:35 normalization > 02:57:46.704035 [debug] [Thread-2 ]: Compiling model.airbyte_utils.product_canonicals_stg 2022-07-30 02:59:35 normalization > 02:57:46.741906 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.product_canonicals_stg" 2022-07-30 02:59:35 normalization > 02:57:46.742365 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:46.742529 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.product_canonicals_stg 2022-07-30 02:59:35 normalization > 02:57:46.746977 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.product_canonicals_stg" 2022-07-30 02:59:35 normalization > 02:57:46.747449 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:46.754288 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:46.755471 [info ] [Thread-8 ]: 42 of 201 OK created view model _airbyte_airbyte_cdc.payments_stg....................................................... [OK in 1.00s] 2022-07-30 02:59:35 normalization > 02:57:46.755784 [debug] [Thread-2 ]: On model.airbyte_utils.product_canonicals_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.product_canonicals_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`product_canonicals_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__product_canonicals_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_product_canonicals 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['ean']") as ean, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['code']") as code, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['gtin']") as gtin, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['name']") as name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['brand']") as brand, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['image']") as image, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_by']") as created_by, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['width_per_unit']") as width_per_unit, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['height_per_unit']") as height_per_unit, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['lenght_per_unit']") as lenght_per_unit, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['reference_price']") as reference_price, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['weight_per_unit']") as weight_per_unit, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_product_canonicals as table_alias 2022-07-30 02:59:35 normalization > -- product_canonicals 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__product_canonicals_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__product_canonicals_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(ean as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as ean, 2022-07-30 02:59:35 normalization > cast(code as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as code, 2022-07-30 02:59:35 normalization > cast(gtin as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as gtin, 2022-07-30 02:59:35 normalization > cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as name, 2022-07-30 02:59:35 normalization > cast(brand as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as brand, 2022-07-30 02:59:35 normalization > cast(image as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as image, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(created_by as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as created_by, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(width_per_unit as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as width_per_unit, 2022-07-30 02:59:35 normalization > cast(height_per_unit as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as height_per_unit, 2022-07-30 02:59:35 normalization > cast(lenght_per_unit as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as lenght_per_unit, 2022-07-30 02:59:35 normalization > cast(reference_price as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as reference_price, 2022-07-30 02:59:35 normalization > cast(weight_per_unit as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as weight_per_unit, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__product_canonicals_ab1 2022-07-30 02:59:35 normalization > -- product_canonicals 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__product_canonicals_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(ean as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(code as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(gtin as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(brand as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(image as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_by as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(width_per_unit as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(height_per_unit as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(lenght_per_unit as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(reference_price as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(weight_per_unit as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_product_canonicals_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__product_canonicals_ab2 tmp 2022-07-30 02:59:35 normalization > -- product_canonicals 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:46.759839 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.payments_stg 2022-07-30 02:59:35 normalization > 02:57:46.760170 [debug] [Thread-8 ]: Began running node model.airbyte_utils.products_stg 2022-07-30 02:59:35 normalization > 02:57:46.760860 [info ] [Thread-8 ]: 51 of 201 START view model _airbyte_airbyte_cdc.products_stg............................................................ [RUN] 2022-07-30 02:59:35 normalization > 02:57:46.762073 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.products_stg" 2022-07-30 02:59:35 normalization > 02:57:46.762253 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.products_stg 2022-07-30 02:59:35 normalization > 02:57:46.762388 [debug] [Thread-8 ]: Compiling model.airbyte_utils.products_stg 2022-07-30 02:59:35 normalization > 02:57:46.839852 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.products_stg" 2022-07-30 02:59:35 normalization > 02:57:46.840575 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:46.840840 [debug] [Thread-8 ]: Began executing node model.airbyte_utils.products_stg 2022-07-30 02:59:35 normalization > 02:57:46.845568 [debug] [Thread-8 ]: Writing runtime SQL for node "model.airbyte_utils.products_stg" 2022-07-30 02:59:35 normalization > 02:57:46.846097 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:46.851395 [debug] [Thread-8 ]: On model.airbyte_utils.products_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.products_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`products_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__products_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_products 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['ncm']") as ncm, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['name']") as name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['price']") as price, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['details']") as details, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['omie_id']") as omie_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['trusted']") as trusted, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['on_offer']") as on_offer, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['store_id']") as store_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['available']") as available, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['pipefy_id']") as pipefy_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['changed_by']") as changed_by, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['conta_azul']") as conta_azul, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['description']") as description, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['inserted_by']") as inserted_by, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['type_quantity']") as type_quantity, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['width_per_unit']") as width_per_unit, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['height_per_unit']") as height_per_unit, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['lenght_per_unit']") as lenght_per_unit, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['pipefy_store_id']") as pipefy_store_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['weight_per_unit']") as weight_per_unit, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['minimum_quantity']") as minimum_quantity, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['problem_reported']") as problem_reported, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['external_identify']") as external_identify, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['oico_markup_retail']") as oico_markup_retail, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['available_to_stores']") as available_to_stores, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['product_canonical_id']") as product_canonical_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['oico_markup_wholesale']") as oico_markup_wholesale, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['canonical_associated_at']") as canonical_associated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_products as table_alias 2022-07-30 02:59:35 normalization > -- products 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__products_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__products_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(ncm as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as ncm, 2022-07-30 02:59:35 normalization > cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as name, 2022-07-30 02:59:35 normalization > cast(price as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as price, 2022-07-30 02:59:35 normalization > cast(details as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as details, 2022-07-30 02:59:35 normalization > cast(omie_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as omie_id, 2022-07-30 02:59:35 normalization > cast(trusted as boolean) as trusted, 2022-07-30 02:59:35 normalization > cast(on_offer as boolean) as on_offer, 2022-07-30 02:59:35 normalization > cast(store_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as store_id, 2022-07-30 02:59:35 normalization > cast(available as boolean) as available, 2022-07-30 02:59:35 normalization > cast(pipefy_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as pipefy_id, 2022-07-30 02:59:35 normalization > cast(changed_by as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as changed_by, 2022-07-30 02:59:35 normalization > cast(conta_azul as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as conta_azul, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(description as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as description, 2022-07-30 02:59:35 normalization > cast(inserted_by as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as inserted_by, 2022-07-30 02:59:35 normalization > cast(type_quantity as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as type_quantity, 2022-07-30 02:59:35 normalization > cast(width_per_unit as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as width_per_unit, 2022-07-30 02:59:35 normalization > cast(height_per_unit as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as height_per_unit, 2022-07-30 02:59:35 normalization > cast(lenght_per_unit as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as lenght_per_unit, 2022-07-30 02:59:35 normalization > cast(pipefy_store_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as pipefy_store_id, 2022-07-30 02:59:35 normalization > cast(weight_per_unit as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as weight_per_unit, 2022-07-30 02:59:35 normalization > cast(minimum_quantity as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as minimum_quantity, 2022-07-30 02:59:35 normalization > cast(problem_reported as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as problem_reported, 2022-07-30 02:59:35 normalization > cast(external_identify as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as external_identify, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cast(oico_markup_retail as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as oico_markup_retail, 2022-07-30 02:59:35 normalization > cast(available_to_stores as boolean) as available_to_stores, 2022-07-30 02:59:35 normalization > cast(product_canonical_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as product_canonical_id, 2022-07-30 02:59:35 normalization > cast(oico_markup_wholesale as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as oico_markup_wholesale, 2022-07-30 02:59:35 normalization > cast(nullif(canonical_associated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as canonical_associated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__products_ab1 2022-07-30 02:59:35 normalization > -- products 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__products_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(ncm as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(price as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(details as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(omie_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(trusted as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(on_offer as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(store_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(available as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(pipefy_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(changed_by as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(conta_azul as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(description as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(inserted_by as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(type_quantity as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(width_per_unit as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(height_per_unit as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(lenght_per_unit as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(pipefy_store_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(weight_per_unit as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(minimum_quantity as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(problem_reported as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(external_identify as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(oico_markup_retail as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(available_to_stores as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(product_canonical_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(oico_markup_wholesale as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(canonical_associated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_products_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__products_ab2 tmp 2022-07-30 02:59:35 normalization > -- products 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:46.893984 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:46.894861 [info ] [Thread-4 ]: 43 of 201 OK created view model _airbyte_airbyte_cdc.requested_products_stg............................................. [OK in 1.06s] 2022-07-30 02:59:35 normalization > 02:57:46.895448 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.requested_products_stg 2022-07-30 02:59:35 normalization > 02:57:46.899250 [debug] [Thread-4 ]: Began running node model.airbyte_utils.spatial_ref_sys_stg 2022-07-30 02:59:35 normalization > 02:57:46.899924 [info ] [Thread-4 ]: 52 of 201 START view model _airbyte_airbyte_cdc.spatial_ref_sys_stg..................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:46.900965 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.spatial_ref_sys_stg" 2022-07-30 02:59:35 normalization > 02:57:46.901146 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.spatial_ref_sys_stg 2022-07-30 02:59:35 normalization > 02:57:46.901283 [debug] [Thread-4 ]: Compiling model.airbyte_utils.spatial_ref_sys_stg 2022-07-30 02:59:35 normalization > 02:57:46.923409 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.spatial_ref_sys_stg" 2022-07-30 02:59:35 normalization > 02:57:46.923844 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:46.924001 [debug] [Thread-4 ]: Began executing node model.airbyte_utils.spatial_ref_sys_stg 2022-07-30 02:59:35 normalization > 02:57:46.928542 [debug] [Thread-4 ]: Writing runtime SQL for node "model.airbyte_utils.spatial_ref_sys_stg" 2022-07-30 02:59:35 normalization > 02:57:46.928971 [debug] [Thread-4 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:46.933442 [debug] [Thread-4 ]: On model.airbyte_utils.spatial_ref_sys_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.spatial_ref_sys_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`spatial_ref_sys_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__spatial_ref_sys_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_spatial_ref_sys 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['srid']") as srid, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['srtext']") as srtext, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['auth_name']") as auth_name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['auth_srid']") as auth_srid, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['proj4text']") as proj4text, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_spatial_ref_sys as table_alias 2022-07-30 02:59:35 normalization > -- spatial_ref_sys 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__spatial_ref_sys_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__spatial_ref_sys_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(srid as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as srid, 2022-07-30 02:59:35 normalization > cast(srtext as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as srtext, 2022-07-30 02:59:35 normalization > cast(auth_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as auth_name, 2022-07-30 02:59:35 normalization > cast(auth_srid as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as auth_srid, 2022-07-30 02:59:35 normalization > cast(proj4text as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as proj4text, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__spatial_ref_sys_ab1 2022-07-30 02:59:35 normalization > -- spatial_ref_sys 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__spatial_ref_sys_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(srid as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(srtext as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(auth_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(auth_srid as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(proj4text as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_spatial_ref_sys_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__spatial_ref_sys_ab2 tmp 2022-07-30 02:59:35 normalization > -- spatial_ref_sys 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:46.999292 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:47.000193 [info ] [Thread-7 ]: 45 of 201 OK created view model _airbyte_airbyte_cdc.order_categories_stg............................................... [OK in 1.06s] 2022-07-30 02:59:35 normalization > 02:57:47.000585 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.order_categories_stg 2022-07-30 02:59:35 normalization > 02:57:47.000894 [debug] [Thread-7 ]: Began running node model.airbyte_utils.schema_migrations_stg 2022-07-30 02:59:35 normalization > 02:57:47.001241 [info ] [Thread-7 ]: 53 of 201 START view model _airbyte_airbyte_cdc.schema_migrations_stg................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:47.005604 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.schema_migrations_stg" 2022-07-30 02:59:35 normalization > 02:57:47.005815 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.schema_migrations_stg 2022-07-30 02:59:35 normalization > 02:57:47.005970 [debug] [Thread-7 ]: Compiling model.airbyte_utils.schema_migrations_stg 2022-07-30 02:59:35 normalization > 02:57:47.023114 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.schema_migrations_stg" 2022-07-30 02:59:35 normalization > 02:57:47.023584 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:47.023750 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.schema_migrations_stg 2022-07-30 02:59:35 normalization > 02:57:47.028332 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.schema_migrations_stg" 2022-07-30 02:59:35 normalization > 02:57:47.028749 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:47.033071 [debug] [Thread-7 ]: On model.airbyte_utils.schema_migrations_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.schema_migrations_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`schema_migrations_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__schema_migrations_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_schema_migrations 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['version']") as version, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_schema_migrations as table_alias 2022-07-30 02:59:35 normalization > -- schema_migrations 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__schema_migrations_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__schema_migrations_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(version as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as version, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__schema_migrations_ab1 2022-07-30 02:59:35 normalization > -- schema_migrations 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__schema_migrations_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(version as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_schema_migrations_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__schema_migrations_ab2 tmp 2022-07-30 02:59:35 normalization > -- schema_migrations 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:47.045625 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:47.047541 [info ] [Thread-3 ]: 49 of 201 OK created view model _airbyte_airbyte_cdc.product_orders_stg................................................. [OK in 0.92s] 2022-07-30 02:59:35 normalization > 02:57:47.050369 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:47.053645 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:47.056163 [info ] [Thread-6 ]: 47 of 201 OK created view model _airbyte_airbyte_cdc.roi_products_stg................................................... [OK in 0.97s] 2022-07-30 02:59:35 normalization > 02:57:47.055307 [info ] [Thread-1 ]: 46 of 201 OK created view model _airbyte_airbyte_cdc.product_canonical_categories_stg................................... [OK in 1.05s] 2022-07-30 02:59:35 normalization > 02:57:47.057245 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.product_orders_stg 2022-07-30 02:59:35 normalization > 02:57:47.057461 [debug] [Thread-3 ]: Began running node model.airbyte_utils.product_reports_stg 2022-07-30 02:59:35 normalization > 02:57:47.058636 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.roi_products_stg 2022-07-30 02:59:35 normalization > 02:57:47.059449 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.product_canonical_categories_stg 2022-07-30 02:59:35 normalization > 02:57:47.059760 [info ] [Thread-3 ]: 54 of 201 START view model _airbyte_airbyte_cdc.product_reports_stg..................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:47.060006 [debug] [Thread-6 ]: Began running node model.airbyte_utils.store_categories_stg 2022-07-30 02:59:35 normalization > 02:57:47.061436 [info ] [Thread-6 ]: 55 of 201 START view model _airbyte_airbyte_cdc.store_categories_stg.................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:47.060471 [debug] [Thread-1 ]: Began running node model.airbyte_utils.shortened_urls_stg 2022-07-30 02:59:35 normalization > 02:57:47.061761 [info ] [Thread-1 ]: 56 of 201 START view model _airbyte_airbyte_cdc.shortened_urls_stg...................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:47.062457 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.product_reports_stg" 2022-07-30 02:59:35 normalization > 02:57:47.062594 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.product_reports_stg 2022-07-30 02:59:35 normalization > 02:57:47.062710 [debug] [Thread-3 ]: Compiling model.airbyte_utils.product_reports_stg 2022-07-30 02:59:35 normalization > 02:57:47.074237 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.store_categories_stg" 2022-07-30 02:59:35 normalization > 02:57:47.074486 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.store_categories_stg 2022-07-30 02:59:35 normalization > 02:57:47.074611 [debug] [Thread-6 ]: Compiling model.airbyte_utils.store_categories_stg 2022-07-30 02:59:35 normalization > 02:57:47.081647 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.shortened_urls_stg" 2022-07-30 02:59:35 normalization > 02:57:47.083089 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.shortened_urls_stg 2022-07-30 02:59:35 normalization > 02:57:47.088808 [debug] [Thread-1 ]: Compiling model.airbyte_utils.shortened_urls_stg 2022-07-30 02:59:35 normalization > 02:57:47.119031 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.product_reports_stg" 2022-07-30 02:59:35 normalization > 02:57:47.209371 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:47.209596 [debug] [Thread-3 ]: Began executing node model.airbyte_utils.product_reports_stg 2022-07-30 02:59:35 normalization > 02:57:47.107512 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:47.217761 [info ] [Thread-5 ]: 48 of 201 OK created view model _airbyte_airbyte_cdc.reports_stg........................................................ [OK in 1.12s] 2022-07-30 02:59:35 normalization > 02:57:47.216813 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.store_categories_stg" 2022-07-30 02:59:35 normalization > 02:57:47.214098 [debug] [Thread-3 ]: Writing runtime SQL for node "model.airbyte_utils.product_reports_stg" 2022-07-30 02:59:35 normalization > 02:57:47.220491 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.reports_stg 2022-07-30 02:59:35 normalization > 02:57:47.230386 [debug] [Thread-5 ]: Began running node model.airbyte_utils.store_order_quotes_stg 2022-07-30 02:59:35 normalization > 02:57:47.230761 [info ] [Thread-5 ]: 57 of 201 START view model _airbyte_airbyte_cdc.store_order_quotes_stg.................................................. [RUN] 2022-07-30 02:59:35 normalization > 02:57:47.220701 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:47.231971 [debug] [Thread-6 ]: Began executing node model.airbyte_utils.store_categories_stg 2022-07-30 02:59:35 normalization > 02:57:47.237159 [debug] [Thread-6 ]: Writing runtime SQL for node "model.airbyte_utils.store_categories_stg" 2022-07-30 02:59:35 normalization > 02:57:47.237757 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.store_order_quotes_stg" 2022-07-30 02:59:35 normalization > 02:57:47.239931 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.store_order_quotes_stg 2022-07-30 02:59:35 normalization > 02:57:47.246991 [debug] [Thread-5 ]: Compiling model.airbyte_utils.store_order_quotes_stg 2022-07-30 02:59:35 normalization > 02:57:47.239170 [debug] [Thread-3 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:47.263203 [debug] [Thread-6 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:47.277214 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.store_order_quotes_stg" 2022-07-30 02:59:35 normalization > 02:57:47.285759 [debug] [Thread-6 ]: On model.airbyte_utils.store_categories_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.store_categories_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`store_categories_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__store_categories_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_store_categories 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['store_id']") as store_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['category_id']") as category_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_store_categories as table_alias 2022-07-30 02:59:35 normalization > -- store_categories 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__store_categories_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__store_categories_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(store_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as store_id, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(category_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as category_id, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__store_categories_ab1 2022-07-30 02:59:35 normalization > -- store_categories 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__store_categories_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(store_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(category_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_store_categories_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__store_categories_ab2 tmp 2022-07-30 02:59:35 normalization > -- store_categories 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:47.290378 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:47.292457 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.store_order_quotes_stg 2022-07-30 02:59:35 normalization > 02:57:47.291966 [debug] [Thread-3 ]: On model.airbyte_utils.product_reports_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.product_reports_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`product_reports_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__product_reports_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_product_reports 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['type']") as type, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['product_id']") as product_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['buyer_user_id']") as buyer_user_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['product_order_id']") as product_order_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['price_when_reported']") as price_when_reported, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_product_reports as table_alias 2022-07-30 02:59:35 normalization > -- product_reports 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__product_reports_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__product_reports_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(type as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as type, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(product_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as product_id, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(buyer_user_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as buyer_user_id, 2022-07-30 02:59:35 normalization > cast(product_order_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as product_order_id, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cast(price_when_reported as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as price_when_reported, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__product_reports_ab1 2022-07-30 02:59:35 normalization > -- product_reports 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__product_reports_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(product_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(buyer_user_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(product_order_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(price_when_reported as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_product_reports_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__product_reports_ab2 tmp 2022-07-30 02:59:35 normalization > -- product_reports 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:47.300098 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.store_order_quotes_stg" 2022-07-30 02:59:35 normalization > 02:57:47.393678 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:47.397816 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.shortened_urls_stg" 2022-07-30 02:59:35 normalization > 02:57:47.398566 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:47.398801 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.shortened_urls_stg 2022-07-30 02:59:35 normalization > 02:57:47.407004 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.shortened_urls_stg" 2022-07-30 02:59:35 normalization > 02:57:47.411314 [debug] [Thread-5 ]: On model.airbyte_utils.store_order_quotes_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.store_order_quotes_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`store_order_quotes_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__store_order_quotes_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_store_order_quotes 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['sent_at']") as sent_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['order_id']") as order_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['store_id']") as store_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['product_id']") as product_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['quote_link']") as quote_link, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_store_order_quotes as table_alias 2022-07-30 02:59:35 normalization > -- store_order_quotes 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__store_order_quotes_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__store_order_quotes_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(nullif(sent_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as sent_at, 2022-07-30 02:59:35 normalization > cast(order_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as order_id, 2022-07-30 02:59:35 normalization > cast(store_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as store_id, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(product_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as product_id, 2022-07-30 02:59:35 normalization > cast(quote_link as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as quote_link, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__store_order_quotes_ab1 2022-07-30 02:59:35 normalization > -- store_order_quotes 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__store_order_quotes_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(sent_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(order_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(store_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(product_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(quote_link as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_store_order_quotes_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__store_order_quotes_ab2 tmp 2022-07-30 02:59:35 normalization > -- store_order_quotes 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:47.412570 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:47.424245 [debug] [Thread-1 ]: On model.airbyte_utils.shortened_urls_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.shortened_urls_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`shortened_urls_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__shortened_urls_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_shortened_urls 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['url']") as url, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['category']") as category, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['owner_id']") as owner_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['use_count']") as use_count, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['expires_at']") as expires_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['owner_type']") as owner_type, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['unique_key']") as unique_key, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_shortened_urls as table_alias 2022-07-30 02:59:35 normalization > -- shortened_urls 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__shortened_urls_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__shortened_urls_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(url as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as url, 2022-07-30 02:59:35 normalization > cast(category as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as category, 2022-07-30 02:59:35 normalization > cast(owner_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as owner_id, 2022-07-30 02:59:35 normalization > cast(use_count as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as use_count, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(expires_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as expires_at, 2022-07-30 02:59:35 normalization > cast(owner_type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as owner_type, 2022-07-30 02:59:35 normalization > cast(unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as unique_key, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__shortened_urls_ab1 2022-07-30 02:59:35 normalization > -- shortened_urls 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__shortened_urls_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(url as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(category as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(owner_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(use_count as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(expires_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(owner_type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_shortened_urls_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__shortened_urls_ab2 tmp 2022-07-30 02:59:35 normalization > -- shortened_urls 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:47.649068 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:47.649967 [info ] [Thread-8 ]: 51 of 201 OK created view model _airbyte_airbyte_cdc.products_stg....................................................... [OK in 0.89s] 2022-07-30 02:59:35 normalization > 02:57:47.650380 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.products_stg 2022-07-30 02:59:35 normalization > 02:57:47.650855 [debug] [Thread-8 ]: Began running node model.airbyte_utils.stockout_events_stg 2022-07-30 02:59:35 normalization > 02:57:47.651589 [info ] [Thread-8 ]: 58 of 201 START view model _airbyte_airbyte_cdc.stockout_events_stg..................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:47.652761 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.stockout_events_stg" 2022-07-30 02:59:35 normalization > 02:57:47.652967 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.stockout_events_stg 2022-07-30 02:59:35 normalization > 02:57:47.653102 [debug] [Thread-8 ]: Compiling model.airbyte_utils.stockout_events_stg 2022-07-30 02:59:35 normalization > 02:57:47.667135 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:47.668024 [info ] [Thread-4 ]: 52 of 201 OK created view model _airbyte_airbyte_cdc.spatial_ref_sys_stg................................................ [OK in 0.77s] 2022-07-30 02:59:35 normalization > 02:57:47.682698 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.stockout_events_stg" 2022-07-30 02:59:35 normalization > 02:57:47.683457 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:47.683829 [debug] [Thread-8 ]: Began executing node model.airbyte_utils.stockout_events_stg 2022-07-30 02:59:35 normalization > 02:57:47.689707 [debug] [Thread-8 ]: Writing runtime SQL for node "model.airbyte_utils.stockout_events_stg" 2022-07-30 02:59:35 normalization > 02:57:47.692301 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:47.693544 [info ] [Thread-2 ]: 50 of 201 OK created view model _airbyte_airbyte_cdc.product_canonicals_stg............................................. [OK in 0.99s] 2022-07-30 02:59:35 normalization > 02:57:47.692538 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.spatial_ref_sys_stg 2022-07-30 02:59:35 normalization > 02:57:47.694115 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:47.694665 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.product_canonicals_stg 2022-07-30 02:59:35 normalization > 02:57:47.695108 [debug] [Thread-4 ]: Began running node model.airbyte_utils.sidekiq_sequence_records_stg 2022-07-30 02:59:35 normalization > 02:57:47.695892 [debug] [Thread-2 ]: Began running node model.airbyte_utils.terms_stg 2022-07-30 02:59:35 normalization > 02:57:47.696801 [info ] [Thread-2 ]: 60 of 201 START view model _airbyte_airbyte_cdc.terms_stg............................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:47.696491 [info ] [Thread-4 ]: 59 of 201 START view model _airbyte_airbyte_cdc.sidekiq_sequence_records_stg............................................ [RUN] 2022-07-30 02:59:35 normalization > 02:57:47.698023 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.terms_stg" 2022-07-30 02:59:35 normalization > 02:57:47.698221 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.terms_stg 2022-07-30 02:59:35 normalization > 02:57:47.698347 [debug] [Thread-2 ]: Compiling model.airbyte_utils.terms_stg 2022-07-30 02:59:35 normalization > 02:57:47.710430 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.sidekiq_sequence_records_stg" 2022-07-30 02:59:35 normalization > 02:57:47.716624 [debug] [Thread-8 ]: On model.airbyte_utils.stockout_events_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.stockout_events_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`stockout_events_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__stockout_events_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_stockout_events 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['order_id']") as order_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_by']") as created_by, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['product_id']") as product_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['price_when_deleted']") as price_when_deleted, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_stockout_events as table_alias 2022-07-30 02:59:35 normalization > -- stockout_events 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__stockout_events_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__stockout_events_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(order_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as order_id, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(created_by as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as created_by, 2022-07-30 02:59:35 normalization > cast(product_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as product_id, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cast(price_when_deleted as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as price_when_deleted, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__stockout_events_ab1 2022-07-30 02:59:35 normalization > -- stockout_events 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__stockout_events_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(order_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_by as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(product_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(price_when_deleted as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_stockout_events_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__stockout_events_ab2 tmp 2022-07-30 02:59:35 normalization > -- stockout_events 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:47.718794 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.sidekiq_sequence_records_stg 2022-07-30 02:59:35 normalization > 02:57:47.722115 [debug] [Thread-4 ]: Compiling model.airbyte_utils.sidekiq_sequence_records_stg 2022-07-30 02:59:35 normalization > 02:57:47.760206 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.terms_stg" 2022-07-30 02:59:35 normalization > 02:57:47.775785 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:47.776093 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.terms_stg 2022-07-30 02:59:35 normalization > 02:57:47.769686 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.sidekiq_sequence_records_stg" 2022-07-30 02:59:35 normalization > 02:57:47.782268 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.terms_stg" 2022-07-30 02:59:35 normalization > 02:57:47.783240 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:47.783724 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:47.783985 [debug] [Thread-4 ]: Began executing node model.airbyte_utils.sidekiq_sequence_records_stg 2022-07-30 02:59:35 normalization > 02:57:47.790587 [debug] [Thread-4 ]: Writing runtime SQL for node "model.airbyte_utils.sidekiq_sequence_records_stg" 2022-07-30 02:59:35 normalization > 02:57:47.791798 [debug] [Thread-2 ]: On model.airbyte_utils.terms_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.terms_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`terms_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__terms_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_terms 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['link']") as link, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['type']") as type, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['version']") as version, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['mandatory']") as mandatory, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_terms as table_alias 2022-07-30 02:59:35 normalization > -- terms 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__terms_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__terms_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(link as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as link, 2022-07-30 02:59:35 normalization > cast(type as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as type, 2022-07-30 02:59:35 normalization > cast(version as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as version, 2022-07-30 02:59:35 normalization > cast(mandatory as boolean) as mandatory, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__terms_ab1 2022-07-30 02:59:35 normalization > -- terms 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__terms_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(link as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(version as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(mandatory as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_terms_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__terms_ab2 tmp 2022-07-30 02:59:35 normalization > -- terms 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:47.794612 [debug] [Thread-4 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:47.800066 [debug] [Thread-4 ]: On model.airbyte_utils.sidekiq_sequence_records_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.sidekiq_sequence_records_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`sidekiq_sequence_records_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__sidekiq_sequence_records_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_sidekiq_sequence_records 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['data']") as data, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['current_step']") as current_step, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_sidekiq_sequence_records as table_alias 2022-07-30 02:59:35 normalization > -- sidekiq_sequence_records 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__sidekiq_sequence_records_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__sidekiq_sequence_records_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(data as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as data, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(current_step as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as current_step, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__sidekiq_sequence_records_ab1 2022-07-30 02:59:35 normalization > -- sidekiq_sequence_records 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__sidekiq_sequence_records_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(data as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(current_step as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_sidekiq_sequence_records_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__sidekiq_sequence_records_ab2 tmp 2022-07-30 02:59:35 normalization > -- sidekiq_sequence_records 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:47.808653 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:47.809949 [info ] [Thread-7 ]: 53 of 201 OK created view model _airbyte_airbyte_cdc.schema_migrations_stg.............................................. [OK in 0.80s] 2022-07-30 02:59:35 normalization > 02:57:47.815750 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.schema_migrations_stg 2022-07-30 02:59:35 normalization > 02:57:47.816205 [debug] [Thread-7 ]: Began running node model.airbyte_utils.transfeera_batches_stg 2022-07-30 02:59:35 normalization > 02:57:47.823790 [info ] [Thread-7 ]: 61 of 201 START view model _airbyte_airbyte_cdc.transfeera_batches_stg.................................................. [RUN] 2022-07-30 02:59:35 normalization > 02:57:47.825775 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.transfeera_batches_stg" 2022-07-30 02:59:35 normalization > 02:57:47.826061 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.transfeera_batches_stg 2022-07-30 02:59:35 normalization > 02:57:47.826270 [debug] [Thread-7 ]: Compiling model.airbyte_utils.transfeera_batches_stg 2022-07-30 02:59:35 normalization > 02:57:47.857249 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.transfeera_batches_stg" 2022-07-30 02:59:35 normalization > 02:57:47.859256 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:47.859745 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.transfeera_batches_stg 2022-07-30 02:59:35 normalization > 02:57:47.864449 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.transfeera_batches_stg" 2022-07-30 02:59:35 normalization > 02:57:47.865275 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:47.875640 [debug] [Thread-7 ]: On model.airbyte_utils.transfeera_batches_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.transfeera_batches_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`transfeera_batches_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__transfeera_batches_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_transfeera_batches 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['name']") as name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['transfeera_id']") as transfeera_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_transfeera_batches as table_alias 2022-07-30 02:59:35 normalization > -- transfeera_batches 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__transfeera_batches_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__transfeera_batches_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as name, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(transfeera_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as transfeera_id, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__transfeera_batches_ab1 2022-07-30 02:59:35 normalization > -- transfeera_batches 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__transfeera_batches_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(transfeera_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_transfeera_batches_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__transfeera_batches_ab2 tmp 2022-07-30 02:59:35 normalization > -- transfeera_batches 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:47.997579 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:47.998604 [info ] [Thread-5 ]: 57 of 201 OK created view model _airbyte_airbyte_cdc.store_order_quotes_stg............................................. [OK in 0.76s] 2022-07-30 02:59:35 normalization > 02:57:48.001498 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:48.002829 [info ] [Thread-1 ]: 56 of 201 OK created view model _airbyte_airbyte_cdc.shortened_urls_stg................................................. [OK in 0.92s] 2022-07-30 02:59:35 normalization > 02:57:48.003583 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.store_order_quotes_stg 2022-07-30 02:59:35 normalization > 02:57:48.004084 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.shortened_urls_stg 2022-07-30 02:59:35 normalization > 02:57:48.005010 [debug] [Thread-1 ]: Began running node model.airbyte_utils.store_locations_stg 2022-07-30 02:59:35 normalization > 02:57:48.005534 [info ] [Thread-1 ]: 63 of 201 START view model _airbyte_airbyte_cdc.store_locations_stg..................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:48.004388 [debug] [Thread-5 ]: Began running node model.airbyte_utils.responsible_deliveries_stg 2022-07-30 02:59:35 normalization > 02:57:48.006916 [info ] [Thread-5 ]: 62 of 201 START view model _airbyte_airbyte_cdc.responsible_deliveries_stg.............................................. [RUN] 2022-07-30 02:59:35 normalization > 02:57:48.008050 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.responsible_deliveries_stg" 2022-07-30 02:59:35 normalization > 02:57:48.008222 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.responsible_deliveries_stg 2022-07-30 02:59:35 normalization > 02:57:48.008359 [debug] [Thread-5 ]: Compiling model.airbyte_utils.responsible_deliveries_stg 2022-07-30 02:59:35 normalization > 02:57:48.006570 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.store_locations_stg" 2022-07-30 02:59:35 normalization > 02:57:48.014821 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.store_locations_stg 2022-07-30 02:59:35 normalization > 02:57:48.015017 [debug] [Thread-1 ]: Compiling model.airbyte_utils.store_locations_stg 2022-07-30 02:59:35 normalization > 02:57:48.051907 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.responsible_deliveries_stg" 2022-07-30 02:59:35 normalization > 02:57:48.060310 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:48.066687 [info ] [Thread-6 ]: 55 of 201 OK created view model _airbyte_airbyte_cdc.store_categories_stg............................................... [OK in 0.99s] 2022-07-30 02:59:35 normalization > 02:57:48.067425 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:48.067749 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.store_categories_stg 2022-07-30 02:59:35 normalization > 02:57:48.082445 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.store_locations_stg" 2022-07-30 02:59:35 normalization > 02:57:48.082696 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.responsible_deliveries_stg 2022-07-30 02:59:35 normalization > 02:57:48.082990 [debug] [Thread-6 ]: Began running node model.airbyte_utils.stores_stg 2022-07-30 02:59:35 normalization > 02:57:48.088186 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.responsible_deliveries_stg" 2022-07-30 02:59:35 normalization > 02:57:48.088635 [info ] [Thread-6 ]: 64 of 201 START view model _airbyte_airbyte_cdc.stores_stg.............................................................. [RUN] 2022-07-30 02:59:35 normalization > 02:57:48.089346 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:48.089619 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.store_locations_stg 2022-07-30 02:59:35 normalization > 02:57:48.091203 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.stores_stg" 2022-07-30 02:59:35 normalization > 02:57:48.098582 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.stores_stg 2022-07-30 02:59:35 normalization > 02:57:48.098297 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.store_locations_stg" 2022-07-30 02:59:35 normalization > 02:57:48.098740 [debug] [Thread-6 ]: Compiling model.airbyte_utils.stores_stg 2022-07-30 02:59:35 normalization > 02:57:48.093322 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:48.105073 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:48.188050 [debug] [Thread-5 ]: On model.airbyte_utils.responsible_deliveries_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.responsible_deliveries_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`responsible_deliveries_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__responsible_deliveries_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_responsible_deliveries 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['name']") as name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['email']") as email, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['buyer_id']") as buyer_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['phone_number']") as phone_number, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['buyer_location_id']") as buyer_location_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_responsible_deliveries as table_alias 2022-07-30 02:59:35 normalization > -- responsible_deliveries 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__responsible_deliveries_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__responsible_deliveries_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as name, 2022-07-30 02:59:35 normalization > cast(email as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as email, 2022-07-30 02:59:35 normalization > cast(buyer_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as buyer_id, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(phone_number as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as phone_number, 2022-07-30 02:59:35 normalization > cast(buyer_location_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as buyer_location_id, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__responsible_deliveries_ab1 2022-07-30 02:59:35 normalization > -- responsible_deliveries 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__responsible_deliveries_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(email as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(buyer_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(phone_number as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(buyer_location_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_responsible_deliveries_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__responsible_deliveries_ab2 tmp 2022-07-30 02:59:35 normalization > -- responsible_deliveries 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:48.181615 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.stores_stg" 2022-07-30 02:59:35 normalization > 02:57:48.170397 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:48.191918 [debug] [Thread-1 ]: On model.airbyte_utils.store_locations_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.store_locations_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`store_locations_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__store_locations_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_store_locations 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['lat']") as lat, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['lng']") as lng, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['city']") as city, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['name']") as name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['state']") as state, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['street']") as street, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['zipcode']") as zipcode, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['location']") as location, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['store_id']") as store_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['pipefy_id']") as pipefy_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['address_details']") as address_details, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['google_place_id']") as google_place_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_store_locations as table_alias 2022-07-30 02:59:35 normalization > -- store_locations 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__store_locations_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__store_locations_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(lat as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as lat, 2022-07-30 02:59:35 normalization > cast(lng as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as lng, 2022-07-30 02:59:35 normalization > cast(city as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as city, 2022-07-30 02:59:35 normalization > cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as name, 2022-07-30 02:59:35 normalization > cast(state as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as state, 2022-07-30 02:59:35 normalization > cast(street as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as street, 2022-07-30 02:59:35 normalization > cast(zipcode as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as zipcode, 2022-07-30 02:59:35 normalization > cast(location as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as location, 2022-07-30 02:59:35 normalization > cast(store_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as store_id, 2022-07-30 02:59:35 normalization > cast(pipefy_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as pipefy_id, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(address_details as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as address_details, 2022-07-30 02:59:35 normalization > cast(google_place_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as google_place_id, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__store_locations_ab1 2022-07-30 02:59:35 normalization > -- store_locations 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__store_locations_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(lat as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(lng as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(city as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(state as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(street as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(zipcode as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(location as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(store_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(pipefy_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(address_details as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(google_place_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_store_locations_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__store_locations_ab2 tmp 2022-07-30 02:59:35 normalization > -- store_locations 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:48.193837 [info ] [Thread-3 ]: 54 of 201 OK created view model _airbyte_airbyte_cdc.product_reports_stg................................................ [OK in 1.13s] 2022-07-30 02:59:35 normalization > 02:57:48.195122 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:48.198191 [debug] [Thread-6 ]: Began executing node model.airbyte_utils.stores_stg 2022-07-30 02:59:35 normalization > 02:57:48.195718 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.product_reports_stg 2022-07-30 02:59:35 normalization > 02:57:48.214489 [debug] [Thread-3 ]: Began running node model.airbyte_utils.term_acceptances_stg 2022-07-30 02:59:35 normalization > 02:57:48.215579 [info ] [Thread-3 ]: 65 of 201 START view model _airbyte_airbyte_cdc.term_acceptances_stg.................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:48.205831 [debug] [Thread-6 ]: Writing runtime SQL for node "model.airbyte_utils.stores_stg" 2022-07-30 02:59:35 normalization > 02:57:48.216814 [debug] [Thread-6 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:48.220186 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.term_acceptances_stg" 2022-07-30 02:59:35 normalization > 02:57:48.220441 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.term_acceptances_stg 2022-07-30 02:59:35 normalization > 02:57:48.220671 [debug] [Thread-3 ]: Compiling model.airbyte_utils.term_acceptances_stg 2022-07-30 02:59:35 normalization > 02:57:48.252287 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.term_acceptances_stg" 2022-07-30 02:59:35 normalization > 02:57:48.257310 [debug] [Thread-6 ]: On model.airbyte_utils.stores_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.stores_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`stores_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__stores_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_stores 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['cnae']") as cnae, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['cnpj']") as cnpj, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['block']") as block, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['omie_id']") as omie_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['pix_key']") as pix_key, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['website']") as website, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['activity']") as activity, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['priority']") as priority, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['bank_code']") as bank_code, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['store_type']") as store_type, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['bank_branch']") as bank_branch, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['sales_email']") as sales_email, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['bank_account']") as bank_account, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['manufacturer']") as manufacturer, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['oico_partner']") as oico_partner, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['payment_type']") as payment_type, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['trading_name']") as trading_name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['business_name']") as business_name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['sales_whatsapp']") as sales_whatsapp, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['national_simple']") as national_simple, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['state_registration']") as state_registration, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['minimum_response_time']") as minimum_response_time, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['municipal_registration']") as municipal_registration, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['sales_point_of_contact']") as sales_point_of_contact, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['payment_recommendations']") as payment_recommendations, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['bank_account_check_digit']") as bank_account_check_digit, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['bank_account_holder_name']") as bank_account_holder_name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['bank_account_holder_document']") as bank_account_holder_document, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_stores as table_alias 2022-07-30 02:59:35 normalization > -- stores 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__stores_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__stores_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(cnae as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as cnae, 2022-07-30 02:59:35 normalization > cast(cnpj as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as cnpj, 2022-07-30 02:59:35 normalization > cast(block as boolean) as block, 2022-07-30 02:59:35 normalization > cast(omie_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as omie_id, 2022-07-30 02:59:35 normalization > cast(pix_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as pix_key, 2022-07-30 02:59:35 normalization > cast(website as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as website, 2022-07-30 02:59:35 normalization > cast(activity as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as activity, 2022-07-30 02:59:35 normalization > cast(priority as boolean) as priority, 2022-07-30 02:59:35 normalization > cast(bank_code as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as bank_code, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(store_type as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as store_type, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(bank_branch as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as bank_branch, 2022-07-30 02:59:35 normalization > cast(sales_email as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as sales_email, 2022-07-30 02:59:35 normalization > cast(bank_account as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as bank_account, 2022-07-30 02:59:35 normalization > cast(manufacturer as boolean) as manufacturer, 2022-07-30 02:59:35 normalization > cast(oico_partner as boolean) as oico_partner, 2022-07-30 02:59:35 normalization > cast(payment_type as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as payment_type, 2022-07-30 02:59:35 normalization > cast(trading_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as trading_name, 2022-07-30 02:59:35 normalization > cast(business_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as business_name, 2022-07-30 02:59:35 normalization > cast(sales_whatsapp as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as sales_whatsapp, 2022-07-30 02:59:35 normalization > cast(national_simple as boolean) as national_simple, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cast(state_registration as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as state_registration, 2022-07-30 02:59:35 normalization > cast(minimum_response_time as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as minimum_response_time, 2022-07-30 02:59:35 normalization > cast(municipal_registration as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as municipal_registration, 2022-07-30 02:59:35 normalization > cast(sales_point_of_contact as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as sales_point_of_contact, 2022-07-30 02:59:35 normalization > cast(payment_recommendations as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as payment_recommendations, 2022-07-30 02:59:35 normalization > cast(bank_account_check_digit as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as bank_account_check_digit, 2022-07-30 02:59:35 normalization > cast(bank_account_holder_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as bank_account_holder_name, 2022-07-30 02:59:35 normalization > cast(bank_account_holder_document as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as bank_account_holder_document, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__stores_ab1 2022-07-30 02:59:35 normalization > -- stores 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__stores_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(cnae as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(cnpj as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(block as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(omie_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(pix_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(website as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(activity as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(priority as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(bank_code as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(store_type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(bank_branch as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(sales_email as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(bank_account as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(manufacturer as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(oico_partner as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(payment_type as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(trading_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(business_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(sales_whatsapp as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(national_simple as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(state_registration as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(minimum_response_time as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(municipal_registration as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(sales_point_of_contact as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(payment_recommendations as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(bank_account_check_digit as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(bank_account_holder_name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(bank_account_holder_document as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_stores_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__stores_ab2 tmp 2022-07-30 02:59:35 normalization > -- stores 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:48.258480 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:48.259156 [debug] [Thread-3 ]: Began executing node model.airbyte_utils.term_acceptances_stg 2022-07-30 02:59:35 normalization > 02:57:48.266837 [debug] [Thread-3 ]: Writing runtime SQL for node "model.airbyte_utils.term_acceptances_stg" 2022-07-30 02:59:35 normalization > 02:57:48.267627 [debug] [Thread-3 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:48.277512 [debug] [Thread-3 ]: On model.airbyte_utils.term_acceptances_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.term_acceptances_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`term_acceptances_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__term_acceptances_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_term_acceptances 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['term_id']") as term_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['buyer_id']") as buyer_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['store_id']") as store_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_term_acceptances as table_alias 2022-07-30 02:59:35 normalization > -- term_acceptances 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__term_acceptances_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__term_acceptances_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(term_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as term_id, 2022-07-30 02:59:35 normalization > cast(buyer_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as buyer_id, 2022-07-30 02:59:35 normalization > cast(store_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as store_id, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__term_acceptances_ab1 2022-07-30 02:59:35 normalization > -- term_acceptances 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__term_acceptances_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(term_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(buyer_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(store_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_term_acceptances_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__term_acceptances_ab2 tmp 2022-07-30 02:59:35 normalization > -- term_acceptances 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:48.323911 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:48.325165 [info ] [Thread-4 ]: 59 of 201 OK created view model _airbyte_airbyte_cdc.sidekiq_sequence_records_stg....................................... [OK in 0.61s] 2022-07-30 02:59:35 normalization > 02:57:48.326384 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.sidekiq_sequence_records_stg 2022-07-30 02:59:35 normalization > 02:57:48.326780 [debug] [Thread-4 ]: Began running node model.airbyte_utils.store_users_stg 2022-07-30 02:59:35 normalization > 02:57:48.327651 [info ] [Thread-4 ]: 66 of 201 START view model _airbyte_airbyte_cdc.store_users_stg......................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:48.329247 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.store_users_stg" 2022-07-30 02:59:35 normalization > 02:57:48.329461 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.store_users_stg 2022-07-30 02:59:35 normalization > 02:57:48.329658 [debug] [Thread-4 ]: Compiling model.airbyte_utils.store_users_stg 2022-07-30 02:59:35 normalization > 02:57:48.368496 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.store_users_stg" 2022-07-30 02:59:35 normalization > 02:57:48.369157 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:48.369345 [debug] [Thread-4 ]: Began executing node model.airbyte_utils.store_users_stg 2022-07-30 02:59:35 normalization > 02:57:48.374004 [debug] [Thread-4 ]: Writing runtime SQL for node "model.airbyte_utils.store_users_stg" 2022-07-30 02:59:35 normalization > 02:57:48.374463 [debug] [Thread-4 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:48.378844 [debug] [Thread-4 ]: On model.airbyte_utils.store_users_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.store_users_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`store_users_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__store_users_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_store_users 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['name']") as name, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['email']") as email, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['active']") as active, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['store_id']") as store_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['phone_number']") as phone_number, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['encrypted_password']") as encrypted_password, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['remember_created_at']") as remember_created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['reset_password_token']") as reset_password_token, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['reset_password_sent_at']") as reset_password_sent_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_store_users as table_alias 2022-07-30 02:59:35 normalization > -- store_users 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__store_users_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__store_users_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as name, 2022-07-30 02:59:35 normalization > cast(email as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as email, 2022-07-30 02:59:35 normalization > cast(active as boolean) as active, 2022-07-30 02:59:35 normalization > cast(store_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as store_id, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(phone_number as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as phone_number, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cast(encrypted_password as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as encrypted_password, 2022-07-30 02:59:35 normalization > cast(nullif(remember_created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as remember_created_at, 2022-07-30 02:59:35 normalization > cast(reset_password_token as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as reset_password_token, 2022-07-30 02:59:35 normalization > cast(nullif(reset_password_sent_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as reset_password_sent_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__store_users_ab1 2022-07-30 02:59:35 normalization > -- store_users 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__store_users_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(name as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(email as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(active as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(store_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(phone_number as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(encrypted_password as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(remember_created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(reset_password_token as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(reset_password_sent_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_store_users_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__store_users_ab2 tmp 2022-07-30 02:59:35 normalization > -- store_users 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:48.554602 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:48.555537 [info ] [Thread-8 ]: 58 of 201 OK created view model _airbyte_airbyte_cdc.stockout_events_stg................................................ [OK in 0.90s] 2022-07-30 02:59:35 normalization > 02:57:48.556011 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.stockout_events_stg 2022-07-30 02:59:35 normalization > 02:57:48.556348 [debug] [Thread-8 ]: Began running node model.airbyte_utils.store_orders_stg 2022-07-30 02:59:35 normalization > 02:57:48.557061 [info ] [Thread-8 ]: 67 of 201 START view model _airbyte_airbyte_cdc.store_orders_stg........................................................ [RUN] 2022-07-30 02:59:35 normalization > 02:57:48.558048 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.store_orders_stg" 2022-07-30 02:59:35 normalization > 02:57:48.558223 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.store_orders_stg 2022-07-30 02:59:35 normalization > 02:57:48.558363 [debug] [Thread-8 ]: Compiling model.airbyte_utils.store_orders_stg 2022-07-30 02:59:35 normalization > 02:57:48.582243 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.store_orders_stg" 2022-07-30 02:59:35 normalization > 02:57:48.582684 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:48.582838 [debug] [Thread-8 ]: Began executing node model.airbyte_utils.store_orders_stg 2022-07-30 02:59:35 normalization > 02:57:48.587807 [debug] [Thread-8 ]: Writing runtime SQL for node "model.airbyte_utils.store_orders_stg" 2022-07-30 02:59:35 normalization > 02:57:48.590690 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:48.595221 [debug] [Thread-8 ]: On model.airbyte_utils.store_orders_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.store_orders_stg"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace view `dwcasa`._airbyte_airbyte_cdc.`store_orders_stg` 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as 2022-07-30 02:59:35 normalization > with __dbt__cte__store_orders_ab1 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-07-30 02:59:35 normalization > -- depends_on: `dwcasa`.airbyte_cdc._airbyte_raw_store_orders 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['order_id']") as order_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['store_id']") as store_id, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['created_at']") as created_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['updated_at']") as updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > json_extract_scalar(_airbyte_data, "$['campaign_last_sent_at']") as campaign_last_sent_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from `dwcasa`.airbyte_cdc._airbyte_raw_store_orders as table_alias 2022-07-30 02:59:35 normalization > -- store_orders 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > ), __dbt__cte__store_orders_ab2 as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__store_orders_ab1 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > cast(id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as id, 2022-07-30 02:59:35 normalization > cast(order_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as order_id, 2022-07-30 02:59:35 normalization > cast(store_id as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as store_id, 2022-07-30 02:59:35 normalization > cast(nullif(created_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as created_at, 2022-07-30 02:59:35 normalization > cast(nullif(updated_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as updated_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > float64 2022-07-30 02:59:35 normalization > ) as _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) as _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cast(nullif(campaign_last_sent_at, '') as 2022-07-30 02:59:35 normalization > timestamp 2022-07-30 02:59:35 normalization > ) as campaign_last_sent_at, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-07-30 02:59:35 normalization > from __dbt__cte__store_orders_ab1 2022-07-30 02:59:35 normalization > -- store_orders 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > )-- SQL model to build a hash column based on the values of this record 2022-07-30 02:59:35 normalization > -- depends_on: __dbt__cte__store_orders_ab2 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(order_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(store_id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(created_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(campaign_last_sent_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_store_orders_hashid, 2022-07-30 02:59:35 normalization > tmp.* 2022-07-30 02:59:35 normalization > from __dbt__cte__store_orders_ab2 tmp 2022-07-30 02:59:35 normalization > -- store_orders 2022-07-30 02:59:35 normalization > where 1 = 1 2022-07-30 02:59:35 normalization > ; 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:48.654314 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:48.655195 [info ] [Thread-7 ]: 61 of 201 OK created view model _airbyte_airbyte_cdc.transfeera_batches_stg............................................. [OK in 0.83s] 2022-07-30 02:59:35 normalization > 02:57:48.655701 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.transfeera_batches_stg 2022-07-30 02:59:35 normalization > 02:57:48.656032 [debug] [Thread-7 ]: Began running node model.airbyte_utils.buyer_uploads_scd 2022-07-30 02:59:35 normalization > 02:57:48.656742 [info ] [Thread-7 ]: 68 of 201 START incremental model airbyte_cdc.buyer_uploads_scd......................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:48.657892 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_uploads_scd" 2022-07-30 02:59:35 normalization > 02:57:48.658064 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.buyer_uploads_scd 2022-07-30 02:59:35 normalization > 02:57:48.658198 [debug] [Thread-7 ]: Compiling model.airbyte_utils.buyer_uploads_scd 2022-07-30 02:59:35 normalization > 02:57:48.675117 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.buyer_uploads_scd" 2022-07-30 02:59:35 normalization > 02:57:48.678657 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:48.679613 [info ] [Thread-2 ]: 60 of 201 OK created view model _airbyte_airbyte_cdc.terms_stg.......................................................... [OK in 0.98s] 2022-07-30 02:59:35 normalization > 02:57:48.680214 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:48.680552 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.buyer_uploads_scd 2022-07-30 02:59:35 normalization > 02:57:48.686417 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.terms_stg 2022-07-30 02:59:35 normalization > 02:57:48.702545 [debug] [Thread-2 ]: Began running node model.airbyte_utils.active_storage_variant_records_scd 2022-07-30 02:59:35 normalization > 02:57:48.714586 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:48.717053 [info ] [Thread-2 ]: 69 of 201 START incremental model airbyte_cdc.active_storage_variant_records_scd........................................ [RUN] 2022-07-30 02:59:35 normalization > 02:57:48.719078 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.active_storage_variant_records_scd" 2022-07-30 02:59:35 normalization > 02:57:48.719334 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.active_storage_variant_records_scd 2022-07-30 02:59:35 normalization > 02:57:48.719547 [debug] [Thread-2 ]: Compiling model.airbyte_utils.active_storage_variant_records_scd 2022-07-30 02:59:35 normalization > 02:57:48.742154 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.active_storage_variant_records_scd" 2022-07-30 02:59:35 normalization > 02:57:48.743229 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:48.743443 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.active_storage_variant_records_scd 2022-07-30 02:59:35 normalization > 02:57:48.746818 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:48.800914 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:48.802187 [info ] [Thread-5 ]: 62 of 201 OK created view model _airbyte_airbyte_cdc.responsible_deliveries_stg......................................... [OK in 0.79s] 2022-07-30 02:59:35 normalization > 02:57:48.802805 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.responsible_deliveries_stg 2022-07-30 02:59:35 normalization > 02:57:48.803191 [debug] [Thread-5 ]: Began running node model.airbyte_utils.buyer_locations_scd 2022-07-30 02:59:35 normalization > 02:57:48.804688 [info ] [Thread-5 ]: 70 of 201 START incremental model airbyte_cdc.buyer_locations_scd....................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:48.805718 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_locations_scd" 2022-07-30 02:59:35 normalization > 02:57:48.805896 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.buyer_locations_scd 2022-07-30 02:59:35 normalization > 02:57:48.806031 [debug] [Thread-5 ]: Compiling model.airbyte_utils.buyer_locations_scd 2022-07-30 02:59:35 normalization > 02:57:48.823470 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.buyer_locations_scd" 2022-07-30 02:59:35 normalization > 02:57:48.823894 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:48.824048 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.buyer_locations_scd 2022-07-30 02:59:35 normalization > 02:57:48.829059 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:48.903134 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:48.904063 [info ] [Thread-1 ]: 63 of 201 OK created view model _airbyte_airbyte_cdc.store_locations_stg................................................ [OK in 0.90s] 2022-07-30 02:59:35 normalization > 02:57:48.905278 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.store_locations_stg 2022-07-30 02:59:35 normalization > 02:57:48.905520 [debug] [Thread-1 ]: Began running node model.airbyte_utils.active_storage_attachments_scd 2022-07-30 02:59:35 normalization > 02:57:48.906046 [info ] [Thread-1 ]: 71 of 201 START incremental model airbyte_cdc.active_storage_attachments_scd............................................ [RUN] 2022-07-30 02:59:35 normalization > 02:57:48.907215 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.active_storage_attachments_scd" 2022-07-30 02:59:35 normalization > 02:57:48.907422 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.active_storage_attachments_scd 2022-07-30 02:59:35 normalization > 02:57:48.907555 [debug] [Thread-1 ]: Compiling model.airbyte_utils.active_storage_attachments_scd 2022-07-30 02:59:35 normalization > 02:57:48.926288 [debug] [Thread-2 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/active_storage_variant_records_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.active_storage_variant_records_scd 2022-07-30 02:59:35 normalization > 02:57:48.926648 [debug] [Thread-7 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/buyer_uploads_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.buyer_uploads_scd 2022-07-30 02:59:35 normalization > 02:57:48.926873 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.active_storage_attachments_scd" 2022-07-30 02:59:35 normalization > 02:57:48.939742 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:48.939300 [info ] [Thread-7 ]: 02:57:48 + `dwcasa`.airbyte_cdc.`buyer_uploads_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:57:48.938195 [info ] [Thread-2 ]: 02:57:48 + `dwcasa`.airbyte_cdc.`active_storage_variant_records_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:57:48.939936 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.active_storage_attachments_scd 2022-07-30 02:59:35 normalization > 02:57:48.980253 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.buyer_uploads_scd" 2022-07-30 02:59:35 normalization > 02:57:48.981840 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.active_storage_variant_records_scd" 2022-07-30 02:59:35 normalization > 02:57:48.985253 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:48.988921 [debug] [Thread-7 ]: On model.airbyte_utils.buyer_uploads_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_uploads_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`buyer_uploads_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('buyer_uploads_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`buyer_uploads_stg` 2022-07-30 02:59:35 normalization > -- buyer_uploads from `dwcasa`.airbyte_cdc._airbyte_raw_buyer_uploads 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > done, 2022-07-30 02:59:35 normalization > buyer_id, 2022-07-30 02:59:35 normalization > file_url, 2022-07-30 02:59:35 normalization > filename, 2022-07-30 02:59:35 normalization > file_type, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > buyer_user_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_buyer_uploads_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > done, 2022-07-30 02:59:35 normalization > buyer_id, 2022-07-30 02:59:35 normalization > file_url, 2022-07-30 02:59:35 normalization > filename, 2022-07-30 02:59:35 normalization > file_type, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > buyer_user_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_buyer_uploads_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:48.993212 [debug] [Thread-2 ]: On model.airbyte_utils.active_storage_variant_records_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.active_storage_variant_records_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`active_storage_variant_records_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('active_storage_variant_records_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`active_storage_variant_records_stg` 2022-07-30 02:59:35 normalization > -- active_storage_variant_records from `dwcasa`.airbyte_cdc._airbyte_raw_active_storage_variant_records 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > blob_id, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > variation_digest, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_active_storage_variant_records_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > blob_id, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > variation_digest, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_active_storage_variant_records_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:48.995602 [debug] [Thread-5 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/buyer_locations_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.buyer_locations_scd 2022-07-30 02:59:35 normalization > 02:57:48.997563 [info ] [Thread-5 ]: 02:57:48 + `dwcasa`.airbyte_cdc.`buyer_locations_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:57:49.001746 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.buyer_locations_scd" 2022-07-30 02:59:35 normalization > 02:57:49.004039 [debug] [Thread-5 ]: On model.airbyte_utils.buyer_locations_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_locations_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`buyer_locations_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('buyer_locations_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`buyer_locations_stg` 2022-07-30 02:59:35 normalization > -- buyer_locations from `dwcasa`.airbyte_cdc._airbyte_raw_buyer_locations 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > lat, 2022-07-30 02:59:35 normalization > lng, 2022-07-30 02:59:35 normalization > city, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > state, 2022-07-30 02:59:35 normalization > street, 2022-07-30 02:59:35 normalization > zipcode, 2022-07-30 02:59:35 normalization > buyer_id, 2022-07-30 02:59:35 normalization > location, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > address_details, 2022-07-30 02:59:35 normalization > google_place_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_buyer_locations_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > lat, 2022-07-30 02:59:35 normalization > lng, 2022-07-30 02:59:35 normalization > city, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > state, 2022-07-30 02:59:35 normalization > street, 2022-07-30 02:59:35 normalization > zipcode, 2022-07-30 02:59:35 normalization > buyer_id, 2022-07-30 02:59:35 normalization > location, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > address_details, 2022-07-30 02:59:35 normalization > google_place_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_buyer_locations_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:49.060719 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:49.061621 [info ] [Thread-6 ]: 64 of 201 OK created view model _airbyte_airbyte_cdc.stores_stg......................................................... [OK in 0.97s] 2022-07-30 02:59:35 normalization > 02:57:49.062859 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.stores_stg 2022-07-30 02:59:35 normalization > 02:57:49.063103 [debug] [Thread-6 ]: Began running node model.airbyte_utils.buyer_public_informations_scd 2022-07-30 02:59:35 normalization > 02:57:49.063388 [info ] [Thread-6 ]: 72 of 201 START incremental model airbyte_cdc.buyer_public_informations_scd............................................. [RUN] 2022-07-30 02:59:35 normalization > 02:57:49.065468 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_public_informations_scd" 2022-07-30 02:59:35 normalization > 02:57:49.065697 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.buyer_public_informations_scd 2022-07-30 02:59:35 normalization > 02:57:49.065819 [debug] [Thread-6 ]: Compiling model.airbyte_utils.buyer_public_informations_scd 2022-07-30 02:59:35 normalization > 02:57:49.075639 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:49.094187 [info ] [Thread-3 ]: 65 of 201 OK created view model _airbyte_airbyte_cdc.term_acceptances_stg............................................... [OK in 0.87s] 2022-07-30 02:59:35 normalization > 02:57:49.095737 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.buyer_public_informations_scd" 2022-07-30 02:59:35 normalization > 02:57:49.099592 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:49.101917 [debug] [Thread-6 ]: Began executing node model.airbyte_utils.buyer_public_informations_scd 2022-07-30 02:59:35 normalization > 02:57:49.106750 [debug] [Thread-6 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:49.107114 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.term_acceptances_stg 2022-07-30 02:59:35 normalization > 02:57:49.107695 [debug] [Thread-3 ]: Began running node model.airbyte_utils.buyer_contact_rules_scd 2022-07-30 02:59:35 normalization > 02:57:49.108570 [info ] [Thread-3 ]: 73 of 201 START incremental model airbyte_cdc.buyer_contact_rules_scd................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:49.110637 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_contact_rules_scd" 2022-07-30 02:59:35 normalization > 02:57:49.110847 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.buyer_contact_rules_scd 2022-07-30 02:59:35 normalization > 02:57:49.111013 [debug] [Thread-3 ]: Compiling model.airbyte_utils.buyer_contact_rules_scd 2022-07-30 02:59:35 normalization > 02:57:49.135967 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.buyer_contact_rules_scd" 2022-07-30 02:59:35 normalization > 02:57:49.138365 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:49.138687 [debug] [Thread-3 ]: Began executing node model.airbyte_utils.buyer_contact_rules_scd 2022-07-30 02:59:35 normalization > 02:57:49.144091 [debug] [Thread-3 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:49.177459 [debug] [Thread-1 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/active_storage_attachments_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.active_storage_attachments_scd 2022-07-30 02:59:35 normalization > 02:57:49.181835 [info ] [Thread-1 ]: 02:57:49 + `dwcasa`.airbyte_cdc.`active_storage_attachments_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:57:49.190485 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.active_storage_attachments_scd" 2022-07-30 02:59:35 normalization > 02:57:49.197322 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:49.207781 [info ] [Thread-4 ]: 66 of 201 OK created view model _airbyte_airbyte_cdc.store_users_stg.................................................... [OK in 0.88s] 2022-07-30 02:59:35 normalization > 02:57:49.208961 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.store_users_stg 2022-07-30 02:59:35 normalization > 02:57:49.220244 [debug] [Thread-4 ]: Began running node model.airbyte_utils.buyer_contacts_scd 2022-07-30 02:59:35 normalization > 02:57:49.223518 [info ] [Thread-4 ]: 74 of 201 START incremental model airbyte_cdc.buyer_contacts_scd........................................................ [RUN] 2022-07-30 02:59:35 normalization > 02:57:49.223062 [debug] [Thread-1 ]: On model.airbyte_utils.active_storage_attachments_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.active_storage_attachments_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`active_storage_attachments_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('active_storage_attachments_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`active_storage_attachments_stg` 2022-07-30 02:59:35 normalization > -- active_storage_attachments from `dwcasa`.airbyte_cdc._airbyte_raw_active_storage_attachments 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > blob_id, 2022-07-30 02:59:35 normalization > record_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > record_type, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_active_storage_attachments_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > blob_id, 2022-07-30 02:59:35 normalization > record_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > record_type, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_active_storage_attachments_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:49.224960 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_contacts_scd" 2022-07-30 02:59:35 normalization > 02:57:49.234974 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.buyer_contacts_scd 2022-07-30 02:59:35 normalization > 02:57:49.237507 [debug] [Thread-4 ]: Compiling model.airbyte_utils.buyer_contacts_scd 2022-07-30 02:59:35 normalization > 02:57:49.264113 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.buyer_contacts_scd" 2022-07-30 02:59:35 normalization > 02:57:49.266661 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:49.267648 [debug] [Thread-4 ]: Began executing node model.airbyte_utils.buyer_contacts_scd 2022-07-30 02:59:35 normalization > 02:57:49.271686 [debug] [Thread-4 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:49.355977 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:49.357299 [info ] [Thread-8 ]: 67 of 201 OK created view model _airbyte_airbyte_cdc.store_orders_stg................................................... [OK in 0.80s] 2022-07-30 02:59:35 normalization > 02:57:49.358276 [debug] [Thread-6 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/buyer_public_informations_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.buyer_public_informations_scd 2022-07-30 02:59:35 normalization > 02:57:49.359898 [info ] [Thread-6 ]: 02:57:49 + `dwcasa`.airbyte_cdc.`buyer_public_informations_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:57:49.360368 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.store_orders_stg 2022-07-30 02:59:35 normalization > 02:57:49.365887 [debug] [Thread-6 ]: Writing runtime SQL for node "model.airbyte_utils.buyer_public_informations_scd" 2022-07-30 02:59:35 normalization > 02:57:49.366288 [debug] [Thread-8 ]: Began running node model.airbyte_utils.categories_scd 2022-07-30 02:59:35 normalization > 02:57:49.367132 [info ] [Thread-8 ]: 75 of 201 START incremental model airbyte_cdc.categories_scd............................................................ [RUN] 2022-07-30 02:59:35 normalization > 02:57:49.367669 [debug] [Thread-6 ]: On model.airbyte_utils.buyer_public_informations_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_public_informations_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`buyer_public_informations_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('buyer_public_informations_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`buyer_public_informations_stg` 2022-07-30 02:59:35 normalization > -- buyer_public_informations from `dwcasa`.airbyte_cdc._airbyte_raw_buyer_public_informations 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > type, 2022-07-30 02:59:35 normalization > score, 2022-07-30 02:59:35 normalization > buyer_id, 2022-07-30 02:59:35 normalization > response, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > recommended_term_limit, 2022-07-30 02:59:35 normalization > recommended_spend_limit, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_buyer_public_informations_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > type, 2022-07-30 02:59:35 normalization > score, 2022-07-30 02:59:35 normalization > buyer_id, 2022-07-30 02:59:35 normalization > response, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > recommended_term_limit, 2022-07-30 02:59:35 normalization > recommended_spend_limit, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_buyer_public_informations_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:49.370504 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.categories_scd" 2022-07-30 02:59:35 normalization > 02:57:49.370758 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.categories_scd 2022-07-30 02:59:35 normalization > 02:57:49.370962 [debug] [Thread-8 ]: Compiling model.airbyte_utils.categories_scd 2022-07-30 02:59:35 normalization > 02:57:49.397314 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.categories_scd" 2022-07-30 02:59:35 normalization > 02:57:49.408249 [debug] [Thread-3 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/buyer_contact_rules_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.buyer_contact_rules_scd 2022-07-30 02:59:35 normalization > 02:57:49.409710 [info ] [Thread-3 ]: 02:57:49 + `dwcasa`.airbyte_cdc.`buyer_contact_rules_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:57:49.410812 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:49.419254 [debug] [Thread-3 ]: Writing runtime SQL for node "model.airbyte_utils.buyer_contact_rules_scd" 2022-07-30 02:59:35 normalization > 02:57:49.419603 [debug] [Thread-8 ]: Began executing node model.airbyte_utils.categories_scd 2022-07-30 02:59:35 normalization > 02:57:49.427364 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:49.428121 [debug] [Thread-3 ]: On model.airbyte_utils.buyer_contact_rules_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_contact_rules_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`buyer_contact_rules_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('buyer_contact_rules_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`buyer_contact_rules_stg` 2022-07-30 02:59:35 normalization > -- buyer_contact_rules from `dwcasa`.airbyte_cdc._airbyte_raw_buyer_contact_rules 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > order_id, 2022-07-30 02:59:35 normalization > categories, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > buyer_contact_id, 2022-07-30 02:59:35 normalization > buyer_location_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_buyer_contact_rules_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > order_id, 2022-07-30 02:59:35 normalization > categories, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > buyer_contact_id, 2022-07-30 02:59:35 normalization > buyer_location_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_buyer_contact_rules_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:49.448306 [debug] [Thread-4 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/buyer_contacts_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.buyer_contacts_scd 2022-07-30 02:59:35 normalization > 02:57:49.449778 [info ] [Thread-4 ]: 02:57:49 + `dwcasa`.airbyte_cdc.`buyer_contacts_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:57:49.454345 [debug] [Thread-4 ]: Writing runtime SQL for node "model.airbyte_utils.buyer_contacts_scd" 2022-07-30 02:59:35 normalization > 02:57:49.454795 [debug] [Thread-4 ]: On model.airbyte_utils.buyer_contacts_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_contacts_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`buyer_contacts_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('buyer_contacts_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`buyer_contacts_stg` 2022-07-30 02:59:35 normalization > -- buyer_contacts from `dwcasa`.airbyte_cdc._airbyte_raw_buyer_contacts 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > email, 2022-07-30 02:59:35 normalization > buyer_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > phone_number, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_buyer_contacts_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > email, 2022-07-30 02:59:35 normalization > buyer_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > phone_number, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_buyer_contacts_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:49.591213 [debug] [Thread-8 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/categories_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.categories_scd 2022-07-30 02:59:35 normalization > 02:57:49.593029 [info ] [Thread-8 ]: 02:57:49 + `dwcasa`.airbyte_cdc.`categories_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:57:49.597223 [debug] [Thread-8 ]: Writing runtime SQL for node "model.airbyte_utils.categories_scd" 2022-07-30 02:59:35 normalization > 02:57:49.597648 [debug] [Thread-8 ]: On model.airbyte_utils.categories_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.categories_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`categories_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('categories_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`categories_stg` 2022-07-30 02:59:35 normalization > -- categories from `dwcasa`.airbyte_cdc._airbyte_raw_categories 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > level, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > category_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > visible_on_store_sign_up, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_categories_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > level, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > category_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > visible_on_store_sign_up, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_categories_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:51.723039 [debug] [Thread-2 ]: On model.airbyte_utils.active_storage_variant_records_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.active_storage_variant_records_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`active_storage_variant_records_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:51.758045 [debug] [Thread-7 ]: On model.airbyte_utils.buyer_uploads_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_uploads_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`buyer_uploads_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:51.942236 [debug] [Thread-4 ]: On model.airbyte_utils.buyer_contacts_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_contacts_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`buyer_contacts_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:52.161578 [debug] [Thread-5 ]: On model.airbyte_utils.buyer_locations_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_locations_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`buyer_locations_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:52.218437 [debug] [Thread-3 ]: On model.airbyte_utils.buyer_contact_rules_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_contact_rules_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`buyer_contact_rules_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:52.450922 [debug] [Thread-8 ]: On model.airbyte_utils.categories_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.categories_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`categories_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:52.741757 [debug] [Thread-6 ]: On model.airbyte_utils.buyer_public_informations_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_public_informations_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`buyer_public_informations_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:53.782252 [debug] [Thread-2 ]: On model.airbyte_utils.active_storage_variant_records_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.active_storage_variant_records_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.active_storage_variant_records_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:54.212132 [debug] [Thread-1 ]: On model.airbyte_utils.active_storage_attachments_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.active_storage_attachments_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`active_storage_attachments_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:54.332452 [debug] [Thread-4 ]: On model.airbyte_utils.buyer_contacts_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_contacts_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.buyer_contacts_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:54.403216 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:54.405968 [info ] [Thread-2 ]: 69 of 201 OK created incremental model airbyte_cdc.active_storage_variant_records_scd................................... [CREATE TABLE (0.0 rows, 0 processed) in 5.69s] 2022-07-30 02:59:35 normalization > 02:57:54.407245 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.active_storage_variant_records_scd 2022-07-30 02:59:35 normalization > 02:57:54.407613 [debug] [Thread-2 ]: Began running node model.airbyte_utils.ar_internal_metadata_scd 2022-07-30 02:59:35 normalization > 02:57:54.409197 [info ] [Thread-2 ]: 76 of 201 START incremental model airbyte_cdc.ar_internal_metadata_scd.................................................. [RUN] 2022-07-30 02:59:35 normalization > 02:57:54.412177 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.ar_internal_metadata_scd" 2022-07-30 02:59:35 normalization > 02:57:54.412544 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.ar_internal_metadata_scd 2022-07-30 02:59:35 normalization > 02:57:54.412693 [debug] [Thread-2 ]: Compiling model.airbyte_utils.ar_internal_metadata_scd 2022-07-30 02:59:35 normalization > 02:57:54.465495 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.ar_internal_metadata_scd" 2022-07-30 02:59:35 normalization > 02:57:54.467106 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:54.467314 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.ar_internal_metadata_scd 2022-07-30 02:59:35 normalization > 02:57:54.474464 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:54.528409 [debug] [Thread-5 ]: On model.airbyte_utils.buyer_locations_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_locations_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.buyer_locations_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:54.577311 [debug] [Thread-3 ]: On model.airbyte_utils.buyer_contact_rules_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_contact_rules_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.buyer_contact_rules_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:54.659165 [debug] [Thread-2 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/ar_internal_metadata_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.ar_internal_metadata_scd 2022-07-30 02:59:35 normalization > 02:57:54.660927 [info ] [Thread-2 ]: 02:57:54 + `dwcasa`.airbyte_cdc.`ar_internal_metadata_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:57:54.666341 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.ar_internal_metadata_scd" 2022-07-30 02:59:35 normalization > 02:57:54.666848 [debug] [Thread-2 ]: On model.airbyte_utils.ar_internal_metadata_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.ar_internal_metadata_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`ar_internal_metadata_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('ar_internal_metadata_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`ar_internal_metadata_stg` 2022-07-30 02:59:35 normalization > -- ar_internal_metadata from `dwcasa`.airbyte_cdc._airbyte_raw_ar_internal_metadata 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > key, 2022-07-30 02:59:35 normalization > value, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by key 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by key 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_ar_internal_metadata_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > key, 2022-07-30 02:59:35 normalization > value, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_ar_internal_metadata_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:54.850760 [debug] [Thread-8 ]: On model.airbyte_utils.categories_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.categories_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.categories_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:54.864760 [debug] [Thread-7 ]: On model.airbyte_utils.buyer_uploads_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_uploads_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.buyer_uploads_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:55.021108 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:55.022168 [info ] [Thread-4 ]: 74 of 201 OK created incremental model airbyte_cdc.buyer_contacts_scd................................................... [CREATE TABLE (5.0 rows, 1.7 KB processed) in 5.80s] 2022-07-30 02:59:35 normalization > 02:57:55.022700 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.buyer_contacts_scd 2022-07-30 02:59:35 normalization > 02:57:55.022968 [debug] [Thread-4 ]: Began running node model.airbyte_utils.faq_scd 2022-07-30 02:59:35 normalization > 02:57:55.023806 [info ] [Thread-4 ]: 77 of 201 START incremental model airbyte_cdc.faq_scd................................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:55.025285 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.faq_scd" 2022-07-30 02:59:35 normalization > 02:57:55.025462 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.faq_scd 2022-07-30 02:59:35 normalization > 02:57:55.025644 [debug] [Thread-4 ]: Compiling model.airbyte_utils.faq_scd 2022-07-30 02:59:35 normalization > 02:57:55.178979 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:55.184647 [info ] [Thread-5 ]: 70 of 201 OK created incremental model airbyte_cdc.buyer_locations_scd.................................................. [CREATE TABLE (4.2k rows, 2.3 MB processed) in 6.38s] 2022-07-30 02:59:35 normalization > 02:57:55.186444 [debug] [Thread-6 ]: On model.airbyte_utils.buyer_public_informations_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_public_informations_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.buyer_public_informations_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:55.191751 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.buyer_locations_scd 2022-07-30 02:59:35 normalization > 02:57:55.195236 [debug] [Thread-5 ]: Began running node model.airbyte_utils.active_storage_blobs_scd 2022-07-30 02:59:35 normalization > 02:57:55.197871 [info ] [Thread-5 ]: 78 of 201 START incremental model airbyte_cdc.active_storage_blobs_scd.................................................. [RUN] 2022-07-30 02:59:35 normalization > 02:57:55.199829 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.active_storage_blobs_scd" 2022-07-30 02:59:35 normalization > 02:57:55.200445 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.active_storage_blobs_scd 2022-07-30 02:59:35 normalization > 02:57:55.200695 [debug] [Thread-5 ]: Compiling model.airbyte_utils.active_storage_blobs_scd 2022-07-30 02:59:35 normalization > 02:57:55.221784 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.active_storage_blobs_scd" 2022-07-30 02:59:35 normalization > 02:57:55.222922 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:55.223561 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.active_storage_blobs_scd 2022-07-30 02:59:35 normalization > 02:57:55.227386 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:55.259251 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:55.261878 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.faq_scd" 2022-07-30 02:59:35 normalization > 02:57:55.266267 [info ] [Thread-3 ]: 73 of 201 OK created incremental model airbyte_cdc.buyer_contact_rules_scd.............................................. [CREATE TABLE (5.0 rows, 1.6 KB processed) in 6.15s] 2022-07-30 02:59:35 normalization > 02:57:55.272150 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:55.272867 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.buyer_contact_rules_scd 2022-07-30 02:59:35 normalization > 02:57:55.276068 [debug] [Thread-3 ]: Began running node model.airbyte_utils.changebase_metadata_scd 2022-07-30 02:59:35 normalization > 02:57:55.275628 [debug] [Thread-4 ]: Began executing node model.airbyte_utils.faq_scd 2022-07-30 02:59:35 normalization > 02:57:55.276958 [info ] [Thread-3 ]: 79 of 201 START incremental model airbyte_cdc.changebase_metadata_scd................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:55.336879 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.changebase_metadata_scd" 2022-07-30 02:59:35 normalization > 02:57:55.338558 [debug] [Thread-4 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:55.338825 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.changebase_metadata_scd 2022-07-30 02:59:35 normalization > 02:57:55.343081 [debug] [Thread-3 ]: Compiling model.airbyte_utils.changebase_metadata_scd 2022-07-30 02:59:35 normalization > 02:57:55.342442 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:55.367537 [info ] [Thread-8 ]: 75 of 201 OK created incremental model airbyte_cdc.categories_scd....................................................... [CREATE TABLE (43.0 rows, 13.8 KB processed) in 5.99s] 2022-07-30 02:59:35 normalization > 02:57:55.372431 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:55.374838 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.categories_scd 2022-07-30 02:59:35 normalization > 02:57:55.376554 [debug] [Thread-8 ]: Began running node model.airbyte_utils.flipper_features_scd 2022-07-30 02:59:35 normalization > 02:57:55.377421 [info ] [Thread-8 ]: 80 of 201 START incremental model airbyte_cdc.flipper_features_scd...................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:55.376096 [info ] [Thread-7 ]: 68 of 201 OK created incremental model airbyte_cdc.buyer_uploads_scd.................................................... [CREATE TABLE (14.0 rows, 9.0 KB processed) in 6.72s] 2022-07-30 02:59:35 normalization > 02:57:55.384355 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.flipper_features_scd" 2022-07-30 02:59:35 normalization > 02:57:55.412556 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.flipper_features_scd 2022-07-30 02:59:35 normalization > 02:57:55.406098 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.changebase_metadata_scd" 2022-07-30 02:59:35 normalization > 02:57:55.401484 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.buyer_uploads_scd 2022-07-30 02:59:35 normalization > 02:57:55.420494 [debug] [Thread-7 ]: Began running node model.airbyte_utils.buyer_store_recommendations_scd 2022-07-30 02:59:35 normalization > 02:57:55.420918 [info ] [Thread-7 ]: 81 of 201 START incremental model airbyte_cdc.buyer_store_recommendations_scd........................................... [RUN] 2022-07-30 02:59:35 normalization > 02:57:55.414249 [debug] [Thread-8 ]: Compiling model.airbyte_utils.flipper_features_scd 2022-07-30 02:59:35 normalization > 02:57:55.438722 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:55.439701 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_store_recommendations_scd" 2022-07-30 02:59:35 normalization > 02:57:55.440403 [debug] [Thread-3 ]: Began executing node model.airbyte_utils.changebase_metadata_scd 2022-07-30 02:59:35 normalization > 02:57:55.461085 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.flipper_features_scd" 2022-07-30 02:59:35 normalization > 02:57:55.461410 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.buyer_store_recommendations_scd 2022-07-30 02:59:35 normalization > 02:57:55.468520 [debug] [Thread-3 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:55.469036 [debug] [Thread-7 ]: Compiling model.airbyte_utils.buyer_store_recommendations_scd 2022-07-30 02:59:35 normalization > 02:57:55.480433 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:55.480753 [debug] [Thread-8 ]: Began executing node model.airbyte_utils.flipper_features_scd 2022-07-30 02:59:35 normalization > 02:57:55.484029 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:55.527208 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.buyer_store_recommendations_scd" 2022-07-30 02:59:35 normalization > 02:57:55.531841 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:55.532257 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.buyer_store_recommendations_scd 2022-07-30 02:59:35 normalization > 02:57:55.538109 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:55.627540 [debug] [Thread-5 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/active_storage_blobs_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.active_storage_blobs_scd 2022-07-30 02:59:35 normalization > 02:57:55.629059 [info ] [Thread-5 ]: 02:57:55 + `dwcasa`.airbyte_cdc.`active_storage_blobs_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:57:55.633124 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.active_storage_blobs_scd" 2022-07-30 02:59:35 normalization > 02:57:55.633575 [debug] [Thread-5 ]: On model.airbyte_utils.active_storage_blobs_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.active_storage_blobs_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`active_storage_blobs_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('active_storage_blobs_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`active_storage_blobs_stg` 2022-07-30 02:59:35 normalization > -- active_storage_blobs from `dwcasa`.airbyte_cdc._airbyte_raw_active_storage_blobs 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > key, 2022-07-30 02:59:35 normalization > checksum, 2022-07-30 02:59:35 normalization > filename, 2022-07-30 02:59:35 normalization > metadata, 2022-07-30 02:59:35 normalization > byte_size, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > content_type, 2022-07-30 02:59:35 normalization > service_name, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_active_storage_blobs_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > key, 2022-07-30 02:59:35 normalization > checksum, 2022-07-30 02:59:35 normalization > filename, 2022-07-30 02:59:35 normalization > metadata, 2022-07-30 02:59:35 normalization > byte_size, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > content_type, 2022-07-30 02:59:35 normalization > service_name, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_active_storage_blobs_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:55.690302 [debug] [Thread-4 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/faq_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.faq_scd 2022-07-30 02:59:35 normalization > 02:57:55.691981 [info ] [Thread-4 ]: 02:57:55 + `dwcasa`.airbyte_cdc.`faq_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:57:55.704945 [debug] [Thread-4 ]: Writing runtime SQL for node "model.airbyte_utils.faq_scd" 2022-07-30 02:59:35 normalization > 02:57:55.712198 [debug] [Thread-8 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/flipper_features_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.flipper_features_scd 2022-07-30 02:59:35 normalization > 02:57:55.713365 [info ] [Thread-8 ]: 02:57:55 + `dwcasa`.airbyte_cdc.`flipper_features_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:57:55.716516 [debug] [Thread-3 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/changebase_metadata_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.changebase_metadata_scd 2022-07-30 02:59:35 normalization > 02:57:55.717427 [debug] [Thread-4 ]: On model.airbyte_utils.faq_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.faq_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`faq_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('faq_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`faq_stg` 2022-07-30 02:59:35 normalization > -- faq from `dwcasa`.airbyte_cdc._airbyte_raw_faq 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > title, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > description, 2022-07-30 02:59:35 normalization > faq_category_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_faq_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > title, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > description, 2022-07-30 02:59:35 normalization > faq_category_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_faq_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:55.724535 [debug] [Thread-8 ]: Writing runtime SQL for node "model.airbyte_utils.flipper_features_scd" 2022-07-30 02:59:35 normalization > 02:57:55.725650 [info ] [Thread-3 ]: 02:57:55 + `dwcasa`.airbyte_cdc.`changebase_metadata_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:57:55.735012 [debug] [Thread-3 ]: Writing runtime SQL for node "model.airbyte_utils.changebase_metadata_scd" 2022-07-30 02:59:35 normalization > 02:57:55.735570 [debug] [Thread-8 ]: On model.airbyte_utils.flipper_features_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.flipper_features_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`flipper_features_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('flipper_features_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`flipper_features_stg` 2022-07-30 02:59:35 normalization > -- flipper_features from `dwcasa`.airbyte_cdc._airbyte_raw_flipper_features 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > key, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_flipper_features_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > key, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_flipper_features_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:55.737789 [debug] [Thread-3 ]: On model.airbyte_utils.changebase_metadata_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.changebase_metadata_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`changebase_metadata_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('changebase_metadata_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`changebase_metadata_stg` 2022-07-30 02:59:35 normalization > -- changebase_metadata from `dwcasa`.airbyte_cdc._airbyte_raw_changebase_metadata 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(version as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > data, 2022-07-30 02:59:35 normalization > version, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(version as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(version as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_changebase_metadata_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > data, 2022-07-30 02:59:35 normalization > version, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_changebase_metadata_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:55.745296 [debug] [Thread-7 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/buyer_store_recommendations_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.buyer_store_recommendations_scd 2022-07-30 02:59:35 normalization > 02:57:55.747776 [info ] [Thread-7 ]: 02:57:55 + `dwcasa`.airbyte_cdc.`buyer_store_recommendations_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:57:55.755102 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.buyer_store_recommendations_scd" 2022-07-30 02:59:35 normalization > 02:57:55.755576 [debug] [Thread-7 ]: On model.airbyte_utils.buyer_store_recommendations_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_store_recommendations_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`buyer_store_recommendations_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('buyer_store_recommendations_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`buyer_store_recommendations_stg` 2022-07-30 02:59:35 normalization > -- buyer_store_recommendations from `dwcasa`.airbyte_cdc._airbyte_raw_buyer_store_recommendations 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > buyer_id, 2022-07-30 02:59:35 normalization > store_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > store_name, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > store_email, 2022-07-30 02:59:35 normalization > store_phone, 2022-07-30 02:59:35 normalization > contact_name, 2022-07-30 02:59:35 normalization > buyer_user_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_buyer_store_recommendations_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > buyer_id, 2022-07-30 02:59:35 normalization > store_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > store_name, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > store_email, 2022-07-30 02:59:35 normalization > store_phone, 2022-07-30 02:59:35 normalization > contact_name, 2022-07-30 02:59:35 normalization > buyer_user_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_buyer_store_recommendations_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:55.806032 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:55.806951 [info ] [Thread-6 ]: 72 of 201 OK created incremental model airbyte_cdc.buyer_public_informations_scd........................................ [CREATE TABLE (2.0k rows, 5.1 MB processed) in 6.74s] 2022-07-30 02:59:35 normalization > 02:57:55.807344 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.buyer_public_informations_scd 2022-07-30 02:59:35 normalization > 02:57:55.807639 [debug] [Thread-6 ]: Began running node model.airbyte_utils.faq_categories_scd 2022-07-30 02:59:35 normalization > 02:57:55.808225 [info ] [Thread-6 ]: 82 of 201 START incremental model airbyte_cdc.faq_categories_scd........................................................ [RUN] 2022-07-30 02:59:35 normalization > 02:57:55.809654 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.faq_categories_scd" 2022-07-30 02:59:35 normalization > 02:57:55.809819 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.faq_categories_scd 2022-07-30 02:59:35 normalization > 02:57:55.809954 [debug] [Thread-6 ]: Compiling model.airbyte_utils.faq_categories_scd 2022-07-30 02:59:35 normalization > 02:57:55.833004 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.faq_categories_scd" 2022-07-30 02:59:35 normalization > 02:57:55.833447 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:55.833600 [debug] [Thread-6 ]: Began executing node model.airbyte_utils.faq_categories_scd 2022-07-30 02:59:35 normalization > 02:57:55.836699 [debug] [Thread-6 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:55.971504 [debug] [Thread-6 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/faq_categories_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.faq_categories_scd 2022-07-30 02:59:35 normalization > 02:57:55.972672 [info ] [Thread-6 ]: 02:57:55 + `dwcasa`.airbyte_cdc.`faq_categories_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:57:55.976550 [debug] [Thread-6 ]: Writing runtime SQL for node "model.airbyte_utils.faq_categories_scd" 2022-07-30 02:59:35 normalization > 02:57:55.976959 [debug] [Thread-6 ]: On model.airbyte_utils.faq_categories_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.faq_categories_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`faq_categories_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('faq_categories_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`faq_categories_stg` 2022-07-30 02:59:35 normalization > -- faq_categories from `dwcasa`.airbyte_cdc._airbyte_raw_faq_categories 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_faq_categories_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_faq_categories_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:56.867784 [debug] [Thread-1 ]: On model.airbyte_utils.active_storage_attachments_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.active_storage_attachments_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.active_storage_attachments_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:57.487988 [debug] [Thread-2 ]: On model.airbyte_utils.ar_internal_metadata_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.ar_internal_metadata_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`ar_internal_metadata_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:57.494743 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:57.496123 [info ] [Thread-1 ]: 71 of 201 OK created incremental model airbyte_cdc.active_storage_attachments_scd....................................... [CREATE TABLE (56.2k rows, 16.1 MB processed) in 8.59s] 2022-07-30 02:59:35 normalization > 02:57:57.497637 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.active_storage_attachments_scd 2022-07-30 02:59:35 normalization > 02:57:57.497979 [debug] [Thread-1 ]: Began running node model.airbyte_utils.buyers_scd 2022-07-30 02:59:35 normalization > 02:57:57.498691 [info ] [Thread-1 ]: 83 of 201 START incremental model airbyte_cdc.buyers_scd................................................................ [RUN] 2022-07-30 02:59:35 normalization > 02:57:57.500281 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.buyers_scd" 2022-07-30 02:59:35 normalization > 02:57:57.500524 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.buyers_scd 2022-07-30 02:59:35 normalization > 02:57:57.500721 [debug] [Thread-1 ]: Compiling model.airbyte_utils.buyers_scd 2022-07-30 02:59:35 normalization > 02:57:57.522915 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.buyers_scd" 2022-07-30 02:59:35 normalization > 02:57:57.523356 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:57:57.523592 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.buyers_scd 2022-07-30 02:59:35 normalization > 02:57:57.527997 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:57:57.690378 [debug] [Thread-1 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/buyers_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.buyers_scd 2022-07-30 02:59:35 normalization > 02:57:57.691736 [info ] [Thread-1 ]: 02:57:57 + `dwcasa`.airbyte_cdc.`buyers_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:57:57.699238 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.buyers_scd" 2022-07-30 02:59:35 normalization > 02:57:57.701294 [debug] [Thread-1 ]: On model.airbyte_utils.buyers_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyers_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`buyers_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('buyers_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`buyers_stg` 2022-07-30 02:59:35 normalization > -- buyers from `dwcasa`.airbyte_cdc._airbyte_raw_buyers 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > cnpj, 2022-07-30 02:59:35 normalization > wholesale, 2022-07-30 02:59:35 normalization > conta_azul, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > spend_limit, 2022-07-30 02:59:35 normalization > truora_size, 2022-07-30 02:59:35 normalization > trading_name, 2022-07-30 02:59:35 normalization > type_company, 2022-07-30 02:59:35 normalization > business_name, 2022-07-30 02:59:35 normalization > financing_fee, 2022-07-30 02:59:35 normalization > location_city, 2022-07-30 02:59:35 normalization > max_term_days, 2022-07-30 02:59:35 normalization > location_state, 2022-07-30 02:59:35 normalization > truora_address, 2022-07-30 02:59:35 normalization > truora_check_id, 2022-07-30 02:59:35 normalization > default_payer_id, 2022-07-30 02:59:35 normalization > truora_legal_type, 2022-07-30 02:59:35 normalization > truora_started_on, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > new_orders_blocked, 2022-07-30 02:59:35 normalization > state_registration, 2022-07-30 02:59:35 normalization > truora_trading_name, 2022-07-30 02:59:35 normalization > truora_business_name, 2022-07-30 02:59:35 normalization > average_monthly_spend, 2022-07-30 02:59:35 normalization > municipal_registration, 2022-07-30 02:59:35 normalization > truora_main_activities, 2022-07-30 02:59:35 normalization > truora_unfiltered_data, 2022-07-30 02:59:35 normalization > truora_current_irs_status, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_buyers_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > cnpj, 2022-07-30 02:59:35 normalization > wholesale, 2022-07-30 02:59:35 normalization > conta_azul, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > spend_limit, 2022-07-30 02:59:35 normalization > truora_size, 2022-07-30 02:59:35 normalization > trading_name, 2022-07-30 02:59:35 normalization > type_company, 2022-07-30 02:59:35 normalization > business_name, 2022-07-30 02:59:35 normalization > financing_fee, 2022-07-30 02:59:35 normalization > location_city, 2022-07-30 02:59:35 normalization > max_term_days, 2022-07-30 02:59:35 normalization > location_state, 2022-07-30 02:59:35 normalization > truora_address, 2022-07-30 02:59:35 normalization > truora_check_id, 2022-07-30 02:59:35 normalization > default_payer_id, 2022-07-30 02:59:35 normalization > truora_legal_type, 2022-07-30 02:59:35 normalization > truora_started_on, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > new_orders_blocked, 2022-07-30 02:59:35 normalization > state_registration, 2022-07-30 02:59:35 normalization > truora_trading_name, 2022-07-30 02:59:35 normalization > truora_business_name, 2022-07-30 02:59:35 normalization > average_monthly_spend, 2022-07-30 02:59:35 normalization > municipal_registration, 2022-07-30 02:59:35 normalization > truora_main_activities, 2022-07-30 02:59:35 normalization > truora_unfiltered_data, 2022-07-30 02:59:35 normalization > truora_current_irs_status, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_buyers_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:58.445962 [debug] [Thread-6 ]: On model.airbyte_utils.faq_categories_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.faq_categories_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`faq_categories_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:58.476779 [debug] [Thread-3 ]: On model.airbyte_utils.changebase_metadata_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.changebase_metadata_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`changebase_metadata_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:58.499160 [debug] [Thread-8 ]: On model.airbyte_utils.flipper_features_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.flipper_features_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`flipper_features_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:58.509691 [debug] [Thread-7 ]: On model.airbyte_utils.buyer_store_recommendations_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_store_recommendations_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`buyer_store_recommendations_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:58.735902 [debug] [Thread-1 ]: BigQuery adapter: Retry attempt 1 of 3 after error: BadRequest("Invalid date: '1994-03-17T00:00:00Z'") 2022-07-30 02:59:35 normalization > 02:57:58.828777 [debug] [Thread-4 ]: On model.airbyte_utils.faq_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.faq_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`faq_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:57:59.920866 [debug] [Thread-2 ]: On model.airbyte_utils.ar_internal_metadata_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.ar_internal_metadata_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.ar_internal_metadata_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:00.001542 [debug] [Thread-1 ]: BigQuery adapter: Retry attempt 2 of 3 after error: BadRequest("Invalid date: '1994-03-17T00:00:00Z'") 2022-07-30 02:59:35 normalization > 02:58:00.500963 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:00.501879 [info ] [Thread-2 ]: 76 of 201 OK created incremental model airbyte_cdc.ar_internal_metadata_scd............................................. [CREATE TABLE (1.0 rows, 277.0 Bytes processed) in 6.09s] 2022-07-30 02:59:35 normalization > 02:58:00.502305 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.ar_internal_metadata_scd 2022-07-30 02:59:35 normalization > 02:58:00.502755 [debug] [Thread-2 ]: Began running node model.airbyte_utils.freight_partners_scd 2022-07-30 02:59:35 normalization > 02:58:00.503979 [info ] [Thread-2 ]: 84 of 201 START incremental model airbyte_cdc.freight_partners_scd...................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:00.507352 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_partners_scd" 2022-07-30 02:59:35 normalization > 02:58:00.507582 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.freight_partners_scd 2022-07-30 02:59:35 normalization > 02:58:00.507999 [debug] [Thread-2 ]: Compiling model.airbyte_utils.freight_partners_scd 2022-07-30 02:59:35 normalization > 02:58:00.576841 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.freight_partners_scd" 2022-07-30 02:59:35 normalization > 02:58:00.577301 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:00.580000 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.freight_partners_scd 2022-07-30 02:59:35 normalization > 02:58:00.591668 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:00.760334 [debug] [Thread-2 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/freight_partners_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.freight_partners_scd 2022-07-30 02:59:35 normalization > 02:58:00.761491 [info ] [Thread-2 ]: 02:58:00 + `dwcasa`.airbyte_cdc.`freight_partners_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:00.774975 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.freight_partners_scd" 2022-07-30 02:59:35 normalization > 02:58:00.786684 [debug] [Thread-2 ]: On model.airbyte_utils.freight_partners_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_partners_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`freight_partners_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('freight_partners_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`freight_partners_stg` 2022-07-30 02:59:35 normalization > -- freight_partners from `dwcasa`.airbyte_cdc._airbyte_raw_freight_partners 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > cpf, 2022-07-30 02:59:35 normalization > cnpj, 2022-07-30 02:59:35 normalization > email, 2022-07-30 02:59:35 normalization > active, 2022-07-30 02:59:35 normalization > website, 2022-07-30 02:59:35 normalization > whatsapp, 2022-07-30 02:59:35 normalization > daily_fee, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > is_dedicated, 2022-07-30 02:59:35 normalization > payment_type, 2022-07-30 02:59:35 normalization > trading_name, 2022-07-30 02:59:35 normalization > business_name, 2022-07-30 02:59:35 normalization > point_of_contact, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_freight_partners_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > cpf, 2022-07-30 02:59:35 normalization > cnpj, 2022-07-30 02:59:35 normalization > email, 2022-07-30 02:59:35 normalization > active, 2022-07-30 02:59:35 normalization > website, 2022-07-30 02:59:35 normalization > whatsapp, 2022-07-30 02:59:35 normalization > daily_fee, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > is_dedicated, 2022-07-30 02:59:35 normalization > payment_type, 2022-07-30 02:59:35 normalization > trading_name, 2022-07-30 02:59:35 normalization > business_name, 2022-07-30 02:59:35 normalization > point_of_contact, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_freight_partners_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:00.797776 [debug] [Thread-6 ]: On model.airbyte_utils.faq_categories_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.faq_categories_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.faq_categories_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:00.842836 [debug] [Thread-7 ]: On model.airbyte_utils.buyer_store_recommendations_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_store_recommendations_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.buyer_store_recommendations_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:00.901418 [debug] [Thread-3 ]: On model.airbyte_utils.changebase_metadata_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.changebase_metadata_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.changebase_metadata_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:01.102264 [debug] [Thread-8 ]: On model.airbyte_utils.flipper_features_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.flipper_features_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.flipper_features_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:01.160185 [debug] [Thread-4 ]: On model.airbyte_utils.faq_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.faq_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.faq_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:01.364405 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:01.365418 [info ] [Thread-6 ]: 82 of 201 OK created incremental model airbyte_cdc.faq_categories_scd................................................... [CREATE TABLE (8.0 rows, 2.1 KB processed) in 5.56s] 2022-07-30 02:59:35 normalization > 02:58:01.365859 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.faq_categories_scd 2022-07-30 02:59:35 normalization > 02:58:01.366141 [debug] [Thread-6 ]: Began running node model.airbyte_utils.heya_campaign_memberships_scd 2022-07-30 02:59:35 normalization > 02:58:01.366915 [info ] [Thread-6 ]: 85 of 201 START incremental model airbyte_cdc.heya_campaign_memberships_scd............................................. [RUN] 2022-07-30 02:59:35 normalization > 02:58:01.368076 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.heya_campaign_memberships_scd" 2022-07-30 02:59:35 normalization > 02:58:01.368255 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.heya_campaign_memberships_scd 2022-07-30 02:59:35 normalization > 02:58:01.368374 [debug] [Thread-6 ]: Compiling model.airbyte_utils.heya_campaign_memberships_scd 2022-07-30 02:59:35 normalization > 02:58:01.388166 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.heya_campaign_memberships_scd" 2022-07-30 02:59:35 normalization > 02:58:01.388646 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:01.388819 [debug] [Thread-6 ]: Began executing node model.airbyte_utils.heya_campaign_memberships_scd 2022-07-30 02:59:35 normalization > 02:58:01.394812 [debug] [Thread-6 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:01.501938 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:01.504988 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:01.506425 [info ] [Thread-3 ]: 79 of 201 OK created incremental model airbyte_cdc.changebase_metadata_scd.............................................. [CREATE TABLE (0.0 rows, 0 processed) in 6.17s] 2022-07-30 02:59:35 normalization > 02:58:01.506841 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.changebase_metadata_scd 2022-07-30 02:59:35 normalization > 02:58:01.508328 [debug] [Thread-3 ]: Began running node model.airbyte_utils.freight_route_partner_costs_scd 2022-07-30 02:59:35 normalization > 02:58:01.509476 [info ] [Thread-3 ]: 86 of 201 START incremental model airbyte_cdc.freight_route_partner_costs_scd........................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:01.509833 [info ] [Thread-7 ]: 81 of 201 OK created incremental model airbyte_cdc.buyer_store_recommendations_scd...................................... [CREATE TABLE (1.0 rows, 410.0 Bytes processed) in 6.08s] 2022-07-30 02:59:35 normalization > 02:58:01.511337 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_route_partner_costs_scd" 2022-07-30 02:59:35 normalization > 02:58:01.511801 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.freight_route_partner_costs_scd 2022-07-30 02:59:35 normalization > 02:58:01.512029 [debug] [Thread-3 ]: Compiling model.airbyte_utils.freight_route_partner_costs_scd 2022-07-30 02:59:35 normalization > 02:58:01.523587 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.buyer_store_recommendations_scd 2022-07-30 02:59:35 normalization > 02:58:01.529146 [debug] [Thread-7 ]: Began running node model.airbyte_utils.freight_partner_vehicles_scd 2022-07-30 02:59:35 normalization > 02:58:01.530772 [info ] [Thread-7 ]: 87 of 201 START incremental model airbyte_cdc.freight_partner_vehicles_scd.............................................. [RUN] 2022-07-30 02:59:35 normalization > 02:58:01.536067 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.freight_route_partner_costs_scd" 2022-07-30 02:59:35 normalization > 02:58:01.536869 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_partner_vehicles_scd" 2022-07-30 02:59:35 normalization > 02:58:01.537308 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.freight_partner_vehicles_scd 2022-07-30 02:59:35 normalization > 02:58:01.537591 [debug] [Thread-7 ]: Compiling model.airbyte_utils.freight_partner_vehicles_scd 2022-07-30 02:59:35 normalization > 02:58:01.537783 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:01.556702 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.freight_partner_vehicles_scd" 2022-07-30 02:59:35 normalization > 02:58:01.556975 [debug] [Thread-3 ]: Began executing node model.airbyte_utils.freight_route_partner_costs_scd 2022-07-30 02:59:35 normalization > 02:58:01.560996 [debug] [Thread-3 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:01.561547 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:01.561851 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.freight_partner_vehicles_scd 2022-07-30 02:59:35 normalization > 02:58:01.566621 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:01.569300 [debug] [Thread-6 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/heya_campaign_memberships_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.heya_campaign_memberships_scd 2022-07-30 02:59:35 normalization > 02:58:01.570964 [info ] [Thread-6 ]: 02:58:01 + `dwcasa`.airbyte_cdc.`heya_campaign_memberships_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:01.580492 [debug] [Thread-6 ]: Writing runtime SQL for node "model.airbyte_utils.heya_campaign_memberships_scd" 2022-07-30 02:59:35 normalization > 02:58:01.581011 [debug] [Thread-6 ]: On model.airbyte_utils.heya_campaign_memberships_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.heya_campaign_memberships_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`heya_campaign_memberships_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('heya_campaign_memberships_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`heya_campaign_memberships_stg` 2022-07-30 02:59:35 normalization > -- heya_campaign_memberships from `dwcasa`.airbyte_cdc._airbyte_raw_heya_campaign_memberships 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > user_id, 2022-07-30 02:59:35 normalization > step_gid, 2022-07-30 02:59:35 normalization > user_type, 2022-07-30 02:59:35 normalization > concurrent, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > campaign_gid, 2022-07-30 02:59:35 normalization > last_sent_at, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_heya_campaign_memberships_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > user_id, 2022-07-30 02:59:35 normalization > step_gid, 2022-07-30 02:59:35 normalization > user_type, 2022-07-30 02:59:35 normalization > concurrent, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > campaign_gid, 2022-07-30 02:59:35 normalization > last_sent_at, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_heya_campaign_memberships_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:01.631107 [debug] [Thread-1 ]: BigQuery adapter: Retry attempt 3 of 3 after error: BadRequest("Invalid date: '1994-03-17T00:00:00Z'") 2022-07-30 02:59:35 normalization > 02:58:01.706719 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:01.707689 [info ] [Thread-8 ]: 80 of 201 OK created incremental model airbyte_cdc.flipper_features_scd................................................. [CREATE TABLE (10.0 rows, 2.6 KB processed) in 6.32s] 2022-07-30 02:59:35 normalization > 02:58:01.708113 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.flipper_features_scd 2022-07-30 02:59:35 normalization > 02:58:01.708553 [debug] [Thread-8 ]: Began running node model.airbyte_utils.freight_product_orders_scd 2022-07-30 02:59:35 normalization > 02:58:01.709383 [info ] [Thread-8 ]: 88 of 201 START incremental model airbyte_cdc.freight_product_orders_scd................................................ [RUN] 2022-07-30 02:59:35 normalization > 02:58:01.710548 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_product_orders_scd" 2022-07-30 02:59:35 normalization > 02:58:01.710725 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.freight_product_orders_scd 2022-07-30 02:59:35 normalization > 02:58:01.710846 [debug] [Thread-8 ]: Compiling model.airbyte_utils.freight_product_orders_scd 2022-07-30 02:59:35 normalization > 02:58:01.730714 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.freight_product_orders_scd" 2022-07-30 02:59:35 normalization > 02:58:01.731148 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:01.731306 [debug] [Thread-8 ]: Began executing node model.airbyte_utils.freight_product_orders_scd 2022-07-30 02:59:35 normalization > 02:58:01.734942 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:01.766877 [debug] [Thread-3 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/freight_route_partner_costs_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.freight_route_partner_costs_scd 2022-07-30 02:59:35 normalization > 02:58:01.768113 [info ] [Thread-3 ]: 02:58:01 + `dwcasa`.airbyte_cdc.`freight_route_partner_costs_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:01.776804 [debug] [Thread-3 ]: Writing runtime SQL for node "model.airbyte_utils.freight_route_partner_costs_scd" 2022-07-30 02:59:35 normalization > 02:58:01.777556 [debug] [Thread-7 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/freight_partner_vehicles_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.freight_partner_vehicles_scd 2022-07-30 02:59:35 normalization > 02:58:01.780738 [info ] [Thread-7 ]: 02:58:01 + `dwcasa`.airbyte_cdc.`freight_partner_vehicles_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:01.785511 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.freight_partner_vehicles_scd" 2022-07-30 02:59:35 normalization > 02:58:01.786643 [debug] [Thread-7 ]: On model.airbyte_utils.freight_partner_vehicles_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_partner_vehicles_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`freight_partner_vehicles_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('freight_partner_vehicles_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`freight_partner_vehicles_stg` 2022-07-30 02:59:35 normalization > -- freight_partner_vehicles from `dwcasa`.airbyte_cdc._airbyte_raw_freight_partner_vehicles 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > plate, 2022-07-30 02:59:35 normalization > start_lat, 2022-07-30 02:59:35 normalization > start_lng, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > start_location, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > freight_partner_id, 2022-07-30 02:59:35 normalization > freight_vehicle_type_id, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_freight_partner_vehicles_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > plate, 2022-07-30 02:59:35 normalization > start_lat, 2022-07-30 02:59:35 normalization > start_lng, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > start_location, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > freight_partner_id, 2022-07-30 02:59:35 normalization > freight_vehicle_type_id, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_freight_partner_vehicles_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:01.785961 [debug] [Thread-3 ]: On model.airbyte_utils.freight_route_partner_costs_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_route_partner_costs_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`freight_route_partner_costs_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('freight_route_partner_costs_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`freight_route_partner_costs_stg` 2022-07-30 02:59:35 normalization > -- freight_route_partner_costs from `dwcasa`.airbyte_cdc._airbyte_raw_freight_route_partner_costs 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > cost, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > extra_cost, 2022-07-30 02:59:35 normalization > total_cost, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > is_dedicated, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > extra_cost_details, 2022-07-30 02:59:35 normalization > freight_partner_id, 2022-07-30 02:59:35 normalization > delivery_work_end_at, 2022-07-30 02:59:35 normalization > delivery_work_start_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_freight_route_partner_costs_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > cost, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > extra_cost, 2022-07-30 02:59:35 normalization > total_cost, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > is_dedicated, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > extra_cost_details, 2022-07-30 02:59:35 normalization > freight_partner_id, 2022-07-30 02:59:35 normalization > delivery_work_end_at, 2022-07-30 02:59:35 normalization > delivery_work_start_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_freight_route_partner_costs_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:01.817572 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:01.818560 [info ] [Thread-4 ]: 77 of 201 OK created incremental model airbyte_cdc.faq_scd.............................................................. [CREATE TABLE (23.0 rows, 15.9 KB processed) in 6.79s] 2022-07-30 02:59:35 normalization > 02:58:01.819138 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.faq_scd 2022-07-30 02:59:35 normalization > 02:58:01.819522 [debug] [Thread-4 ]: Began running node model.airbyte_utils.flipper_gates_scd 2022-07-30 02:59:35 normalization > 02:58:01.820200 [info ] [Thread-4 ]: 89 of 201 START incremental model airbyte_cdc.flipper_gates_scd......................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:01.821195 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.flipper_gates_scd" 2022-07-30 02:59:35 normalization > 02:58:01.821364 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.flipper_gates_scd 2022-07-30 02:59:35 normalization > 02:58:01.821498 [debug] [Thread-4 ]: Compiling model.airbyte_utils.flipper_gates_scd 2022-07-30 02:59:35 normalization > 02:58:01.842019 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.flipper_gates_scd" 2022-07-30 02:59:35 normalization > 02:58:01.843094 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:01.843280 [debug] [Thread-4 ]: Began executing node model.airbyte_utils.flipper_gates_scd 2022-07-30 02:59:35 normalization > 02:58:01.846518 [debug] [Thread-4 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:01.937173 [debug] [Thread-8 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/freight_product_orders_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.freight_product_orders_scd 2022-07-30 02:59:35 normalization > 02:58:01.938339 [info ] [Thread-8 ]: 02:58:01 + `dwcasa`.airbyte_cdc.`freight_product_orders_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:01.942639 [debug] [Thread-8 ]: Writing runtime SQL for node "model.airbyte_utils.freight_product_orders_scd" 2022-07-30 02:59:35 normalization > 02:58:01.943140 [debug] [Thread-8 ]: On model.airbyte_utils.freight_product_orders_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_product_orders_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`freight_product_orders_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('freight_product_orders_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`freight_product_orders_stg` 2022-07-30 02:59:35 normalization > -- freight_product_orders from `dwcasa`.airbyte_cdc._airbyte_raw_freight_product_orders 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > freight_id, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > product_order_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > quantity_in_freight, 2022-07-30 02:59:35 normalization > internal_product_freight_note, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_freight_product_orders_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > freight_id, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > product_order_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > quantity_in_freight, 2022-07-30 02:59:35 normalization > internal_product_freight_note, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_freight_product_orders_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:02.070517 [debug] [Thread-4 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/flipper_gates_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.flipper_gates_scd 2022-07-30 02:59:35 normalization > 02:58:02.071731 [info ] [Thread-4 ]: 02:58:02 + `dwcasa`.airbyte_cdc.`flipper_gates_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:02.075585 [debug] [Thread-4 ]: Writing runtime SQL for node "model.airbyte_utils.flipper_gates_scd" 2022-07-30 02:59:35 normalization > 02:58:02.076003 [debug] [Thread-4 ]: On model.airbyte_utils.flipper_gates_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.flipper_gates_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`flipper_gates_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('flipper_gates_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`flipper_gates_stg` 2022-07-30 02:59:35 normalization > -- flipper_gates from `dwcasa`.airbyte_cdc._airbyte_raw_flipper_gates 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > key, 2022-07-30 02:59:35 normalization > value, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > feature_key, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_flipper_gates_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > key, 2022-07-30 02:59:35 normalization > value, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > feature_key, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_flipper_gates_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:02.717676 [debug] [Thread-5 ]: On model.airbyte_utils.active_storage_blobs_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.active_storage_blobs_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`active_storage_blobs_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:03.474286 [debug] [Thread-2 ]: On model.airbyte_utils.freight_partners_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_partners_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`freight_partners_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:03.521878 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:03.522618 [debug] [Thread-1 ]: Database Error in model buyers_scd (models/generated/airbyte_incremental/scd/airbyte_cdc/buyers_scd.sql) 2022-07-30 02:59:35 normalization > Invalid date: '2019-10-31T00:00:00Z' 2022-07-30 02:59:35 normalization > compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_incremental/scd/airbyte_cdc/buyers_scd.sql 2022-07-30 02:59:35 normalization > 02:58:03.523045 [error] [Thread-1 ]: 83 of 201 ERROR creating incremental model airbyte_cdc.buyers_scd....................................................... [ERROR in 6.02s] 2022-07-30 02:59:35 normalization > 02:58:03.524096 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.buyers_scd 2022-07-30 02:59:35 normalization > 02:58:03.524518 [debug] [Thread-1 ]: Began running node model.airbyte_utils.freight_route_groupings_scd 2022-07-30 02:59:35 normalization > 02:58:03.525256 [info ] [Thread-1 ]: 90 of 201 START incremental model airbyte_cdc.freight_route_groupings_scd............................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:03.526469 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_route_groupings_scd" 2022-07-30 02:59:35 normalization > 02:58:03.526874 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.freight_route_groupings_scd 2022-07-30 02:59:35 normalization > 02:58:03.527006 [debug] [Thread-1 ]: Compiling model.airbyte_utils.freight_route_groupings_scd 2022-07-30 02:59:35 normalization > 02:58:03.556523 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.freight_route_groupings_scd" 2022-07-30 02:59:35 normalization > 02:58:03.556988 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:03.557154 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.freight_route_groupings_scd 2022-07-30 02:59:35 normalization > 02:58:03.560310 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:03.722664 [debug] [Thread-1 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/freight_route_groupings_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.freight_route_groupings_scd 2022-07-30 02:59:35 normalization > 02:58:03.724062 [info ] [Thread-1 ]: 02:58:03 + `dwcasa`.airbyte_cdc.`freight_route_groupings_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:03.733612 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.freight_route_groupings_scd" 2022-07-30 02:59:35 normalization > 02:58:03.734086 [debug] [Thread-1 ]: On model.airbyte_utils.freight_route_groupings_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_route_groupings_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`freight_route_groupings_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('freight_route_groupings_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`freight_route_groupings_stg` 2022-07-30 02:59:35 normalization > -- freight_route_groupings from `dwcasa`.airbyte_cdc._airbyte_raw_freight_route_groupings 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > freight_id, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > freight_route_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > delivery_note_link, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_freight_route_groupings_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > freight_id, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > freight_route_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > delivery_note_link, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_freight_route_groupings_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:04.299852 [debug] [Thread-6 ]: On model.airbyte_utils.heya_campaign_memberships_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.heya_campaign_memberships_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`heya_campaign_memberships_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:04.552014 [debug] [Thread-7 ]: On model.airbyte_utils.freight_partner_vehicles_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_partner_vehicles_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`freight_partner_vehicles_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:04.777647 [debug] [Thread-3 ]: On model.airbyte_utils.freight_route_partner_costs_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_route_partner_costs_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`freight_route_partner_costs_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:05.100287 [debug] [Thread-5 ]: On model.airbyte_utils.active_storage_blobs_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.active_storage_blobs_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.active_storage_blobs_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:05.725229 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:05.726120 [info ] [Thread-5 ]: 78 of 201 OK created incremental model airbyte_cdc.active_storage_blobs_scd............................................. [CREATE TABLE (56.5k rows, 26.0 MB processed) in 10.53s] 2022-07-30 02:59:35 normalization > 02:58:05.727418 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.active_storage_blobs_scd 2022-07-30 02:59:35 normalization > 02:58:05.727808 [debug] [Thread-5 ]: Began running node model.airbyte_utils.buyer_users_scd 2022-07-30 02:59:35 normalization > 02:58:05.728465 [info ] [Thread-5 ]: 91 of 201 START incremental model airbyte_cdc.buyer_users_scd........................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:05.729716 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_users_scd" 2022-07-30 02:59:35 normalization > 02:58:05.729948 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.buyer_users_scd 2022-07-30 02:59:35 normalization > 02:58:05.730151 [debug] [Thread-5 ]: Compiling model.airbyte_utils.buyer_users_scd 2022-07-30 02:59:35 normalization > 02:58:05.750850 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.buyer_users_scd" 2022-07-30 02:59:35 normalization > 02:58:05.751527 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:05.751704 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.buyer_users_scd 2022-07-30 02:59:35 normalization > 02:58:05.755881 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:05.872379 [debug] [Thread-2 ]: On model.airbyte_utils.freight_partners_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_partners_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.freight_partners_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:05.944651 [debug] [Thread-5 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/buyer_users_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.buyer_users_scd 2022-07-30 02:59:35 normalization > 02:58:05.945915 [info ] [Thread-5 ]: 02:58:05 + `dwcasa`.airbyte_cdc.`buyer_users_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:05.950108 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.buyer_users_scd" 2022-07-30 02:59:35 normalization > 02:58:05.950550 [debug] [Thread-5 ]: On model.airbyte_utils.buyer_users_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_users_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`buyer_users_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('buyer_users_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`buyer_users_stg` 2022-07-30 02:59:35 normalization > -- buyer_users from `dwcasa`.airbyte_cdc._airbyte_raw_buyer_users 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > email, 2022-07-30 02:59:35 normalization > active, 2022-07-30 02:59:35 normalization > profile, 2022-07-30 02:59:35 normalization > buyer_id, 2022-07-30 02:59:35 normalization > whatsapp, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > spend_limit, 2022-07-30 02:59:35 normalization > confirmed_at, 2022-07-30 02:59:35 normalization > referral_code, 2022-07-30 02:59:35 normalization > stytch_user_id, 2022-07-30 02:59:35 normalization > own_referral_code, 2022-07-30 02:59:35 normalization > unconfirmed_email, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > confirmation_token, 2022-07-30 02:59:35 normalization > encrypted_password, 2022-07-30 02:59:35 normalization > remember_created_at, 2022-07-30 02:59:35 normalization > confirmation_sent_at, 2022-07-30 02:59:35 normalization > reset_password_token, 2022-07-30 02:59:35 normalization > reset_password_sent_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_buyer_users_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > email, 2022-07-30 02:59:35 normalization > active, 2022-07-30 02:59:35 normalization > profile, 2022-07-30 02:59:35 normalization > buyer_id, 2022-07-30 02:59:35 normalization > whatsapp, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > spend_limit, 2022-07-30 02:59:35 normalization > confirmed_at, 2022-07-30 02:59:35 normalization > referral_code, 2022-07-30 02:59:35 normalization > stytch_user_id, 2022-07-30 02:59:35 normalization > own_referral_code, 2022-07-30 02:59:35 normalization > unconfirmed_email, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > confirmation_token, 2022-07-30 02:59:35 normalization > encrypted_password, 2022-07-30 02:59:35 normalization > remember_created_at, 2022-07-30 02:59:35 normalization > confirmation_sent_at, 2022-07-30 02:59:35 normalization > reset_password_token, 2022-07-30 02:59:35 normalization > reset_password_sent_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_buyer_users_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:06.273781 [debug] [Thread-8 ]: On model.airbyte_utils.freight_product_orders_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_product_orders_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`freight_product_orders_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:06.528591 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:06.529747 [info ] [Thread-2 ]: 84 of 201 OK created incremental model airbyte_cdc.freight_partners_scd................................................. [CREATE TABLE (99.0 rows, 50.9 KB processed) in 6.02s] 2022-07-30 02:59:35 normalization > 02:58:06.531486 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.freight_partners_scd 2022-07-30 02:59:35 normalization > 02:58:06.531916 [debug] [Thread-2 ]: Began running node model.airbyte_utils.freight_routes_scd 2022-07-30 02:59:35 normalization > 02:58:06.532785 [info ] [Thread-2 ]: 92 of 201 START incremental model airbyte_cdc.freight_routes_scd........................................................ [RUN] 2022-07-30 02:59:35 normalization > 02:58:06.536130 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_routes_scd" 2022-07-30 02:59:35 normalization > 02:58:06.536428 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.freight_routes_scd 2022-07-30 02:59:35 normalization > 02:58:06.537103 [debug] [Thread-2 ]: Compiling model.airbyte_utils.freight_routes_scd 2022-07-30 02:59:35 normalization > 02:58:06.558618 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.freight_routes_scd" 2022-07-30 02:59:35 normalization > 02:58:06.559221 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:06.559468 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.freight_routes_scd 2022-07-30 02:59:35 normalization > 02:58:06.564068 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:06.595881 [debug] [Thread-7 ]: On model.airbyte_utils.freight_partner_vehicles_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_partner_vehicles_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.freight_partner_vehicles_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:06.667585 [debug] [Thread-6 ]: On model.airbyte_utils.heya_campaign_memberships_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.heya_campaign_memberships_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.heya_campaign_memberships_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:06.736583 [debug] [Thread-2 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/freight_routes_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.freight_routes_scd 2022-07-30 02:59:35 normalization > 02:58:06.738094 [info ] [Thread-2 ]: 02:58:06 + `dwcasa`.airbyte_cdc.`freight_routes_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:06.743106 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.freight_routes_scd" 2022-07-30 02:59:35 normalization > 02:58:06.743692 [debug] [Thread-2 ]: On model.airbyte_utils.freight_routes_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_routes_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`freight_routes_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('freight_routes_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`freight_routes_stg` 2022-07-30 02:59:35 normalization > -- freight_routes from `dwcasa`.airbyte_cdc._airbyte_raw_freight_routes 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > sequence, 2022-07-30 02:59:35 normalization > pipefy_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > freight_price, 2022-07-30 02:59:35 normalization > total_distance, 2022-07-30 02:59:35 normalization > product_problems, 2022-07-30 02:59:35 normalization > delivery_problems, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > shareable_link_hash, 2022-07-30 02:59:35 normalization > client_delivery_notes, 2022-07-30 02:59:35 normalization > freight_tracking_link, 2022-07-30 02:59:35 normalization > freight_delivery_poc_phone, 2022-07-30 02:59:35 normalization > freight_partner_vehicle_id, 2022-07-30 02:59:35 normalization > freight_partner_external_id, 2022-07-30 02:59:35 normalization > freight_route_partner_cost_id, 2022-07-30 02:59:35 normalization > freight_actual_delivery_datetime, 2022-07-30 02:59:35 normalization > freight_delivery_point_of_contact, 2022-07-30 02:59:35 normalization > freight_scheduled_delivery_datetime, 2022-07-30 02:59:35 normalization > freight_partner_dedicated_when_associated, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_freight_routes_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > sequence, 2022-07-30 02:59:35 normalization > pipefy_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > freight_price, 2022-07-30 02:59:35 normalization > total_distance, 2022-07-30 02:59:35 normalization > product_problems, 2022-07-30 02:59:35 normalization > delivery_problems, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > shareable_link_hash, 2022-07-30 02:59:35 normalization > client_delivery_notes, 2022-07-30 02:59:35 normalization > freight_tracking_link, 2022-07-30 02:59:35 normalization > freight_delivery_poc_phone, 2022-07-30 02:59:35 normalization > freight_partner_vehicle_id, 2022-07-30 02:59:35 normalization > freight_partner_external_id, 2022-07-30 02:59:35 normalization > freight_route_partner_cost_id, 2022-07-30 02:59:35 normalization > freight_actual_delivery_datetime, 2022-07-30 02:59:35 normalization > freight_delivery_point_of_contact, 2022-07-30 02:59:35 normalization > freight_scheduled_delivery_datetime, 2022-07-30 02:59:35 normalization > freight_partner_dedicated_when_associated, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_freight_routes_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:07.059735 [debug] [Thread-3 ]: On model.airbyte_utils.freight_route_partner_costs_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_route_partner_costs_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.freight_route_partner_costs_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:07.231916 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:07.233022 [info ] [Thread-7 ]: 87 of 201 OK created incremental model airbyte_cdc.freight_partner_vehicles_scd......................................... [CREATE TABLE (113.0 rows, 43.1 KB processed) in 5.70s] 2022-07-30 02:59:35 normalization > 02:58:07.233873 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.freight_partner_vehicles_scd 2022-07-30 02:59:35 normalization > 02:58:07.234379 [debug] [Thread-7 ]: Began running node model.airbyte_utils.freight_vehicle_types_scd 2022-07-30 02:59:35 normalization > 02:58:07.236328 [info ] [Thread-7 ]: 93 of 201 START incremental model airbyte_cdc.freight_vehicle_types_scd................................................. [RUN] 2022-07-30 02:59:35 normalization > 02:58:07.239713 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_vehicle_types_scd" 2022-07-30 02:59:35 normalization > 02:58:07.240017 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.freight_vehicle_types_scd 2022-07-30 02:59:35 normalization > 02:58:07.240290 [debug] [Thread-7 ]: Compiling model.airbyte_utils.freight_vehicle_types_scd 2022-07-30 02:59:35 normalization > 02:58:07.265474 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.freight_vehicle_types_scd" 2022-07-30 02:59:35 normalization > 02:58:07.266531 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:07.266737 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.freight_vehicle_types_scd 2022-07-30 02:59:35 normalization > 02:58:07.271301 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:07.299763 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:07.300885 [info ] [Thread-6 ]: 85 of 201 OK created incremental model airbyte_cdc.heya_campaign_memberships_scd........................................ [CREATE TABLE (14.0 rows, 7.3 KB processed) in 5.93s] 2022-07-30 02:59:35 normalization > 02:58:07.305276 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.heya_campaign_memberships_scd 2022-07-30 02:59:35 normalization > 02:58:07.306301 [debug] [Thread-6 ]: Began running node model.airbyte_utils.location_store_products_scd 2022-07-30 02:59:35 normalization > 02:58:07.307077 [info ] [Thread-6 ]: 94 of 201 START incremental model airbyte_cdc.location_store_products_scd............................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:07.308662 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.location_store_products_scd" 2022-07-30 02:59:35 normalization > 02:58:07.308949 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.location_store_products_scd 2022-07-30 02:59:35 normalization > 02:58:07.311502 [debug] [Thread-6 ]: Compiling model.airbyte_utils.location_store_products_scd 2022-07-30 02:59:35 normalization > 02:58:07.335079 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.location_store_products_scd" 2022-07-30 02:59:35 normalization > 02:58:07.336118 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:07.336466 [debug] [Thread-6 ]: Began executing node model.airbyte_utils.location_store_products_scd 2022-07-30 02:59:35 normalization > 02:58:07.342981 [debug] [Thread-6 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:07.440189 [debug] [Thread-7 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/freight_vehicle_types_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.freight_vehicle_types_scd 2022-07-30 02:59:35 normalization > 02:58:07.441600 [info ] [Thread-7 ]: 02:58:07 + `dwcasa`.airbyte_cdc.`freight_vehicle_types_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:07.446463 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.freight_vehicle_types_scd" 2022-07-30 02:59:35 normalization > 02:58:07.447018 [debug] [Thread-7 ]: On model.airbyte_utils.freight_vehicle_types_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_vehicle_types_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`freight_vehicle_types_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('freight_vehicle_types_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`freight_vehicle_types_stg` 2022-07-30 02:59:35 normalization > -- freight_vehicle_types from `dwcasa`.airbyte_cdc._airbyte_raw_freight_vehicle_types 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > max_width, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > max_height, 2022-07-30 02:59:35 normalization > max_lenght, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > description, 2022-07-30 02:59:35 normalization > capacity_in_kg, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_freight_vehicle_types_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > max_width, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > max_height, 2022-07-30 02:59:35 normalization > max_lenght, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > description, 2022-07-30 02:59:35 normalization > capacity_in_kg, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_freight_vehicle_types_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:07.510892 [debug] [Thread-6 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/location_store_products_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.location_store_products_scd 2022-07-30 02:59:35 normalization > 02:58:07.512198 [info ] [Thread-6 ]: 02:58:07 + `dwcasa`.airbyte_cdc.`location_store_products_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:07.517059 [debug] [Thread-6 ]: Writing runtime SQL for node "model.airbyte_utils.location_store_products_scd" 2022-07-30 02:59:35 normalization > 02:58:07.517797 [debug] [Thread-6 ]: On model.airbyte_utils.location_store_products_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.location_store_products_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`location_store_products_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('location_store_products_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`location_store_products_stg` 2022-07-30 02:59:35 normalization > -- location_store_products from `dwcasa`.airbyte_cdc._airbyte_raw_location_store_products 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > pipefy_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > product_id, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > store_location_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > pipefy_product_store_id, 2022-07-30 02:59:35 normalization > pipefy_store_location_id, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_location_store_products_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > pipefy_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > product_id, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > store_location_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > pipefy_product_store_id, 2022-07-30 02:59:35 normalization > pipefy_store_location_id, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_location_store_products_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:07.685046 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:07.685994 [info ] [Thread-3 ]: 86 of 201 OK created incremental model airbyte_cdc.freight_route_partner_costs_scd...................................... [CREATE TABLE (73.0 rows, 35.6 KB processed) in 6.18s] 2022-07-30 02:59:35 normalization > 02:58:07.686716 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.freight_route_partner_costs_scd 2022-07-30 02:59:35 normalization > 02:58:07.687517 [debug] [Thread-3 ]: Began running node model.airbyte_utils.freights_scd 2022-07-30 02:59:35 normalization > 02:58:07.688333 [info ] [Thread-3 ]: 95 of 201 START incremental model airbyte_cdc.freights_scd.............................................................. [RUN] 2022-07-30 02:59:35 normalization > 02:58:07.689466 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.freights_scd" 2022-07-30 02:59:35 normalization > 02:58:07.689642 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.freights_scd 2022-07-30 02:59:35 normalization > 02:58:07.689778 [debug] [Thread-3 ]: Compiling model.airbyte_utils.freights_scd 2022-07-30 02:59:35 normalization > 02:58:07.734321 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.freights_scd" 2022-07-30 02:59:35 normalization > 02:58:07.734772 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:07.736113 [debug] [Thread-3 ]: Began executing node model.airbyte_utils.freights_scd 2022-07-30 02:59:35 normalization > 02:58:07.740921 [debug] [Thread-3 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:07.895737 [debug] [Thread-3 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/freights_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.freights_scd 2022-07-30 02:59:35 normalization > 02:58:07.897168 [info ] [Thread-3 ]: 02:58:07 + `dwcasa`.airbyte_cdc.`freights_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:07.902573 [debug] [Thread-3 ]: Writing runtime SQL for node "model.airbyte_utils.freights_scd" 2022-07-30 02:59:35 normalization > 02:58:07.903066 [debug] [Thread-3 ]: On model.airbyte_utils.freights_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freights_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`freights_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('freights_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`freights_stg` 2022-07-30 02:59:35 normalization > -- freights from `dwcasa`.airbyte_cdc._airbyte_raw_freights 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > distance, 2022-07-30 02:59:35 normalization > order_id, 2022-07-30 02:59:35 normalization > delivered, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > notified_at, 2022-07-30 02:59:35 normalization > received_by, 2022-07-30 02:59:35 normalization > picked_up_at, 2022-07-30 02:59:35 normalization > freight_weight, 2022-07-30 02:59:35 normalization > store_quote_id, 2022-07-30 02:59:35 normalization > reverse_freight, 2022-07-30 02:59:35 normalization > buyer_location_id, 2022-07-30 02:59:35 normalization > store_location_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > client_delivery_notes, 2022-07-30 02:59:35 normalization > internal_delivery_notes, 2022-07-30 02:59:35 normalization > actual_delivery_datetime, 2022-07-30 02:59:35 normalization > target_delivery_datetime, 2022-07-30 02:59:35 normalization > freight_actual_pickup_time, 2022-07-30 02:59:35 normalization > freight_scheduled_pickup_time, 2022-07-30 02:59:35 normalization > arrived_at_pick_up_location_at, 2022-07-30 02:59:35 normalization > arrived_at_drop_off_location_at, 2022-07-30 02:59:35 normalization > estimated_arrival_delivery_datetime, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_freights_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > distance, 2022-07-30 02:59:35 normalization > order_id, 2022-07-30 02:59:35 normalization > delivered, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > notified_at, 2022-07-30 02:59:35 normalization > received_by, 2022-07-30 02:59:35 normalization > picked_up_at, 2022-07-30 02:59:35 normalization > freight_weight, 2022-07-30 02:59:35 normalization > store_quote_id, 2022-07-30 02:59:35 normalization > reverse_freight, 2022-07-30 02:59:35 normalization > buyer_location_id, 2022-07-30 02:59:35 normalization > store_location_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > client_delivery_notes, 2022-07-30 02:59:35 normalization > internal_delivery_notes, 2022-07-30 02:59:35 normalization > actual_delivery_datetime, 2022-07-30 02:59:35 normalization > target_delivery_datetime, 2022-07-30 02:59:35 normalization > freight_actual_pickup_time, 2022-07-30 02:59:35 normalization > freight_scheduled_pickup_time, 2022-07-30 02:59:35 normalization > arrived_at_pick_up_location_at, 2022-07-30 02:59:35 normalization > arrived_at_drop_off_location_at, 2022-07-30 02:59:35 normalization > estimated_arrival_delivery_datetime, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_freights_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:08.269119 [debug] [Thread-8 ]: On model.airbyte_utils.freight_product_orders_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_product_orders_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.freight_product_orders_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:08.372898 [debug] [Thread-1 ]: On model.airbyte_utils.freight_route_groupings_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_route_groupings_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`freight_route_groupings_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:08.840574 [debug] [Thread-5 ]: On model.airbyte_utils.buyer_users_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_users_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`buyer_users_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:08.924124 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:08.925184 [info ] [Thread-8 ]: 88 of 201 OK created incremental model airbyte_cdc.freight_product_orders_scd........................................... [CREATE TABLE (35.0k rows, 11.8 MB processed) in 7.22s] 2022-07-30 02:59:35 normalization > 02:58:08.925708 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.freight_product_orders_scd 2022-07-30 02:59:35 normalization > 02:58:08.925965 [debug] [Thread-8 ]: Began running node model.airbyte_utils.oico_radars_scd 2022-07-30 02:59:35 normalization > 02:58:08.926318 [info ] [Thread-8 ]: 96 of 201 START incremental model airbyte_cdc.oico_radars_scd........................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:08.928116 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.oico_radars_scd" 2022-07-30 02:59:35 normalization > 02:58:08.928294 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.oico_radars_scd 2022-07-30 02:59:35 normalization > 02:58:08.928521 [debug] [Thread-8 ]: Compiling model.airbyte_utils.oico_radars_scd 2022-07-30 02:59:35 normalization > 02:58:08.950495 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.oico_radars_scd" 2022-07-30 02:59:35 normalization > 02:58:08.950944 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:08.951107 [debug] [Thread-8 ]: Began executing node model.airbyte_utils.oico_radars_scd 2022-07-30 02:59:35 normalization > 02:58:08.954719 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:09.121095 [debug] [Thread-8 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/oico_radars_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.oico_radars_scd 2022-07-30 02:59:35 normalization > 02:58:09.122499 [info ] [Thread-8 ]: 02:58:09 + `dwcasa`.airbyte_cdc.`oico_radars_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:09.126878 [debug] [Thread-8 ]: Writing runtime SQL for node "model.airbyte_utils.oico_radars_scd" 2022-07-30 02:59:35 normalization > 02:58:09.138107 [debug] [Thread-8 ]: On model.airbyte_utils.oico_radars_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.oico_radars_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`oico_radars_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('oico_radars_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`oico_radars_stg` 2022-07-30 02:59:35 normalization > -- oico_radars from `dwcasa`.airbyte_cdc._airbyte_raw_oico_radars 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > email, 2022-07-30 02:59:35 normalization > document, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > notify_terms, 2022-07-30 02:59:35 normalization > phone_number, 2022-07-30 02:59:35 normalization > buyer_user_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > shareable_link_hash, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_oico_radars_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > email, 2022-07-30 02:59:35 normalization > document, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > notify_terms, 2022-07-30 02:59:35 normalization > phone_number, 2022-07-30 02:59:35 normalization > buyer_user_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > shareable_link_hash, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_oico_radars_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:09.925090 [debug] [Thread-7 ]: On model.airbyte_utils.freight_vehicle_types_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_vehicle_types_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`freight_vehicle_types_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:10.090926 [debug] [Thread-6 ]: On model.airbyte_utils.location_store_products_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.location_store_products_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`location_store_products_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:10.659359 [debug] [Thread-1 ]: On model.airbyte_utils.freight_route_groupings_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_route_groupings_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.freight_route_groupings_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:11.290968 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:11.291886 [info ] [Thread-1 ]: 90 of 201 OK created incremental model airbyte_cdc.freight_route_groupings_scd.......................................... [CREATE TABLE (24.0k rows, 15.3 MB processed) in 7.77s] 2022-07-30 02:59:35 normalization > 02:58:11.293108 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.freight_route_groupings_scd 2022-07-30 02:59:35 normalization > 02:58:11.293335 [debug] [Thread-1 ]: Began running node model.airbyte_utils.memento_states_scd 2022-07-30 02:59:35 normalization > 02:58:11.294136 [info ] [Thread-1 ]: 97 of 201 START incremental model airbyte_cdc.memento_states_scd........................................................ [RUN] 2022-07-30 02:59:35 normalization > 02:58:11.295738 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.memento_states_scd" 2022-07-30 02:59:35 normalization > 02:58:11.295890 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.memento_states_scd 2022-07-30 02:59:35 normalization > 02:58:11.296011 [debug] [Thread-1 ]: Compiling model.airbyte_utils.memento_states_scd 2022-07-30 02:59:35 normalization > 02:58:11.317851 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.memento_states_scd" 2022-07-30 02:59:35 normalization > 02:58:11.318308 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:11.318498 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.memento_states_scd 2022-07-30 02:59:35 normalization > 02:58:11.323361 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:11.533609 [debug] [Thread-1 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/memento_states_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.memento_states_scd 2022-07-30 02:59:35 normalization > 02:58:11.534947 [info ] [Thread-1 ]: 02:58:11 + `dwcasa`.airbyte_cdc.`memento_states_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:11.540636 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.memento_states_scd" 2022-07-30 02:59:35 normalization > 02:58:11.541053 [debug] [Thread-1 ]: On model.airbyte_utils.memento_states_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.memento_states_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`memento_states_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('memento_states_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`memento_states_stg` 2022-07-30 02:59:35 normalization > -- memento_states from `dwcasa`.airbyte_cdc._airbyte_raw_memento_states 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > record_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > session_id, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > action_type, 2022-07-30 02:59:35 normalization > record_data, 2022-07-30 02:59:35 normalization > record_type, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_memento_states_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > record_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > session_id, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > action_type, 2022-07-30 02:59:35 normalization > record_data, 2022-07-30 02:59:35 normalization > record_type, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_memento_states_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:11.611658 [debug] [Thread-8 ]: On model.airbyte_utils.oico_radars_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.oico_radars_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`oico_radars_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:11.773967 [debug] [Thread-5 ]: On model.airbyte_utils.buyer_users_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_users_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.buyer_users_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:11.925966 [debug] [Thread-7 ]: On model.airbyte_utils.freight_vehicle_types_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_vehicle_types_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.freight_vehicle_types_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:12.299021 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:12.300437 [info ] [Thread-7 ]: 93 of 201 OK created incremental model airbyte_cdc.freight_vehicle_types_scd............................................ [CREATE TABLE (22.0 rows, 7.6 KB processed) in 5.06s] 2022-07-30 02:59:35 normalization > 02:58:12.301038 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.freight_vehicle_types_scd 2022-07-30 02:59:35 normalization > 02:58:12.301332 [debug] [Thread-7 ]: Began running node model.airbyte_utils.memento_sessions_scd 2022-07-30 02:59:35 normalization > 02:58:12.301744 [info ] [Thread-7 ]: 98 of 201 START incremental model airbyte_cdc.memento_sessions_scd...................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:12.303426 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.memento_sessions_scd" 2022-07-30 02:59:35 normalization > 02:58:12.303717 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.memento_sessions_scd 2022-07-30 02:59:35 normalization > 02:58:12.303986 [debug] [Thread-7 ]: Compiling model.airbyte_utils.memento_sessions_scd 2022-07-30 02:59:35 normalization > 02:58:12.324561 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.memento_sessions_scd" 2022-07-30 02:59:35 normalization > 02:58:12.325002 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:12.325163 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.memento_sessions_scd 2022-07-30 02:59:35 normalization > 02:58:12.328733 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:12.374769 [debug] [Thread-2 ]: On model.airbyte_utils.freight_routes_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_routes_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`freight_routes_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:12.441155 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:12.443999 [info ] [Thread-5 ]: 91 of 201 OK created incremental model airbyte_cdc.buyer_users_scd...................................................... [CREATE TABLE (1.8k rows, 1.6 MB processed) in 6.71s] 2022-07-30 02:59:35 normalization > 02:58:12.445282 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.buyer_users_scd 2022-07-30 02:59:35 normalization > 02:58:12.445531 [debug] [Thread-5 ]: Began running node model.airbyte_utils.oico_radar_products_scd 2022-07-30 02:59:35 normalization > 02:58:12.446186 [info ] [Thread-5 ]: 99 of 201 START incremental model airbyte_cdc.oico_radar_products_scd................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:12.447527 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.oico_radar_products_scd" 2022-07-30 02:59:35 normalization > 02:58:12.447691 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.oico_radar_products_scd 2022-07-30 02:59:35 normalization > 02:58:12.447814 [debug] [Thread-5 ]: Compiling model.airbyte_utils.oico_radar_products_scd 2022-07-30 02:59:35 normalization > 02:58:12.573835 [debug] [Thread-7 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/memento_sessions_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.memento_sessions_scd 2022-07-30 02:59:35 normalization > 02:58:12.575236 [info ] [Thread-7 ]: 02:58:12 + `dwcasa`.airbyte_cdc.`memento_sessions_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:12.577338 [debug] [Thread-6 ]: On model.airbyte_utils.location_store_products_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.location_store_products_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.location_store_products_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:12.588043 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.memento_sessions_scd" 2022-07-30 02:59:35 normalization > 02:58:12.589995 [debug] [Thread-7 ]: On model.airbyte_utils.memento_sessions_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.memento_sessions_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`memento_sessions_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('memento_sessions_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`memento_sessions_stg` 2022-07-30 02:59:35 normalization > -- memento_sessions from `dwcasa`.airbyte_cdc._airbyte_raw_memento_sessions 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > user_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_memento_sessions_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > user_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_memento_sessions_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:12.705765 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.oico_radar_products_scd" 2022-07-30 02:59:35 normalization > 02:58:12.706225 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:12.706392 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.oico_radar_products_scd 2022-07-30 02:59:35 normalization > 02:58:12.711875 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:12.884921 [debug] [Thread-5 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/oico_radar_products_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.oico_radar_products_scd 2022-07-30 02:59:35 normalization > 02:58:12.886234 [info ] [Thread-5 ]: 02:58:12 + `dwcasa`.airbyte_cdc.`oico_radar_products_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:12.893304 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.oico_radar_products_scd" 2022-07-30 02:59:35 normalization > 02:58:12.894072 [debug] [Thread-5 ]: On model.airbyte_utils.oico_radar_products_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.oico_radar_products_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`oico_radar_products_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('oico_radar_products_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`oico_radar_products_stg` 2022-07-30 02:59:35 normalization > -- oico_radar_products from `dwcasa`.airbyte_cdc._airbyte_raw_oico_radar_products 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > price, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > oico_radar_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > product_canonical_id, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_oico_radar_products_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > price, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > oico_radar_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > product_canonical_id, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_oico_radar_products_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:13.186295 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:13.190954 [info ] [Thread-6 ]: 94 of 201 OK created incremental model airbyte_cdc.location_store_products_scd.......................................... [CREATE TABLE (1.2k rows, 443.3 KB processed) in 5.88s] 2022-07-30 02:59:35 normalization > 02:58:13.191581 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.location_store_products_scd 2022-07-30 02:59:35 normalization > 02:58:13.192093 [debug] [Thread-6 ]: Began running node model.airbyte_utils.order_feedbacks_scd 2022-07-30 02:59:35 normalization > 02:58:13.193007 [info ] [Thread-6 ]: 100 of 201 START incremental model airbyte_cdc.order_feedbacks_scd...................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:13.194812 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.order_feedbacks_scd" 2022-07-30 02:59:35 normalization > 02:58:13.194981 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.order_feedbacks_scd 2022-07-30 02:59:35 normalization > 02:58:13.195102 [debug] [Thread-6 ]: Compiling model.airbyte_utils.order_feedbacks_scd 2022-07-30 02:59:35 normalization > 02:58:13.214189 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.order_feedbacks_scd" 2022-07-30 02:59:35 normalization > 02:58:13.216441 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:13.216710 [debug] [Thread-6 ]: Began executing node model.airbyte_utils.order_feedbacks_scd 2022-07-30 02:59:35 normalization > 02:58:13.224530 [debug] [Thread-6 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:13.437802 [debug] [Thread-6 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/order_feedbacks_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.order_feedbacks_scd 2022-07-30 02:59:35 normalization > 02:58:13.438977 [info ] [Thread-6 ]: 02:58:13 + `dwcasa`.airbyte_cdc.`order_feedbacks_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:13.442830 [debug] [Thread-6 ]: Writing runtime SQL for node "model.airbyte_utils.order_feedbacks_scd" 2022-07-30 02:59:35 normalization > 02:58:13.443500 [debug] [Thread-6 ]: On model.airbyte_utils.order_feedbacks_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.order_feedbacks_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`order_feedbacks_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('order_feedbacks_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`order_feedbacks_stg` 2022-07-30 02:59:35 normalization > -- order_feedbacks from `dwcasa`.airbyte_cdc._airbyte_raw_order_feedbacks 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > type, 2022-07-30 02:59:35 normalization > liked, 2022-07-30 02:59:35 normalization > order_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_order_feedbacks_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > type, 2022-07-30 02:59:35 normalization > liked, 2022-07-30 02:59:35 normalization > order_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_order_feedbacks_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:13.678676 [debug] [Thread-8 ]: On model.airbyte_utils.oico_radars_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.oico_radars_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.oico_radars_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:14.260888 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:14.261830 [info ] [Thread-8 ]: 96 of 201 OK created incremental model airbyte_cdc.oico_radars_scd...................................................... [CREATE TABLE (3.0 rows, 1.3 KB processed) in 5.33s] 2022-07-30 02:59:35 normalization > 02:58:14.263128 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.oico_radars_scd 2022-07-30 02:59:35 normalization > 02:58:14.263383 [debug] [Thread-8 ]: Began running node model.airbyte_utils.orders_scd 2022-07-30 02:59:35 normalization > 02:58:14.264043 [info ] [Thread-8 ]: 101 of 201 START incremental model airbyte_cdc.orders_scd............................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:14.265536 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.orders_scd" 2022-07-30 02:59:35 normalization > 02:58:14.265769 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.orders_scd 2022-07-30 02:59:35 normalization > 02:58:14.265903 [debug] [Thread-8 ]: Compiling model.airbyte_utils.orders_scd 2022-07-30 02:59:35 normalization > 02:58:14.287890 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.orders_scd" 2022-07-30 02:59:35 normalization > 02:58:14.296162 [debug] [Thread-3 ]: On model.airbyte_utils.freights_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freights_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`freights_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:14.298822 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:14.299644 [debug] [Thread-8 ]: Began executing node model.airbyte_utils.orders_scd 2022-07-30 02:59:35 normalization > 02:58:14.302996 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:14.431682 [debug] [Thread-8 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/orders_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.orders_scd 2022-07-30 02:59:35 normalization > 02:58:14.432845 [info ] [Thread-8 ]: 02:58:14 + `dwcasa`.airbyte_cdc.`orders_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:14.437726 [debug] [Thread-8 ]: Writing runtime SQL for node "model.airbyte_utils.orders_scd" 2022-07-30 02:59:35 normalization > 02:58:14.438166 [debug] [Thread-8 ]: On model.airbyte_utils.orders_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.orders_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`orders_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('orders_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`orders_stg` 2022-07-30 02:59:35 normalization > -- orders from `dwcasa`.airbyte_cdc._airbyte_raw_orders 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > type, 2022-07-30 02:59:35 normalization > quote, 2022-07-30 02:59:35 normalization > value, 2022-07-30 02:59:35 normalization > events, 2022-07-30 02:59:35 normalization > origin, 2022-07-30 02:59:35 normalization > status, 2022-07-30 02:59:35 normalization > comment, 2022-07-30 02:59:35 normalization > buyer_id, 2022-07-30 02:59:35 normalization > discount, 2022-07-30 02:59:35 normalization > identify, 2022-07-30 02:59:35 normalization > payer_id, 2022-07-30 02:59:35 normalization > po_value, 2022-07-30 02:59:35 normalization > pipefy_id, 2022-07-30 02:59:35 normalization > conta_azul, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > last_quote, 2022-07-30 02:59:35 normalization > order_form, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > approved_at, 2022-07-30 02:59:35 normalization > canceled_at, 2022-07-30 02:59:35 normalization > final_value, 2022-07-30 02:59:35 normalization > po_file_url, 2022-07-30 02:59:35 normalization > client_notes, 2022-07-30 02:59:35 normalization > freight_code, 2022-07-30 02:59:35 normalization > freight_link, 2022-07-30 02:59:35 normalization > money_saving, 2022-07-30 02:59:35 normalization > oico_invoice, 2022-07-30 02:59:35 normalization > buyer_user_id, 2022-07-30 02:59:35 normalization > expected_date, 2022-07-30 02:59:35 normalization > expected_time, 2022-07-30 02:59:35 normalization > fast_delivery, 2022-07-30 02:59:35 normalization > freight_value, 2022-07-30 02:59:35 normalization > internal_notes, 2022-07-30 02:59:35 normalization > payment_method, 2022-07-30 02:59:35 normalization > quote_estimate, 2022-07-30 02:59:35 normalization > automatic_quote, 2022-07-30 02:59:35 normalization > expected_period, 2022-07-30 02:59:35 normalization > financing_value, 2022-07-30 02:59:35 normalization > parent_order_id, 2022-07-30 02:59:35 normalization > user_preference, 2022-07-30 02:59:35 normalization > quote_expires_at, 2022-07-30 02:59:35 normalization > buyer_location_id, 2022-07-30 02:59:35 normalization > client_order_form, 2022-07-30 02:59:35 normalization > flexible_delivery, 2022-07-30 02:59:35 normalization > shopping_list_url, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cancelation_reason, 2022-07-30 02:59:35 normalization > client_internal_id, 2022-07-30 02:59:35 normalization > more_payment_terms, 2022-07-30 02:59:35 normalization > cancelation_comment, 2022-07-30 02:59:35 normalization > first_quote_sent_at, 2022-07-30 02:59:35 normalization > shareable_link_hash, 2022-07-30 02:59:35 normalization > internal_delivery_notes, 2022-07-30 02:59:35 normalization > expected_billing_due_date, 2022-07-30 02:59:35 normalization > last_rdo_scheduling_message_sent_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_orders_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > type, 2022-07-30 02:59:35 normalization > quote, 2022-07-30 02:59:35 normalization > value, 2022-07-30 02:59:35 normalization > events, 2022-07-30 02:59:35 normalization > origin, 2022-07-30 02:59:35 normalization > status, 2022-07-30 02:59:35 normalization > comment, 2022-07-30 02:59:35 normalization > buyer_id, 2022-07-30 02:59:35 normalization > discount, 2022-07-30 02:59:35 normalization > identify, 2022-07-30 02:59:35 normalization > payer_id, 2022-07-30 02:59:35 normalization > po_value, 2022-07-30 02:59:35 normalization > pipefy_id, 2022-07-30 02:59:35 normalization > conta_azul, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > last_quote, 2022-07-30 02:59:35 normalization > order_form, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > approved_at, 2022-07-30 02:59:35 normalization > canceled_at, 2022-07-30 02:59:35 normalization > final_value, 2022-07-30 02:59:35 normalization > po_file_url, 2022-07-30 02:59:35 normalization > client_notes, 2022-07-30 02:59:35 normalization > freight_code, 2022-07-30 02:59:35 normalization > freight_link, 2022-07-30 02:59:35 normalization > money_saving, 2022-07-30 02:59:35 normalization > oico_invoice, 2022-07-30 02:59:35 normalization > buyer_user_id, 2022-07-30 02:59:35 normalization > expected_date, 2022-07-30 02:59:35 normalization > expected_time, 2022-07-30 02:59:35 normalization > fast_delivery, 2022-07-30 02:59:35 normalization > freight_value, 2022-07-30 02:59:35 normalization > internal_notes, 2022-07-30 02:59:35 normalization > payment_method, 2022-07-30 02:59:35 normalization > quote_estimate, 2022-07-30 02:59:35 normalization > automatic_quote, 2022-07-30 02:59:35 normalization > expected_period, 2022-07-30 02:59:35 normalization > financing_value, 2022-07-30 02:59:35 normalization > parent_order_id, 2022-07-30 02:59:35 normalization > user_preference, 2022-07-30 02:59:35 normalization > quote_expires_at, 2022-07-30 02:59:35 normalization > buyer_location_id, 2022-07-30 02:59:35 normalization > client_order_form, 2022-07-30 02:59:35 normalization > flexible_delivery, 2022-07-30 02:59:35 normalization > shopping_list_url, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > cancelation_reason, 2022-07-30 02:59:35 normalization > client_internal_id, 2022-07-30 02:59:35 normalization > more_payment_terms, 2022-07-30 02:59:35 normalization > cancelation_comment, 2022-07-30 02:59:35 normalization > first_quote_sent_at, 2022-07-30 02:59:35 normalization > shareable_link_hash, 2022-07-30 02:59:35 normalization > internal_delivery_notes, 2022-07-30 02:59:35 normalization > expected_billing_due_date, 2022-07-30 02:59:35 normalization > last_rdo_scheduling_message_sent_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_orders_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:14.901565 [debug] [Thread-1 ]: On model.airbyte_utils.memento_states_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.memento_states_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`memento_states_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:14.966866 [debug] [Thread-2 ]: On model.airbyte_utils.freight_routes_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_routes_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.freight_routes_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:15.421997 [debug] [Thread-5 ]: On model.airbyte_utils.oico_radar_products_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.oico_radar_products_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`oico_radar_products_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:15.430688 [debug] [Thread-8 ]: BigQuery adapter: Retry attempt 1 of 3 after error: BadRequest("Invalid date: '2021-05-14T00:00:00Z'") 2022-07-30 02:59:35 normalization > 02:58:15.616011 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:15.617133 [info ] [Thread-2 ]: 92 of 201 OK created incremental model airbyte_cdc.freight_routes_scd................................................... [CREATE TABLE (9.6k rows, 15.0 MB processed) in 9.08s] 2022-07-30 02:59:35 normalization > 02:58:15.617694 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.freight_routes_scd 2022-07-30 02:59:35 normalization > 02:58:15.618527 [debug] [Thread-2 ]: Began running node model.airbyte_utils.payer_buyer_locations_scd 2022-07-30 02:59:35 normalization > 02:58:15.620089 [info ] [Thread-2 ]: 102 of 201 START incremental model airbyte_cdc.payer_buyer_locations_scd................................................ [RUN] 2022-07-30 02:59:35 normalization > 02:58:15.622806 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.payer_buyer_locations_scd" 2022-07-30 02:59:35 normalization > 02:58:15.623075 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.payer_buyer_locations_scd 2022-07-30 02:59:35 normalization > 02:58:15.623231 [debug] [Thread-2 ]: Compiling model.airbyte_utils.payer_buyer_locations_scd 2022-07-30 02:59:35 normalization > 02:58:15.662299 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.payer_buyer_locations_scd" 2022-07-30 02:59:35 normalization > 02:58:15.665984 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:15.666233 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.payer_buyer_locations_scd 2022-07-30 02:59:35 normalization > 02:58:15.674177 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:15.858248 [debug] [Thread-2 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/payer_buyer_locations_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.payer_buyer_locations_scd 2022-07-30 02:59:35 normalization > 02:58:15.859744 [info ] [Thread-2 ]: 02:58:15 + `dwcasa`.airbyte_cdc.`payer_buyer_locations_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:15.867525 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.payer_buyer_locations_scd" 2022-07-30 02:59:35 normalization > 02:58:15.868084 [debug] [Thread-2 ]: On model.airbyte_utils.payer_buyer_locations_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.payer_buyer_locations_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`payer_buyer_locations_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('payer_buyer_locations_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`payer_buyer_locations_stg` 2022-07-30 02:59:35 normalization > -- payer_buyer_locations from `dwcasa`.airbyte_cdc._airbyte_raw_payer_buyer_locations 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > buyer_id, 2022-07-30 02:59:35 normalization > payer_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > buyer_location_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_payer_buyer_locations_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > buyer_id, 2022-07-30 02:59:35 normalization > payer_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > buyer_location_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_payer_buyer_locations_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:15.940010 [debug] [Thread-6 ]: On model.airbyte_utils.order_feedbacks_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.order_feedbacks_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`order_feedbacks_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:16.320252 [debug] [Thread-7 ]: On model.airbyte_utils.memento_sessions_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.memento_sessions_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`memento_sessions_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:16.615598 [debug] [Thread-3 ]: On model.airbyte_utils.freights_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freights_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.freights_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:17.186059 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:17.187013 [info ] [Thread-3 ]: 95 of 201 OK created incremental model airbyte_cdc.freights_scd......................................................... [CREATE TABLE (25.2k rows, 22.1 MB processed) in 9.50s] 2022-07-30 02:59:35 normalization > 02:58:17.188876 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.freights_scd 2022-07-30 02:59:35 normalization > 02:58:17.196361 [debug] [Thread-3 ]: Began running node model.airbyte_utils.heya_campaign_receipts_scd 2022-07-30 02:59:35 normalization > 02:58:17.197278 [info ] [Thread-3 ]: 103 of 201 START incremental model airbyte_cdc.heya_campaign_receipts_scd............................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:17.198382 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.heya_campaign_receipts_scd" 2022-07-30 02:59:35 normalization > 02:58:17.198584 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.heya_campaign_receipts_scd 2022-07-30 02:59:35 normalization > 02:58:17.198720 [debug] [Thread-3 ]: Compiling model.airbyte_utils.heya_campaign_receipts_scd 2022-07-30 02:59:35 normalization > 02:58:17.229935 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.heya_campaign_receipts_scd" 2022-07-30 02:59:35 normalization > 02:58:17.231965 [debug] [Thread-1 ]: On model.airbyte_utils.memento_states_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.memento_states_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.memento_states_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:17.235779 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:17.238766 [debug] [Thread-3 ]: Began executing node model.airbyte_utils.heya_campaign_receipts_scd 2022-07-30 02:59:35 normalization > 02:58:17.242908 [debug] [Thread-3 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:17.297087 [debug] [Thread-8 ]: BigQuery adapter: Retry attempt 2 of 3 after error: BadRequest("Invalid date: '2021-05-14T00:00:00Z'") 2022-07-30 02:59:35 normalization > 02:58:17.422715 [debug] [Thread-3 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/heya_campaign_receipts_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.heya_campaign_receipts_scd 2022-07-30 02:59:35 normalization > 02:58:17.424130 [info ] [Thread-3 ]: 02:58:17 + `dwcasa`.airbyte_cdc.`heya_campaign_receipts_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:17.429230 [debug] [Thread-3 ]: Writing runtime SQL for node "model.airbyte_utils.heya_campaign_receipts_scd" 2022-07-30 02:59:35 normalization > 02:58:17.429702 [debug] [Thread-3 ]: On model.airbyte_utils.heya_campaign_receipts_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.heya_campaign_receipts_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`heya_campaign_receipts_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('heya_campaign_receipts_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`heya_campaign_receipts_stg` 2022-07-30 02:59:35 normalization > -- heya_campaign_receipts from `dwcasa`.airbyte_cdc._airbyte_raw_heya_campaign_receipts 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > sent_at, 2022-07-30 02:59:35 normalization > user_id, 2022-07-30 02:59:35 normalization > step_gid, 2022-07-30 02:59:35 normalization > user_type, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_heya_campaign_receipts_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > sent_at, 2022-07-30 02:59:35 normalization > user_id, 2022-07-30 02:59:35 normalization > step_gid, 2022-07-30 02:59:35 normalization > user_type, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_heya_campaign_receipts_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:17.459731 [debug] [Thread-5 ]: On model.airbyte_utils.oico_radar_products_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.oico_radar_products_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.oico_radar_products_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:17.901379 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:17.902683 [info ] [Thread-1 ]: 97 of 201 OK created incremental model airbyte_cdc.memento_states_scd................................................... [CREATE TABLE (9.2k rows, 5.3 MB processed) in 6.61s] 2022-07-30 02:59:35 normalization > 02:58:17.903173 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.memento_states_scd 2022-07-30 02:59:35 normalization > 02:58:17.903480 [debug] [Thread-1 ]: Began running node model.airbyte_utils.order_issues_scd 2022-07-30 02:59:35 normalization > 02:58:17.903821 [info ] [Thread-1 ]: 104 of 201 START incremental model airbyte_cdc.order_issues_scd......................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:17.905386 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.order_issues_scd" 2022-07-30 02:59:35 normalization > 02:58:17.905553 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.order_issues_scd 2022-07-30 02:59:35 normalization > 02:58:17.905751 [debug] [Thread-1 ]: Compiling model.airbyte_utils.order_issues_scd 2022-07-30 02:59:35 normalization > 02:58:17.925710 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.order_issues_scd" 2022-07-30 02:59:35 normalization > 02:58:17.926305 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:17.926495 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.order_issues_scd 2022-07-30 02:59:35 normalization > 02:58:17.932088 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:18.058254 [debug] [Thread-1 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/order_issues_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.order_issues_scd 2022-07-30 02:59:35 normalization > 02:58:18.059551 [info ] [Thread-1 ]: 02:58:18 + `dwcasa`.airbyte_cdc.`order_issues_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:18.063582 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.order_issues_scd" 2022-07-30 02:59:35 normalization > 02:58:18.064172 [debug] [Thread-1 ]: On model.airbyte_utils.order_issues_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.order_issues_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`order_issues_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('order_issues_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`order_issues_stg` 2022-07-30 02:59:35 normalization > -- order_issues from `dwcasa`.airbyte_cdc._airbyte_raw_order_issues 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > type, 2022-07-30 02:59:35 normalization > status, 2022-07-30 02:59:35 normalization > order_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > canceled_at, 2022-07-30 02:59:35 normalization > description, 2022-07-30 02:59:35 normalization > confirmed_at, 2022-07-30 02:59:35 normalization > buyer_user_id, 2022-07-30 02:59:35 normalization > product_problems, 2022-07-30 02:59:35 normalization > delivery_problems, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_order_issues_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > type, 2022-07-30 02:59:35 normalization > status, 2022-07-30 02:59:35 normalization > order_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > canceled_at, 2022-07-30 02:59:35 normalization > description, 2022-07-30 02:59:35 normalization > confirmed_at, 2022-07-30 02:59:35 normalization > buyer_user_id, 2022-07-30 02:59:35 normalization > product_problems, 2022-07-30 02:59:35 normalization > delivery_problems, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_order_issues_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:18.097904 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:18.098827 [info ] [Thread-5 ]: 99 of 201 OK created incremental model airbyte_cdc.oico_radar_products_scd.............................................. [CREATE TABLE (7.0 rows, 2.1 KB processed) in 5.65s] 2022-07-30 02:59:35 normalization > 02:58:18.099536 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.oico_radar_products_scd 2022-07-30 02:59:35 normalization > 02:58:18.099822 [debug] [Thread-5 ]: Began running node model.airbyte_utils.oico_users_scd 2022-07-30 02:59:35 normalization > 02:58:18.100183 [info ] [Thread-5 ]: 105 of 201 START incremental model airbyte_cdc.oico_users_scd........................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:18.101716 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.oico_users_scd" 2022-07-30 02:59:35 normalization > 02:58:18.101885 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.oico_users_scd 2022-07-30 02:59:35 normalization > 02:58:18.102019 [debug] [Thread-5 ]: Compiling model.airbyte_utils.oico_users_scd 2022-07-30 02:59:35 normalization > 02:58:18.124271 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.oico_users_scd" 2022-07-30 02:59:35 normalization > 02:58:18.124821 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:18.124986 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.oico_users_scd 2022-07-30 02:59:35 normalization > 02:58:18.128667 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:18.272087 [debug] [Thread-6 ]: On model.airbyte_utils.order_feedbacks_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.order_feedbacks_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.order_feedbacks_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:18.297462 [debug] [Thread-5 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/oico_users_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.oico_users_scd 2022-07-30 02:59:35 normalization > 02:58:18.298666 [info ] [Thread-5 ]: 02:58:18 + `dwcasa`.airbyte_cdc.`oico_users_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:18.306086 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.oico_users_scd" 2022-07-30 02:59:35 normalization > 02:58:18.306951 [debug] [Thread-5 ]: On model.airbyte_utils.oico_users_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.oico_users_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`oico_users_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('oico_users_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`oico_users_stg` 2022-07-30 02:59:35 normalization > -- oico_users from `dwcasa`.airbyte_cdc._airbyte_raw_oico_users 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > email, 2022-07-30 02:59:35 normalization > active, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > encrypted_password, 2022-07-30 02:59:35 normalization > remember_created_at, 2022-07-30 02:59:35 normalization > reset_password_token, 2022-07-30 02:59:35 normalization > reset_password_sent_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_oico_users_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > email, 2022-07-30 02:59:35 normalization > active, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > encrypted_password, 2022-07-30 02:59:35 normalization > remember_created_at, 2022-07-30 02:59:35 normalization > reset_password_token, 2022-07-30 02:59:35 normalization > reset_password_sent_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_oico_users_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:18.592679 [debug] [Thread-7 ]: On model.airbyte_utils.memento_sessions_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.memento_sessions_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.memento_sessions_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:18.879634 [debug] [Thread-2 ]: On model.airbyte_utils.payer_buyer_locations_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.payer_buyer_locations_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`payer_buyer_locations_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:18.909522 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:18.910467 [info ] [Thread-6 ]: 100 of 201 OK created incremental model airbyte_cdc.order_feedbacks_scd................................................. [CREATE TABLE (324.0 rows, 89.8 KB processed) in 5.72s] 2022-07-30 02:59:35 normalization > 02:58:18.911749 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.order_feedbacks_scd 2022-07-30 02:59:35 normalization > 02:58:18.912175 [debug] [Thread-6 ]: Began running node model.airbyte_utils.omie_accounts_scd 2022-07-30 02:59:35 normalization > 02:58:18.912917 [info ] [Thread-6 ]: 106 of 201 START incremental model airbyte_cdc.omie_accounts_scd........................................................ [RUN] 2022-07-30 02:59:35 normalization > 02:58:18.913867 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.omie_accounts_scd" 2022-07-30 02:59:35 normalization > 02:58:18.914038 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.omie_accounts_scd 2022-07-30 02:59:35 normalization > 02:58:18.914264 [debug] [Thread-6 ]: Compiling model.airbyte_utils.omie_accounts_scd 2022-07-30 02:59:35 normalization > 02:58:18.932657 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.omie_accounts_scd" 2022-07-30 02:59:35 normalization > 02:58:18.933122 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:18.933280 [debug] [Thread-6 ]: Began executing node model.airbyte_utils.omie_accounts_scd 2022-07-30 02:59:35 normalization > 02:58:18.939105 [debug] [Thread-6 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:19.139728 [debug] [Thread-6 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/omie_accounts_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.omie_accounts_scd 2022-07-30 02:59:35 normalization > 02:58:19.140885 [info ] [Thread-6 ]: 02:58:19 + `dwcasa`.airbyte_cdc.`omie_accounts_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:19.146578 [debug] [Thread-6 ]: Writing runtime SQL for node "model.airbyte_utils.omie_accounts_scd" 2022-07-30 02:59:35 normalization > 02:58:19.147134 [debug] [Thread-6 ]: On model.airbyte_utils.omie_accounts_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.omie_accounts_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`omie_accounts_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('omie_accounts_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`omie_accounts_stg` 2022-07-30 02:59:35 normalization > -- omie_accounts from `dwcasa`.airbyte_cdc._airbyte_raw_omie_accounts 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > document, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > credential, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by id 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by id 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_omie_accounts_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > document, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > credential, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_omie_accounts_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:19.182907 [debug] [Thread-8 ]: BigQuery adapter: Retry attempt 3 of 3 after error: BadRequest("Invalid date: '2021-05-14T00:00:00Z'") 2022-07-30 02:59:35 normalization > 02:58:19.203713 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:19.204748 [info ] [Thread-7 ]: 98 of 201 OK created incremental model airbyte_cdc.memento_sessions_scd................................................. [CREATE TABLE (3.4k rows, 857.1 KB processed) in 6.90s] 2022-07-30 02:59:35 normalization > 02:58:19.206026 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.memento_sessions_scd 2022-07-30 02:59:35 normalization > 02:58:19.206419 [debug] [Thread-7 ]: Began running node model.airbyte_utils.payers_scd 2022-07-30 02:59:35 normalization > 02:58:19.206942 [info ] [Thread-7 ]: 107 of 201 START incremental model airbyte_cdc.payers_scd............................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:19.208187 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.payers_scd" 2022-07-30 02:59:35 normalization > 02:58:19.208376 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.payers_scd 2022-07-30 02:59:35 normalization > 02:58:19.208513 [debug] [Thread-7 ]: Compiling model.airbyte_utils.payers_scd 2022-07-30 02:59:35 normalization > 02:58:19.228927 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.payers_scd" 2022-07-30 02:59:35 normalization > 02:58:19.229383 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:19.229537 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.payers_scd 2022-07-30 02:59:35 normalization > 02:58:19.232779 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:19.392806 [debug] [Thread-7 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/payers_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.payers_scd 2022-07-30 02:59:35 normalization > 02:58:19.394076 [info ] [Thread-7 ]: 02:58:19 + `dwcasa`.airbyte_cdc.`payers_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:19.405108 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.payers_scd" 2022-07-30 02:59:35 normalization > 02:58:19.405829 [debug] [Thread-7 ]: On model.airbyte_utils.payers_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.payers_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`payers_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('payers_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`payers_stg` 2022-07-30 02:59:35 normalization > -- payers from `dwcasa`.airbyte_cdc._airbyte_raw_payers 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > cpf, 2022-07-30 02:59:35 normalization > cnae, 2022-07-30 02:59:35 normalization > cnpj, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > email, 2022-07-30 02:59:35 normalization > omie_id, 2022-07-30 02:59:35 normalization > activity, 2022-07-30 02:59:35 normalization > bank_code, 2022-07-30 02:59:35 normalization > conta_azul, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > bank_branch, 2022-07-30 02:59:35 normalization > bank_account, 2022-07-30 02:59:35 normalization > credit_limit, 2022-07-30 02:59:35 normalization > phone_number, 2022-07-30 02:59:35 normalization > final_consumer, 2022-07-30 02:59:35 normalization > internal_notes, 2022-07-30 02:59:35 normalization > billing_address, 2022-07-30 02:59:35 normalization > national_simple, 2022-07-30 02:59:35 normalization > payer_confirmed, 2022-07-30 02:59:35 normalization > tax_mode_simples, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > payer_confirmed_at, 2022-07-30 02:59:35 normalization > payment_terms_days, 2022-07-30 02:59:35 normalization > state_registration, 2022-07-30 02:59:35 normalization > billing_address_city, 2022-07-30 02:59:35 normalization > billing_address_state, 2022-07-30 02:59:35 normalization > billing_address_street, 2022-07-30 02:59:35 normalization > billing_address_zipcode, 2022-07-30 02:59:35 normalization > bank_account_check_digit, 2022-07-30 02:59:35 normalization > bank_account_holder_name, 2022-07-30 02:59:35 normalization > billing_address_district, 2022-07-30 02:59:35 normalization > bank_account_holder_document, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_payers_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > cpf, 2022-07-30 02:59:35 normalization > cnae, 2022-07-30 02:59:35 normalization > cnpj, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > email, 2022-07-30 02:59:35 normalization > omie_id, 2022-07-30 02:59:35 normalization > activity, 2022-07-30 02:59:35 normalization > bank_code, 2022-07-30 02:59:35 normalization > conta_azul, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > bank_branch, 2022-07-30 02:59:35 normalization > bank_account, 2022-07-30 02:59:35 normalization > credit_limit, 2022-07-30 02:59:35 normalization > phone_number, 2022-07-30 02:59:35 normalization > final_consumer, 2022-07-30 02:59:35 normalization > internal_notes, 2022-07-30 02:59:35 normalization > billing_address, 2022-07-30 02:59:35 normalization > national_simple, 2022-07-30 02:59:35 normalization > payer_confirmed, 2022-07-30 02:59:35 normalization > tax_mode_simples, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > payer_confirmed_at, 2022-07-30 02:59:35 normalization > payment_terms_days, 2022-07-30 02:59:35 normalization > state_registration, 2022-07-30 02:59:35 normalization > billing_address_city, 2022-07-30 02:59:35 normalization > billing_address_state, 2022-07-30 02:59:35 normalization > billing_address_street, 2022-07-30 02:59:35 normalization > billing_address_zipcode, 2022-07-30 02:59:35 normalization > bank_account_check_digit, 2022-07-30 02:59:35 normalization > bank_account_holder_name, 2022-07-30 02:59:35 normalization > billing_address_district, 2022-07-30 02:59:35 normalization > bank_account_holder_document, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_payers_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:21.057721 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:21.058497 [debug] [Thread-8 ]: Database Error in model orders_scd (models/generated/airbyte_incremental/scd/airbyte_cdc/orders_scd.sql) 2022-07-30 02:59:35 normalization > Invalid date: '2021-05-14T00:00:00Z' 2022-07-30 02:59:35 normalization > compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_incremental/scd/airbyte_cdc/orders_scd.sql 2022-07-30 02:59:35 normalization > 02:58:21.058962 [error] [Thread-8 ]: 101 of 201 ERROR creating incremental model airbyte_cdc.orders_scd...................................................... [ERROR in 6.79s] 2022-07-30 02:59:35 normalization > 02:58:21.059876 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.orders_scd 2022-07-30 02:59:35 normalization > 02:58:21.060178 [debug] [Thread-8 ]: Began running node model.airbyte_utils.popular_searches_scd 2022-07-30 02:59:35 normalization > 02:58:21.060851 [info ] [Thread-8 ]: 108 of 201 START incremental model airbyte_cdc.popular_searches_scd..................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:21.063253 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.popular_searches_scd" 2022-07-30 02:59:35 normalization > 02:58:21.063450 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.popular_searches_scd 2022-07-30 02:59:35 normalization > 02:58:21.063801 [debug] [Thread-8 ]: Compiling model.airbyte_utils.popular_searches_scd 2022-07-30 02:59:35 normalization > 02:58:21.093359 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.popular_searches_scd" 2022-07-30 02:59:35 normalization > 02:58:21.118891 [debug] [Thread-5 ]: On model.airbyte_utils.oico_users_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.oico_users_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`oico_users_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:21.129847 [debug] [Thread-1 ]: On model.airbyte_utils.order_issues_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.order_issues_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`order_issues_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:21.131872 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:21.137899 [debug] [Thread-8 ]: Began executing node model.airbyte_utils.popular_searches_scd 2022-07-30 02:59:35 normalization > 02:58:21.149577 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:21.235218 [debug] [Thread-2 ]: On model.airbyte_utils.payer_buyer_locations_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.payer_buyer_locations_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.payer_buyer_locations_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:21.291846 [debug] [Thread-8 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/popular_searches_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.popular_searches_scd 2022-07-30 02:59:35 normalization > 02:58:21.298072 [info ] [Thread-8 ]: 02:58:21 + `dwcasa`.airbyte_cdc.`popular_searches_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:21.309195 [debug] [Thread-8 ]: Writing runtime SQL for node "model.airbyte_utils.popular_searches_scd" 2022-07-30 02:59:35 normalization > 02:58:21.310432 [debug] [Thread-8 ]: On model.airbyte_utils.popular_searches_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.popular_searches_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`popular_searches_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('popular_searches_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`popular_searches_stg` 2022-07-30 02:59:35 normalization > -- popular_searches from `dwcasa`.airbyte_cdc._airbyte_raw_popular_searches 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_popular_searches_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_popular_searches_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:21.447909 [debug] [Thread-3 ]: On model.airbyte_utils.heya_campaign_receipts_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.heya_campaign_receipts_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`heya_campaign_receipts_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:21.600693 [debug] [Thread-6 ]: On model.airbyte_utils.omie_accounts_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.omie_accounts_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`omie_accounts_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:21.933584 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:21.934625 [info ] [Thread-2 ]: 102 of 201 OK created incremental model airbyte_cdc.payer_buyer_locations_scd........................................... [CREATE TABLE (4.9k rows, 1.4 MB processed) in 6.31s] 2022-07-30 02:59:35 normalization > 02:58:21.935199 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.payer_buyer_locations_scd 2022-07-30 02:59:35 normalization > 02:58:21.935530 [debug] [Thread-2 ]: Began running node model.airbyte_utils.payment_installments_scd 2022-07-30 02:59:35 normalization > 02:58:21.935890 [info ] [Thread-2 ]: 109 of 201 START incremental model airbyte_cdc.payment_installments_scd................................................. [RUN] 2022-07-30 02:59:35 normalization > 02:58:21.937227 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.payment_installments_scd" 2022-07-30 02:59:35 normalization > 02:58:21.937396 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.payment_installments_scd 2022-07-30 02:59:35 normalization > 02:58:21.937531 [debug] [Thread-2 ]: Compiling model.airbyte_utils.payment_installments_scd 2022-07-30 02:59:35 normalization > 02:58:21.957553 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.payment_installments_scd" 2022-07-30 02:59:35 normalization > 02:58:21.958340 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:21.958538 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.payment_installments_scd 2022-07-30 02:59:35 normalization > 02:58:21.962242 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:22.114828 [debug] [Thread-2 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/payment_installments_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.payment_installments_scd 2022-07-30 02:59:35 normalization > 02:58:22.116573 [info ] [Thread-2 ]: 02:58:22 + `dwcasa`.airbyte_cdc.`payment_installments_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:22.121560 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.payment_installments_scd" 2022-07-30 02:59:35 normalization > 02:58:22.122100 [debug] [Thread-2 ]: On model.airbyte_utils.payment_installments_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.payment_installments_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`payment_installments_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('payment_installments_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`payment_installments_stg` 2022-07-30 02:59:35 normalization > -- payment_installments from `dwcasa`.airbyte_cdc._airbyte_raw_payment_installments 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > link, 2022-07-30 02:59:35 normalization > type, 2022-07-30 02:59:35 normalization > status, 2022-07-30 02:59:35 normalization > paid_at, 2022-07-30 02:59:35 normalization > due_date, 2022-07-30 02:59:35 normalization > metadata, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > paid_value, 2022-07-30 02:59:35 normalization > payment_id, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > canceled_at, 2022-07-30 02:59:35 normalization > receipt_url, 2022-07-30 02:59:35 normalization > advance_payment, 2022-07-30 02:59:35 normalization > bank_receipt_url, 2022-07-30 02:59:35 normalization > external_identify, 2022-07-30 02:59:35 normalization > installment_value, 2022-07-30 02:59:35 normalization > original_due_date, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > installment_number, 2022-07-30 02:59:35 normalization > transfeera_batch_id, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by id 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by id 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_payment_installments_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > link, 2022-07-30 02:59:35 normalization > type, 2022-07-30 02:59:35 normalization > status, 2022-07-30 02:59:35 normalization > paid_at, 2022-07-30 02:59:35 normalization > due_date, 2022-07-30 02:59:35 normalization > metadata, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > paid_value, 2022-07-30 02:59:35 normalization > payment_id, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > canceled_at, 2022-07-30 02:59:35 normalization > receipt_url, 2022-07-30 02:59:35 normalization > advance_payment, 2022-07-30 02:59:35 normalization > bank_receipt_url, 2022-07-30 02:59:35 normalization > external_identify, 2022-07-30 02:59:35 normalization > installment_value, 2022-07-30 02:59:35 normalization > original_due_date, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > installment_number, 2022-07-30 02:59:35 normalization > transfeera_batch_id, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_payment_installments_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:22.369819 [debug] [Thread-7 ]: On model.airbyte_utils.payers_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.payers_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`payers_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:23.107603 [debug] [Thread-2 ]: BigQuery adapter: Retry attempt 1 of 3 after error: BadRequest("Invalid date: '2022-07-15T00:00:00Z'") 2022-07-30 02:59:35 normalization > 02:58:23.169135 [debug] [Thread-5 ]: On model.airbyte_utils.oico_users_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.oico_users_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.oico_users_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:23.435615 [debug] [Thread-1 ]: On model.airbyte_utils.order_issues_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.order_issues_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.order_issues_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:23.789502 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:23.792768 [info ] [Thread-5 ]: 105 of 201 OK created incremental model airbyte_cdc.oico_users_scd...................................................... [CREATE TABLE (13.0 rows, 5.9 KB processed) in 5.69s] 2022-07-30 02:59:35 normalization > 02:58:23.794778 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.oico_users_scd 2022-07-30 02:59:35 normalization > 02:58:23.795174 [debug] [Thread-5 ]: Began running node model.airbyte_utils.payments_scd 2022-07-30 02:59:35 normalization > 02:58:23.796318 [info ] [Thread-5 ]: 110 of 201 START incremental model airbyte_cdc.payments_scd............................................................. [RUN] 2022-07-30 02:59:35 normalization > 02:58:23.799044 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.payments_scd" 2022-07-30 02:59:35 normalization > 02:58:23.799248 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.payments_scd 2022-07-30 02:59:35 normalization > 02:58:23.799401 [debug] [Thread-5 ]: Compiling model.airbyte_utils.payments_scd 2022-07-30 02:59:35 normalization > 02:58:23.851437 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.payments_scd" 2022-07-30 02:59:35 normalization > 02:58:23.853170 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:23.853426 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.payments_scd 2022-07-30 02:59:35 normalization > 02:58:23.862540 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:24.059785 [debug] [Thread-5 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/payments_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.payments_scd 2022-07-30 02:59:35 normalization > 02:58:24.061362 [info ] [Thread-5 ]: 02:58:24 + `dwcasa`.airbyte_cdc.`payments_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:24.075249 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.payments_scd" 2022-07-30 02:59:35 normalization > 02:58:24.077807 [debug] [Thread-5 ]: On model.airbyte_utils.payments_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.payments_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`payments_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('payments_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`payments_stg` 2022-07-30 02:59:35 normalization > -- payments from `dwcasa`.airbyte_cdc._airbyte_raw_payments 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > type, 2022-07-30 02:59:35 normalization > status, 2022-07-30 02:59:35 normalization > omie_id, 2022-07-30 02:59:35 normalization > discount, 2022-07-30 02:59:35 normalization > order_id, 2022-07-30 02:59:35 normalization > payer_id, 2022-07-30 02:59:35 normalization > store_id, 2022-07-30 02:59:35 normalization > xml_link, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > created_by, 2022-07-30 02:59:35 normalization > extra_fees, 2022-07-30 02:59:35 normalization > paid_value, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > canceled_at, 2022-07-30 02:59:35 normalization > payment_value, 2022-07-30 02:59:35 normalization > omie_account_id, 2022-07-30 02:59:35 normalization > postmark_read_at, 2022-07-30 02:59:35 normalization > purchase_order_id, 2022-07-30 02:59:35 normalization > tax_document_link, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > freight_partner_id, 2022-07-30 02:59:35 normalization > tax_note_issued_at, 2022-07-30 02:59:35 normalization > postmark_message_id, 2022-07-30 02:59:35 normalization > purchase_order_link, 2022-07-30 02:59:35 normalization > tax_document_number, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by id 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by id 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_payments_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > type, 2022-07-30 02:59:35 normalization > status, 2022-07-30 02:59:35 normalization > omie_id, 2022-07-30 02:59:35 normalization > discount, 2022-07-30 02:59:35 normalization > order_id, 2022-07-30 02:59:35 normalization > payer_id, 2022-07-30 02:59:35 normalization > store_id, 2022-07-30 02:59:35 normalization > xml_link, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > created_by, 2022-07-30 02:59:35 normalization > extra_fees, 2022-07-30 02:59:35 normalization > paid_value, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > canceled_at, 2022-07-30 02:59:35 normalization > payment_value, 2022-07-30 02:59:35 normalization > omie_account_id, 2022-07-30 02:59:35 normalization > postmark_read_at, 2022-07-30 02:59:35 normalization > purchase_order_id, 2022-07-30 02:59:35 normalization > tax_document_link, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > freight_partner_id, 2022-07-30 02:59:35 normalization > tax_note_issued_at, 2022-07-30 02:59:35 normalization > postmark_message_id, 2022-07-30 02:59:35 normalization > purchase_order_link, 2022-07-30 02:59:35 normalization > tax_document_number, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_payments_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:24.095965 [debug] [Thread-3 ]: On model.airbyte_utils.heya_campaign_receipts_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.heya_campaign_receipts_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.heya_campaign_receipts_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:24.089099 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:24.105553 [info ] [Thread-1 ]: 104 of 201 OK created incremental model airbyte_cdc.order_issues_scd.................................................... [CREATE TABLE (6.5k rows, 3.1 MB processed) in 6.20s] 2022-07-30 02:59:35 normalization > 02:58:24.125859 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.order_issues_scd 2022-07-30 02:59:35 normalization > 02:58:24.130659 [debug] [Thread-8 ]: On model.airbyte_utils.popular_searches_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.popular_searches_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`popular_searches_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:24.132078 [debug] [Thread-1 ]: Began running node model.airbyte_utils.requested_products_scd 2022-07-30 02:59:35 normalization > 02:58:24.138715 [info ] [Thread-1 ]: 111 of 201 START incremental model airbyte_cdc.requested_products_scd................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:24.143514 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.requested_products_scd" 2022-07-30 02:59:35 normalization > 02:58:24.143762 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.requested_products_scd 2022-07-30 02:59:35 normalization > 02:58:24.143889 [debug] [Thread-1 ]: Compiling model.airbyte_utils.requested_products_scd 2022-07-30 02:59:35 normalization > 02:58:24.198125 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.requested_products_scd" 2022-07-30 02:59:35 normalization > 02:58:24.198601 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:24.198765 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.requested_products_scd 2022-07-30 02:59:35 normalization > 02:58:24.214822 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:24.411249 [debug] [Thread-1 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/requested_products_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.requested_products_scd 2022-07-30 02:59:35 normalization > 02:58:24.412798 [info ] [Thread-1 ]: 02:58:24 + `dwcasa`.airbyte_cdc.`requested_products_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:24.424644 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.requested_products_scd" 2022-07-30 02:59:35 normalization > 02:58:24.425120 [debug] [Thread-1 ]: On model.airbyte_utils.requested_products_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.requested_products_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`requested_products_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('requested_products_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`requested_products_stg` 2022-07-30 02:59:35 normalization > -- requested_products from `dwcasa`.airbyte_cdc._airbyte_raw_requested_products 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > comment, 2022-07-30 02:59:35 normalization > order_id, 2022-07-30 02:59:35 normalization > quantity, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > deleted_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > description, 2022-07-30 02:59:35 normalization > unavailable, 2022-07-30 02:59:35 normalization > done_by_client, 2022-07-30 02:59:35 normalization > user_preference, 2022-07-30 02:59:35 normalization > product_order_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > original_description, 2022-07-30 02:59:35 normalization > product_canonical_id, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_requested_products_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > comment, 2022-07-30 02:59:35 normalization > order_id, 2022-07-30 02:59:35 normalization > quantity, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > deleted_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > description, 2022-07-30 02:59:35 normalization > unavailable, 2022-07-30 02:59:35 normalization > done_by_client, 2022-07-30 02:59:35 normalization > user_preference, 2022-07-30 02:59:35 normalization > product_order_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > original_description, 2022-07-30 02:59:35 normalization > product_canonical_id, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_requested_products_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:24.678552 [debug] [Thread-7 ]: On model.airbyte_utils.payers_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.payers_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.payers_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:24.707580 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:24.708466 [info ] [Thread-3 ]: 103 of 201 OK created incremental model airbyte_cdc.heya_campaign_receipts_scd.......................................... [CREATE TABLE (30.7k rows, 12.5 MB processed) in 7.51s] 2022-07-30 02:59:35 normalization > 02:58:24.709638 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.heya_campaign_receipts_scd 2022-07-30 02:59:35 normalization > 02:58:24.709876 [debug] [Thread-3 ]: Began running node model.airbyte_utils.order_categories_scd 2022-07-30 02:59:35 normalization > 02:58:24.710472 [info ] [Thread-3 ]: 112 of 201 START incremental model airbyte_cdc.order_categories_scd..................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:24.711912 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.order_categories_scd" 2022-07-30 02:59:35 normalization > 02:58:24.712201 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.order_categories_scd 2022-07-30 02:59:35 normalization > 02:58:24.712349 [debug] [Thread-3 ]: Compiling model.airbyte_utils.order_categories_scd 2022-07-30 02:59:35 normalization > 02:58:24.734671 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.order_categories_scd" 2022-07-30 02:59:35 normalization > 02:58:24.735276 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:24.735537 [debug] [Thread-3 ]: Began executing node model.airbyte_utils.order_categories_scd 2022-07-30 02:59:35 normalization > 02:58:24.739592 [debug] [Thread-3 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:24.864980 [debug] [Thread-2 ]: BigQuery adapter: Retry attempt 2 of 3 after error: BadRequest("Invalid date: '2022-07-15T00:00:00Z'") 2022-07-30 02:59:35 normalization > 02:58:24.876631 [debug] [Thread-3 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/order_categories_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.order_categories_scd 2022-07-30 02:59:35 normalization > 02:58:24.877960 [info ] [Thread-3 ]: 02:58:24 + `dwcasa`.airbyte_cdc.`order_categories_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:24.882618 [debug] [Thread-3 ]: Writing runtime SQL for node "model.airbyte_utils.order_categories_scd" 2022-07-30 02:59:35 normalization > 02:58:24.883047 [debug] [Thread-3 ]: On model.airbyte_utils.order_categories_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.order_categories_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`order_categories_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('order_categories_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`order_categories_stg` 2022-07-30 02:59:35 normalization > -- order_categories from `dwcasa`.airbyte_cdc._airbyte_raw_order_categories 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > order_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > category_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_order_categories_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > order_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > category_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_order_categories_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:25.313653 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:25.315081 [info ] [Thread-7 ]: 107 of 201 OK created incremental model airbyte_cdc.payers_scd.......................................................... [CREATE TABLE (1.9k rows, 2.0 MB processed) in 6.11s] 2022-07-30 02:59:35 normalization > 02:58:25.316838 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.payers_scd 2022-07-30 02:59:35 normalization > 02:58:25.317120 [debug] [Thread-7 ]: Began running node model.airbyte_utils.product_orders_scd 2022-07-30 02:59:35 normalization > 02:58:25.317867 [info ] [Thread-7 ]: 113 of 201 START incremental model airbyte_cdc.product_orders_scd....................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:25.319239 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.product_orders_scd" 2022-07-30 02:59:35 normalization > 02:58:25.319447 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.product_orders_scd 2022-07-30 02:59:35 normalization > 02:58:25.319573 [debug] [Thread-7 ]: Compiling model.airbyte_utils.product_orders_scd 2022-07-30 02:59:35 normalization > 02:58:25.340858 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.product_orders_scd" 2022-07-30 02:59:35 normalization > 02:58:25.341406 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:25.341571 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.product_orders_scd 2022-07-30 02:59:35 normalization > 02:58:25.345775 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:25.556494 [debug] [Thread-7 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/product_orders_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.product_orders_scd 2022-07-30 02:59:35 normalization > 02:58:25.557761 [info ] [Thread-7 ]: 02:58:25 + `dwcasa`.airbyte_cdc.`product_orders_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:25.564252 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.product_orders_scd" 2022-07-30 02:59:35 normalization > 02:58:25.564740 [debug] [Thread-7 ]: On model.airbyte_utils.product_orders_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.product_orders_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`product_orders_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('product_orders_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`product_orders_stg` 2022-07-30 02:59:35 normalization > -- product_orders from `dwcasa`.airbyte_cdc._airbyte_raw_product_orders 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > order_id, 2022-07-30 02:59:35 normalization > quantity, 2022-07-30 02:59:35 normalization > low_stock, 2022-07-30 02:59:35 normalization > oversized, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > dispatched, 2022-07-30 02:59:35 normalization > product_id, 2022-07-30 02:59:35 normalization > quote_link, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > returned_to, 2022-07-30 02:59:35 normalization > confirmed_by, 2022-07-30 02:59:35 normalization > under_review, 2022-07-30 02:59:35 normalization > type_quantity, 2022-07-30 02:59:35 normalization > custom_product, 2022-07-30 02:59:35 normalization > store_quote_id, 2022-07-30 02:59:35 normalization > pipefy_order_id, 2022-07-30 02:59:35 normalization > canceled_by_store, 2022-07-30 02:59:35 normalization > pipefy_product_id, 2022-07-30 02:59:35 normalization > store_location_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > fits_in_motorcycle, 2022-07-30 02:59:35 normalization > trusted_when_associated, 2022-07-30 02:59:35 normalization > pipefy_location_store_id, 2022-07-30 02:59:35 normalization > store_cancelation_reason, 2022-07-30 02:59:35 normalization > location_store_product_id, 2022-07-30 02:59:35 normalization > product_cost_when_associated, 2022-07-30 02:59:35 normalization > product_price_when_associated, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_product_orders_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > order_id, 2022-07-30 02:59:35 normalization > quantity, 2022-07-30 02:59:35 normalization > low_stock, 2022-07-30 02:59:35 normalization > oversized, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > dispatched, 2022-07-30 02:59:35 normalization > product_id, 2022-07-30 02:59:35 normalization > quote_link, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > returned_to, 2022-07-30 02:59:35 normalization > confirmed_by, 2022-07-30 02:59:35 normalization > under_review, 2022-07-30 02:59:35 normalization > type_quantity, 2022-07-30 02:59:35 normalization > custom_product, 2022-07-30 02:59:35 normalization > store_quote_id, 2022-07-30 02:59:35 normalization > pipefy_order_id, 2022-07-30 02:59:35 normalization > canceled_by_store, 2022-07-30 02:59:35 normalization > pipefy_product_id, 2022-07-30 02:59:35 normalization > store_location_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > fits_in_motorcycle, 2022-07-30 02:59:35 normalization > trusted_when_associated, 2022-07-30 02:59:35 normalization > pipefy_location_store_id, 2022-07-30 02:59:35 normalization > store_cancelation_reason, 2022-07-30 02:59:35 normalization > location_store_product_id, 2022-07-30 02:59:35 normalization > product_cost_when_associated, 2022-07-30 02:59:35 normalization > product_price_when_associated, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_product_orders_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:26.146590 [debug] [Thread-6 ]: On model.airbyte_utils.omie_accounts_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.omie_accounts_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.omie_accounts_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:26.183699 [debug] [Thread-8 ]: On model.airbyte_utils.popular_searches_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.popular_searches_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.popular_searches_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:26.777109 [debug] [Thread-2 ]: BigQuery adapter: Retry attempt 3 of 3 after error: BadRequest("Invalid date: '2022-07-15T00:00:00Z'") 2022-07-30 02:59:35 normalization > 02:58:26.786578 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:26.787499 [info ] [Thread-6 ]: 106 of 201 OK created incremental model airbyte_cdc.omie_accounts_scd................................................... [CREATE TABLE (1.0 rows, 357.0 Bytes processed) in 7.87s] 2022-07-30 02:59:35 normalization > 02:58:26.788727 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.omie_accounts_scd 2022-07-30 02:59:35 normalization > 02:58:26.788966 [debug] [Thread-6 ]: Began running node model.airbyte_utils.roi_products_scd 2022-07-30 02:59:35 normalization > 02:58:26.789461 [info ] [Thread-6 ]: 114 of 201 START incremental model airbyte_cdc.roi_products_scd......................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:26.790583 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.roi_products_scd" 2022-07-30 02:59:35 normalization > 02:58:26.790768 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.roi_products_scd 2022-07-30 02:59:35 normalization > 02:58:26.790889 [debug] [Thread-6 ]: Compiling model.airbyte_utils.roi_products_scd 2022-07-30 02:59:35 normalization > 02:58:26.800064 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:26.815074 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.roi_products_scd" 2022-07-30 02:59:35 normalization > 02:58:26.816059 [info ] [Thread-8 ]: 108 of 201 OK created incremental model airbyte_cdc.popular_searches_scd................................................ [CREATE TABLE (6.0 rows, 1.5 KB processed) in 5.75s] 2022-07-30 02:59:35 normalization > 02:58:26.816845 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:26.817264 [debug] [Thread-6 ]: Began executing node model.airbyte_utils.roi_products_scd 2022-07-30 02:59:35 normalization > 02:58:26.821635 [debug] [Thread-6 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:26.821895 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.popular_searches_scd 2022-07-30 02:59:35 normalization > 02:58:26.822340 [debug] [Thread-8 ]: Began running node model.airbyte_utils.product_canonical_categories_scd 2022-07-30 02:59:35 normalization > 02:58:26.823247 [info ] [Thread-8 ]: 115 of 201 START incremental model airbyte_cdc.product_canonical_categories_scd......................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:26.825514 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.product_canonical_categories_scd" 2022-07-30 02:59:35 normalization > 02:58:26.825725 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.product_canonical_categories_scd 2022-07-30 02:59:35 normalization > 02:58:26.825892 [debug] [Thread-8 ]: Compiling model.airbyte_utils.product_canonical_categories_scd 2022-07-30 02:59:35 normalization > 02:58:26.846837 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.product_canonical_categories_scd" 2022-07-30 02:59:35 normalization > 02:58:26.848511 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:26.848950 [debug] [Thread-8 ]: Began executing node model.airbyte_utils.product_canonical_categories_scd 2022-07-30 02:59:35 normalization > 02:58:26.852832 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:26.976199 [debug] [Thread-8 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/product_canonical_categories_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.product_canonical_categories_scd 2022-07-30 02:59:35 normalization > 02:58:26.977351 [info ] [Thread-8 ]: 02:58:26 + `dwcasa`.airbyte_cdc.`product_canonical_categories_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:26.982050 [debug] [Thread-8 ]: Writing runtime SQL for node "model.airbyte_utils.product_canonical_categories_scd" 2022-07-30 02:59:35 normalization > 02:58:26.982498 [debug] [Thread-8 ]: On model.airbyte_utils.product_canonical_categories_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.product_canonical_categories_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`product_canonical_categories_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('product_canonical_categories_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`product_canonical_categories_stg` 2022-07-30 02:59:35 normalization > -- product_canonical_categories from `dwcasa`.airbyte_cdc._airbyte_raw_product_canonical_categories 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > category_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > product_canonical_id, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_product_canonical_categories_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > category_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > product_canonical_id, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_product_canonical_categories_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:27.035352 [debug] [Thread-6 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/roi_products_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.roi_products_scd 2022-07-30 02:59:35 normalization > 02:58:27.036522 [info ] [Thread-6 ]: 02:58:27 + `dwcasa`.airbyte_cdc.`roi_products_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:27.041192 [debug] [Thread-6 ]: Writing runtime SQL for node "model.airbyte_utils.roi_products_scd" 2022-07-30 02:59:35 normalization > 02:58:27.041633 [debug] [Thread-6 ]: On model.airbyte_utils.roi_products_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.roi_products_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`roi_products_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('roi_products_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`roi_products_stg` 2022-07-30 02:59:35 normalization > -- roi_products from `dwcasa`.airbyte_cdc._airbyte_raw_roi_products 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > price, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_roi_products_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > price, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_roi_products_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:27.431987 [debug] [Thread-4 ]: On model.airbyte_utils.flipper_gates_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.flipper_gates_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`flipper_gates_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:27.899062 [debug] [Thread-3 ]: On model.airbyte_utils.order_categories_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.order_categories_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`order_categories_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:28.713238 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:28.713974 [debug] [Thread-2 ]: Database Error in model payment_installments_scd (models/generated/airbyte_incremental/scd/airbyte_cdc/payment_installments_scd.sql) 2022-07-30 02:59:35 normalization > Invalid date: '2022-07-15T00:00:00Z' 2022-07-30 02:59:35 normalization > compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_incremental/scd/airbyte_cdc/payment_installments_scd.sql 2022-07-30 02:59:35 normalization > 02:58:28.714426 [error] [Thread-2 ]: 109 of 201 ERROR creating incremental model airbyte_cdc.payment_installments_scd........................................ [ERROR in 6.78s] 2022-07-30 02:59:35 normalization > 02:58:28.714849 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.payment_installments_scd 2022-07-30 02:59:35 normalization > 02:58:28.715165 [debug] [Thread-2 ]: Began running node model.airbyte_utils.reports_scd 2022-07-30 02:59:35 normalization > 02:58:28.717000 [info ] [Thread-2 ]: 116 of 201 START incremental model airbyte_cdc.reports_scd.............................................................. [RUN] 2022-07-30 02:59:35 normalization > 02:58:28.719148 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.reports_scd" 2022-07-30 02:59:35 normalization > 02:58:28.719323 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.reports_scd 2022-07-30 02:59:35 normalization > 02:58:28.719501 [debug] [Thread-2 ]: Compiling model.airbyte_utils.reports_scd 2022-07-30 02:59:35 normalization > 02:58:28.745746 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.reports_scd" 2022-07-30 02:59:35 normalization > 02:58:28.757779 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:28.758147 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.reports_scd 2022-07-30 02:59:35 normalization > 02:58:28.761878 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:28.906247 [debug] [Thread-2 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/reports_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.reports_scd 2022-07-30 02:59:35 normalization > 02:58:28.908169 [info ] [Thread-2 ]: 02:58:28 + `dwcasa`.airbyte_cdc.`reports_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:28.912685 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.reports_scd" 2022-07-30 02:59:35 normalization > 02:58:28.913194 [debug] [Thread-2 ]: On model.airbyte_utils.reports_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.reports_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`reports_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('reports_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`reports_stg` 2022-07-30 02:59:35 normalization > -- reports from `dwcasa`.airbyte_cdc._airbyte_raw_reports 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > sended, 2022-07-30 02:59:35 normalization > message, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > buyer_user_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_reports_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > sended, 2022-07-30 02:59:35 normalization > message, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > buyer_user_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_reports_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:29.797710 [debug] [Thread-6 ]: On model.airbyte_utils.roi_products_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.roi_products_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`roi_products_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:29.807011 [debug] [Thread-4 ]: On model.airbyte_utils.flipper_gates_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.flipper_gates_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.flipper_gates_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:29.947120 [debug] [Thread-3 ]: On model.airbyte_utils.order_categories_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.order_categories_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.order_categories_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:30.426210 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:30.427776 [info ] [Thread-4 ]: 89 of 201 OK created incremental model airbyte_cdc.flipper_gates_scd.................................................... [CREATE TABLE (11.0 rows, 3.3 KB processed) in 28.61s] 2022-07-30 02:59:35 normalization > 02:58:30.428227 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.flipper_gates_scd 2022-07-30 02:59:35 normalization > 02:58:30.428505 [debug] [Thread-4 ]: Began running node model.airbyte_utils.products_scd 2022-07-30 02:59:35 normalization > 02:58:30.429316 [info ] [Thread-4 ]: 117 of 201 START incremental model airbyte_cdc.products_scd............................................................. [RUN] 2022-07-30 02:59:35 normalization > 02:58:30.430293 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.products_scd" 2022-07-30 02:59:35 normalization > 02:58:30.430464 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.products_scd 2022-07-30 02:59:35 normalization > 02:58:30.430731 [debug] [Thread-4 ]: Compiling model.airbyte_utils.products_scd 2022-07-30 02:59:35 normalization > 02:58:30.463467 [debug] [Thread-1 ]: On model.airbyte_utils.requested_products_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.requested_products_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`requested_products_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:30.464350 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.products_scd" 2022-07-30 02:59:35 normalization > 02:58:30.467505 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:30.467770 [debug] [Thread-4 ]: Began executing node model.airbyte_utils.products_scd 2022-07-30 02:59:35 normalization > 02:58:30.472954 [debug] [Thread-4 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:30.597841 [debug] [Thread-4 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/products_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.products_scd 2022-07-30 02:59:35 normalization > 02:58:30.599091 [info ] [Thread-4 ]: 02:58:30 + `dwcasa`.airbyte_cdc.`products_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:30.602963 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:30.607197 [debug] [Thread-4 ]: Writing runtime SQL for node "model.airbyte_utils.products_scd" 2022-07-30 02:59:35 normalization > 02:58:30.608577 [info ] [Thread-3 ]: 112 of 201 OK created incremental model airbyte_cdc.order_categories_scd................................................ [CREATE TABLE (13.7k rows, 3.7 MB processed) in 5.90s] 2022-07-30 02:59:35 normalization > 02:58:30.609549 [debug] [Thread-4 ]: On model.airbyte_utils.products_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.products_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`products_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('products_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`products_stg` 2022-07-30 02:59:35 normalization > -- products from `dwcasa`.airbyte_cdc._airbyte_raw_products 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > ncm, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > price, 2022-07-30 02:59:35 normalization > details, 2022-07-30 02:59:35 normalization > omie_id, 2022-07-30 02:59:35 normalization > trusted, 2022-07-30 02:59:35 normalization > on_offer, 2022-07-30 02:59:35 normalization > store_id, 2022-07-30 02:59:35 normalization > available, 2022-07-30 02:59:35 normalization > pipefy_id, 2022-07-30 02:59:35 normalization > changed_by, 2022-07-30 02:59:35 normalization > conta_azul, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > description, 2022-07-30 02:59:35 normalization > inserted_by, 2022-07-30 02:59:35 normalization > type_quantity, 2022-07-30 02:59:35 normalization > width_per_unit, 2022-07-30 02:59:35 normalization > height_per_unit, 2022-07-30 02:59:35 normalization > lenght_per_unit, 2022-07-30 02:59:35 normalization > pipefy_store_id, 2022-07-30 02:59:35 normalization > weight_per_unit, 2022-07-30 02:59:35 normalization > minimum_quantity, 2022-07-30 02:59:35 normalization > problem_reported, 2022-07-30 02:59:35 normalization > external_identify, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > oico_markup_retail, 2022-07-30 02:59:35 normalization > available_to_stores, 2022-07-30 02:59:35 normalization > product_canonical_id, 2022-07-30 02:59:35 normalization > oico_markup_wholesale, 2022-07-30 02:59:35 normalization > canonical_associated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_products_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > ncm, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > price, 2022-07-30 02:59:35 normalization > details, 2022-07-30 02:59:35 normalization > omie_id, 2022-07-30 02:59:35 normalization > trusted, 2022-07-30 02:59:35 normalization > on_offer, 2022-07-30 02:59:35 normalization > store_id, 2022-07-30 02:59:35 normalization > available, 2022-07-30 02:59:35 normalization > pipefy_id, 2022-07-30 02:59:35 normalization > changed_by, 2022-07-30 02:59:35 normalization > conta_azul, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > description, 2022-07-30 02:59:35 normalization > inserted_by, 2022-07-30 02:59:35 normalization > type_quantity, 2022-07-30 02:59:35 normalization > width_per_unit, 2022-07-30 02:59:35 normalization > height_per_unit, 2022-07-30 02:59:35 normalization > lenght_per_unit, 2022-07-30 02:59:35 normalization > pipefy_store_id, 2022-07-30 02:59:35 normalization > weight_per_unit, 2022-07-30 02:59:35 normalization > minimum_quantity, 2022-07-30 02:59:35 normalization > problem_reported, 2022-07-30 02:59:35 normalization > external_identify, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > oico_markup_retail, 2022-07-30 02:59:35 normalization > available_to_stores, 2022-07-30 02:59:35 normalization > product_canonical_id, 2022-07-30 02:59:35 normalization > oico_markup_wholesale, 2022-07-30 02:59:35 normalization > canonical_associated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_products_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:30.617340 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.order_categories_scd 2022-07-30 02:59:35 normalization > 02:58:30.617641 [debug] [Thread-3 ]: Began running node model.airbyte_utils.spatial_ref_sys_scd 2022-07-30 02:59:35 normalization > 02:58:30.618259 [info ] [Thread-3 ]: 118 of 201 START incremental model airbyte_cdc.spatial_ref_sys_scd...................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:30.620148 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.spatial_ref_sys_scd" 2022-07-30 02:59:35 normalization > 02:58:30.620398 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.spatial_ref_sys_scd 2022-07-30 02:59:35 normalization > 02:58:30.620549 [debug] [Thread-3 ]: Compiling model.airbyte_utils.spatial_ref_sys_scd 2022-07-30 02:59:35 normalization > 02:58:30.643302 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.spatial_ref_sys_scd" 2022-07-30 02:59:35 normalization > 02:58:30.643903 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:30.644088 [debug] [Thread-3 ]: Began executing node model.airbyte_utils.spatial_ref_sys_scd 2022-07-30 02:59:35 normalization > 02:58:30.647878 [debug] [Thread-3 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:30.815976 [debug] [Thread-3 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/spatial_ref_sys_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.spatial_ref_sys_scd 2022-07-30 02:59:35 normalization > 02:58:30.817114 [info ] [Thread-3 ]: 02:58:30 + `dwcasa`.airbyte_cdc.`spatial_ref_sys_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:30.822771 [debug] [Thread-3 ]: Writing runtime SQL for node "model.airbyte_utils.spatial_ref_sys_scd" 2022-07-30 02:59:35 normalization > 02:58:30.823457 [debug] [Thread-3 ]: On model.airbyte_utils.spatial_ref_sys_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.spatial_ref_sys_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`spatial_ref_sys_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('spatial_ref_sys_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`spatial_ref_sys_stg` 2022-07-30 02:59:35 normalization > -- spatial_ref_sys from `dwcasa`.airbyte_cdc._airbyte_raw_spatial_ref_sys 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(srid as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > srid, 2022-07-30 02:59:35 normalization > srtext, 2022-07-30 02:59:35 normalization > auth_name, 2022-07-30 02:59:35 normalization > auth_srid, 2022-07-30 02:59:35 normalization > proj4text, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(srid as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(srid as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_spatial_ref_sys_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > srid, 2022-07-30 02:59:35 normalization > srtext, 2022-07-30 02:59:35 normalization > auth_name, 2022-07-30 02:59:35 normalization > auth_srid, 2022-07-30 02:59:35 normalization > proj4text, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_spatial_ref_sys_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:31.710639 [debug] [Thread-2 ]: On model.airbyte_utils.reports_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.reports_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`reports_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:31.805288 [debug] [Thread-6 ]: On model.airbyte_utils.roi_products_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.roi_products_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.roi_products_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:32.395877 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:32.396777 [info ] [Thread-6 ]: 114 of 201 OK created incremental model airbyte_cdc.roi_products_scd.................................................... [CREATE TABLE (5.0 rows, 1.0 KB processed) in 5.61s] 2022-07-30 02:59:35 normalization > 02:58:32.399734 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.roi_products_scd 2022-07-30 02:59:35 normalization > 02:58:32.400104 [debug] [Thread-6 ]: Began running node model.airbyte_utils.product_canonicals_scd 2022-07-30 02:59:35 normalization > 02:58:32.406172 [info ] [Thread-6 ]: 119 of 201 START incremental model airbyte_cdc.product_canonicals_scd................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:32.407207 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.product_canonicals_scd" 2022-07-30 02:59:35 normalization > 02:58:32.407459 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.product_canonicals_scd 2022-07-30 02:59:35 normalization > 02:58:32.407612 [debug] [Thread-6 ]: Compiling model.airbyte_utils.product_canonicals_scd 2022-07-30 02:59:35 normalization > 02:58:32.466843 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.product_canonicals_scd" 2022-07-30 02:59:35 normalization > 02:58:32.467289 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:32.467515 [debug] [Thread-6 ]: Began executing node model.airbyte_utils.product_canonicals_scd 2022-07-30 02:59:35 normalization > 02:58:32.471264 [debug] [Thread-6 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:32.619923 [debug] [Thread-6 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/product_canonicals_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.product_canonicals_scd 2022-07-30 02:59:35 normalization > 02:58:32.621154 [info ] [Thread-6 ]: 02:58:32 + `dwcasa`.airbyte_cdc.`product_canonicals_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:32.625497 [debug] [Thread-6 ]: Writing runtime SQL for node "model.airbyte_utils.product_canonicals_scd" 2022-07-30 02:59:35 normalization > 02:58:32.625919 [debug] [Thread-6 ]: On model.airbyte_utils.product_canonicals_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.product_canonicals_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`product_canonicals_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('product_canonicals_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`product_canonicals_stg` 2022-07-30 02:59:35 normalization > -- product_canonicals from `dwcasa`.airbyte_cdc._airbyte_raw_product_canonicals 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > ean, 2022-07-30 02:59:35 normalization > code, 2022-07-30 02:59:35 normalization > gtin, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > brand, 2022-07-30 02:59:35 normalization > image, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > created_by, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > width_per_unit, 2022-07-30 02:59:35 normalization > height_per_unit, 2022-07-30 02:59:35 normalization > lenght_per_unit, 2022-07-30 02:59:35 normalization > reference_price, 2022-07-30 02:59:35 normalization > weight_per_unit, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_product_canonicals_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > ean, 2022-07-30 02:59:35 normalization > code, 2022-07-30 02:59:35 normalization > gtin, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > brand, 2022-07-30 02:59:35 normalization > image, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > created_by, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > width_per_unit, 2022-07-30 02:59:35 normalization > height_per_unit, 2022-07-30 02:59:35 normalization > lenght_per_unit, 2022-07-30 02:59:35 normalization > reference_price, 2022-07-30 02:59:35 normalization > weight_per_unit, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_product_canonicals_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:32.782218 [debug] [Thread-1 ]: On model.airbyte_utils.requested_products_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.requested_products_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.requested_products_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:33.580996 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:33.582238 [info ] [Thread-1 ]: 111 of 201 OK created incremental model airbyte_cdc.requested_products_scd.............................................. [CREATE TABLE (38.7k rows, 21.6 MB processed) in 9.44s] 2022-07-30 02:59:35 normalization > 02:58:33.582658 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.requested_products_scd 2022-07-30 02:59:35 normalization > 02:58:33.583470 [debug] [Thread-1 ]: Began running node model.airbyte_utils.schema_migrations_scd 2022-07-30 02:59:35 normalization > 02:58:33.584353 [info ] [Thread-1 ]: 120 of 201 START incremental model airbyte_cdc.schema_migrations_scd.................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:33.585611 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.schema_migrations_scd" 2022-07-30 02:59:35 normalization > 02:58:33.585864 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.schema_migrations_scd 2022-07-30 02:59:35 normalization > 02:58:33.586023 [debug] [Thread-1 ]: Compiling model.airbyte_utils.schema_migrations_scd 2022-07-30 02:59:35 normalization > 02:58:33.665342 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.schema_migrations_scd" 2022-07-30 02:59:35 normalization > 02:58:33.669354 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:33.669644 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.schema_migrations_scd 2022-07-30 02:59:35 normalization > 02:58:33.676958 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:33.790417 [debug] [Thread-3 ]: On model.airbyte_utils.spatial_ref_sys_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.spatial_ref_sys_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`spatial_ref_sys_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:33.837898 [debug] [Thread-1 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/schema_migrations_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.schema_migrations_scd 2022-07-30 02:59:35 normalization > 02:58:33.839545 [info ] [Thread-1 ]: 02:58:33 + `dwcasa`.airbyte_cdc.`schema_migrations_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:33.845590 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.schema_migrations_scd" 2022-07-30 02:59:35 normalization > 02:58:33.849524 [debug] [Thread-1 ]: On model.airbyte_utils.schema_migrations_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.schema_migrations_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`schema_migrations_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('schema_migrations_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`schema_migrations_stg` 2022-07-30 02:59:35 normalization > -- schema_migrations from `dwcasa`.airbyte_cdc._airbyte_raw_schema_migrations 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(version as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > version, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by version 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by version 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_schema_migrations_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > version, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_schema_migrations_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:34.028020 [debug] [Thread-5 ]: On model.airbyte_utils.payments_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.payments_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`payments_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:34.030401 [debug] [Thread-2 ]: On model.airbyte_utils.reports_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.reports_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.reports_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:34.577033 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:34.578781 [info ] [Thread-2 ]: 116 of 201 OK created incremental model airbyte_cdc.reports_scd......................................................... [CREATE TABLE (0.0 rows, 0 processed) in 5.86s] 2022-07-30 02:59:35 normalization > 02:58:34.579696 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.reports_scd 2022-07-30 02:59:35 normalization > 02:58:34.580058 [debug] [Thread-2 ]: Began running node model.airbyte_utils.store_order_quotes_scd 2022-07-30 02:59:35 normalization > 02:58:34.580804 [info ] [Thread-2 ]: 121 of 201 START incremental model airbyte_cdc.store_order_quotes_scd................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:34.583390 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.store_order_quotes_scd" 2022-07-30 02:59:35 normalization > 02:58:34.583580 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.store_order_quotes_scd 2022-07-30 02:59:35 normalization > 02:58:34.583704 [debug] [Thread-2 ]: Compiling model.airbyte_utils.store_order_quotes_scd 2022-07-30 02:59:35 normalization > 02:58:34.604555 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.store_order_quotes_scd" 2022-07-30 02:59:35 normalization > 02:58:34.604999 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:34.605226 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.store_order_quotes_scd 2022-07-30 02:59:35 normalization > 02:58:34.611288 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:34.765540 [debug] [Thread-2 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/store_order_quotes_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.store_order_quotes_scd 2022-07-30 02:59:35 normalization > 02:58:34.767287 [info ] [Thread-2 ]: 02:58:34 + `dwcasa`.airbyte_cdc.`store_order_quotes_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:34.772071 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.store_order_quotes_scd" 2022-07-30 02:59:35 normalization > 02:58:34.772648 [debug] [Thread-2 ]: On model.airbyte_utils.store_order_quotes_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.store_order_quotes_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`store_order_quotes_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('store_order_quotes_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`store_order_quotes_stg` 2022-07-30 02:59:35 normalization > -- store_order_quotes from `dwcasa`.airbyte_cdc._airbyte_raw_store_order_quotes 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > sent_at, 2022-07-30 02:59:35 normalization > order_id, 2022-07-30 02:59:35 normalization > store_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > product_id, 2022-07-30 02:59:35 normalization > quote_link, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_store_order_quotes_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > sent_at, 2022-07-30 02:59:35 normalization > order_id, 2022-07-30 02:59:35 normalization > store_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > product_id, 2022-07-30 02:59:35 normalization > quote_link, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_store_order_quotes_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:36.108461 [debug] [Thread-3 ]: On model.airbyte_utils.spatial_ref_sys_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.spatial_ref_sys_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.spatial_ref_sys_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:36.697926 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:36.698859 [info ] [Thread-3 ]: 118 of 201 OK created incremental model airbyte_cdc.spatial_ref_sys_scd................................................. [CREATE TABLE (0.0 rows, 0 processed) in 6.08s] 2022-07-30 02:59:35 normalization > 02:58:36.699266 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.spatial_ref_sys_scd 2022-07-30 02:59:35 normalization > 02:58:36.699569 [debug] [Thread-3 ]: Began running node model.airbyte_utils.shortened_urls_scd 2022-07-30 02:59:35 normalization > 02:58:36.700427 [info ] [Thread-3 ]: 122 of 201 START incremental model airbyte_cdc.shortened_urls_scd....................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:36.701595 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.shortened_urls_scd" 2022-07-30 02:59:35 normalization > 02:58:36.701743 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.shortened_urls_scd 2022-07-30 02:59:35 normalization > 02:58:36.701862 [debug] [Thread-3 ]: Compiling model.airbyte_utils.shortened_urls_scd 2022-07-30 02:59:35 normalization > 02:58:36.726827 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.shortened_urls_scd" 2022-07-30 02:59:35 normalization > 02:58:36.727424 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:36.727646 [debug] [Thread-3 ]: Began executing node model.airbyte_utils.shortened_urls_scd 2022-07-30 02:59:35 normalization > 02:58:36.733157 [debug] [Thread-3 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:36.855725 [debug] [Thread-3 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/shortened_urls_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.shortened_urls_scd 2022-07-30 02:59:35 normalization > 02:58:36.856867 [info ] [Thread-3 ]: 02:58:36 + `dwcasa`.airbyte_cdc.`shortened_urls_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:36.863469 [debug] [Thread-3 ]: Writing runtime SQL for node "model.airbyte_utils.shortened_urls_scd" 2022-07-30 02:59:35 normalization > 02:58:36.864077 [debug] [Thread-3 ]: On model.airbyte_utils.shortened_urls_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.shortened_urls_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`shortened_urls_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('shortened_urls_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`shortened_urls_stg` 2022-07-30 02:59:35 normalization > -- shortened_urls from `dwcasa`.airbyte_cdc._airbyte_raw_shortened_urls 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > url, 2022-07-30 02:59:35 normalization > category, 2022-07-30 02:59:35 normalization > owner_id, 2022-07-30 02:59:35 normalization > use_count, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > expires_at, 2022-07-30 02:59:35 normalization > owner_type, 2022-07-30 02:59:35 normalization > unique_key, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_shortened_urls_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > url, 2022-07-30 02:59:35 normalization > category, 2022-07-30 02:59:35 normalization > owner_id, 2022-07-30 02:59:35 normalization > use_count, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > expires_at, 2022-07-30 02:59:35 normalization > owner_type, 2022-07-30 02:59:35 normalization > unique_key, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_shortened_urls_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:36.995496 [debug] [Thread-5 ]: On model.airbyte_utils.payments_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.payments_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.payments_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:37.190385 [debug] [Thread-1 ]: On model.airbyte_utils.schema_migrations_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.schema_migrations_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`schema_migrations_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:37.410977 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:37.412029 [info ] [Thread-5 ]: 110 of 201 OK created incremental model airbyte_cdc.payments_scd........................................................ [CREATE TABLE (28.7k rows, 27.3 MB processed) in 13.61s] 2022-07-30 02:59:35 normalization > 02:58:37.412571 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.payments_scd 2022-07-30 02:59:35 normalization > 02:58:37.412866 [debug] [Thread-5 ]: Began running node model.airbyte_utils.store_categories_scd 2022-07-30 02:59:35 normalization > 02:58:37.413626 [info ] [Thread-5 ]: 123 of 201 START incremental model airbyte_cdc.store_categories_scd..................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:37.415106 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.store_categories_scd" 2022-07-30 02:59:35 normalization > 02:58:37.415301 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.store_categories_scd 2022-07-30 02:59:35 normalization > 02:58:37.415496 [debug] [Thread-5 ]: Compiling model.airbyte_utils.store_categories_scd 2022-07-30 02:59:35 normalization > 02:58:37.436129 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.store_categories_scd" 2022-07-30 02:59:35 normalization > 02:58:37.436582 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:37.436739 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.store_categories_scd 2022-07-30 02:59:35 normalization > 02:58:37.442450 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:37.569489 [debug] [Thread-5 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/store_categories_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.store_categories_scd 2022-07-30 02:59:35 normalization > 02:58:37.570676 [info ] [Thread-5 ]: 02:58:37 + `dwcasa`.airbyte_cdc.`store_categories_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:37.574931 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.store_categories_scd" 2022-07-30 02:59:35 normalization > 02:58:37.575619 [debug] [Thread-5 ]: On model.airbyte_utils.store_categories_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.store_categories_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`store_categories_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('store_categories_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`store_categories_stg` 2022-07-30 02:59:35 normalization > -- store_categories from `dwcasa`.airbyte_cdc._airbyte_raw_store_categories 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > store_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > category_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_store_categories_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > store_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > category_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_store_categories_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:39.521710 [debug] [Thread-1 ]: On model.airbyte_utils.schema_migrations_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.schema_migrations_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.schema_migrations_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:40.150826 [debug] [Thread-6 ]: On model.airbyte_utils.product_canonicals_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.product_canonicals_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`product_canonicals_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:40.257830 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:40.258722 [info ] [Thread-1 ]: 120 of 201 OK created incremental model airbyte_cdc.schema_migrations_scd............................................... [CREATE TABLE (385.0 rows, 66.5 KB processed) in 6.67s] 2022-07-30 02:59:35 normalization > 02:58:40.259711 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.schema_migrations_scd 2022-07-30 02:59:35 normalization > 02:58:40.261316 [debug] [Thread-1 ]: Began running node model.airbyte_utils.product_reports_scd 2022-07-30 02:59:35 normalization > 02:58:40.261950 [info ] [Thread-1 ]: 124 of 201 START incremental model airbyte_cdc.product_reports_scd...................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:40.262948 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.product_reports_scd" 2022-07-30 02:59:35 normalization > 02:58:40.263117 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.product_reports_scd 2022-07-30 02:59:35 normalization > 02:58:40.263342 [debug] [Thread-1 ]: Compiling model.airbyte_utils.product_reports_scd 2022-07-30 02:59:35 normalization > 02:58:40.283769 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.product_reports_scd" 2022-07-30 02:59:35 normalization > 02:58:40.284267 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:40.284445 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.product_reports_scd 2022-07-30 02:59:35 normalization > 02:58:40.287937 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:40.455732 [debug] [Thread-5 ]: On model.airbyte_utils.store_categories_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.store_categories_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`store_categories_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:40.464057 [debug] [Thread-1 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/product_reports_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.product_reports_scd 2022-07-30 02:59:35 normalization > 02:58:40.467915 [info ] [Thread-1 ]: 02:58:40 + `dwcasa`.airbyte_cdc.`product_reports_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:40.472966 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.product_reports_scd" 2022-07-30 02:59:35 normalization > 02:58:40.473406 [debug] [Thread-1 ]: On model.airbyte_utils.product_reports_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.product_reports_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`product_reports_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('product_reports_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`product_reports_stg` 2022-07-30 02:59:35 normalization > -- product_reports from `dwcasa`.airbyte_cdc._airbyte_raw_product_reports 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > type, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > product_id, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > buyer_user_id, 2022-07-30 02:59:35 normalization > product_order_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > price_when_reported, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_product_reports_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > type, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > product_id, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > buyer_user_id, 2022-07-30 02:59:35 normalization > product_order_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > price_when_reported, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_product_reports_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:40.816927 [debug] [Thread-3 ]: On model.airbyte_utils.shortened_urls_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.shortened_urls_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`shortened_urls_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:41.116725 [debug] [Thread-2 ]: On model.airbyte_utils.store_order_quotes_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.store_order_quotes_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`store_order_quotes_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:42.534182 [debug] [Thread-6 ]: On model.airbyte_utils.product_canonicals_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.product_canonicals_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.product_canonicals_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:42.883173 [debug] [Thread-3 ]: On model.airbyte_utils.shortened_urls_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.shortened_urls_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.shortened_urls_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:43.075660 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:43.080464 [info ] [Thread-6 ]: 119 of 201 OK created incremental model airbyte_cdc.product_canonicals_scd.............................................. [CREATE TABLE (67.7k rows, 34.4 MB processed) in 10.67s] 2022-07-30 02:59:35 normalization > 02:58:43.082599 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.product_canonicals_scd 2022-07-30 02:59:35 normalization > 02:58:43.082973 [debug] [Thread-6 ]: Began running node model.airbyte_utils.sidekiq_sequence_records_scd 2022-07-30 02:59:35 normalization > 02:58:43.083626 [info ] [Thread-6 ]: 125 of 201 START incremental model airbyte_cdc.sidekiq_sequence_records_scd............................................. [RUN] 2022-07-30 02:59:35 normalization > 02:58:43.085102 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.sidekiq_sequence_records_scd" 2022-07-30 02:59:35 normalization > 02:58:43.085281 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.sidekiq_sequence_records_scd 2022-07-30 02:59:35 normalization > 02:58:43.085529 [debug] [Thread-6 ]: Compiling model.airbyte_utils.sidekiq_sequence_records_scd 2022-07-30 02:59:35 normalization > 02:58:43.121853 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.sidekiq_sequence_records_scd" 2022-07-30 02:59:35 normalization > 02:58:43.122456 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:43.122652 [debug] [Thread-6 ]: Began executing node model.airbyte_utils.sidekiq_sequence_records_scd 2022-07-30 02:59:35 normalization > 02:58:43.126898 [debug] [Thread-6 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:43.154403 [debug] [Thread-1 ]: On model.airbyte_utils.product_reports_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.product_reports_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`product_reports_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:43.317763 [debug] [Thread-6 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/sidekiq_sequence_records_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.sidekiq_sequence_records_scd 2022-07-30 02:59:35 normalization > 02:58:43.318932 [info ] [Thread-6 ]: 02:58:43 + `dwcasa`.airbyte_cdc.`sidekiq_sequence_records_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:43.324404 [debug] [Thread-6 ]: Writing runtime SQL for node "model.airbyte_utils.sidekiq_sequence_records_scd" 2022-07-30 02:59:35 normalization > 02:58:43.325166 [debug] [Thread-6 ]: On model.airbyte_utils.sidekiq_sequence_records_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.sidekiq_sequence_records_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`sidekiq_sequence_records_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('sidekiq_sequence_records_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`sidekiq_sequence_records_stg` 2022-07-30 02:59:35 normalization > -- sidekiq_sequence_records from `dwcasa`.airbyte_cdc._airbyte_raw_sidekiq_sequence_records 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > data, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > current_step, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_sidekiq_sequence_records_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > data, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > current_step, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_sidekiq_sequence_records_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:43.354831 [debug] [Thread-7 ]: On model.airbyte_utils.product_orders_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.product_orders_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`product_orders_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:43.441627 [debug] [Thread-2 ]: On model.airbyte_utils.store_order_quotes_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.store_order_quotes_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.store_order_quotes_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:43.471829 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:43.472922 [info ] [Thread-3 ]: 122 of 201 OK created incremental model airbyte_cdc.shortened_urls_scd.................................................. [CREATE TABLE (19.4k rows, 9.0 MB processed) in 6.77s] 2022-07-30 02:59:35 normalization > 02:58:43.473551 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.shortened_urls_scd 2022-07-30 02:59:35 normalization > 02:58:43.473808 [debug] [Thread-3 ]: Began running node model.airbyte_utils.stockout_events_scd 2022-07-30 02:59:35 normalization > 02:58:43.474250 [info ] [Thread-3 ]: 126 of 201 START incremental model airbyte_cdc.stockout_events_scd...................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:43.475806 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.stockout_events_scd" 2022-07-30 02:59:35 normalization > 02:58:43.476029 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.stockout_events_scd 2022-07-30 02:59:35 normalization > 02:58:43.476302 [debug] [Thread-3 ]: Compiling model.airbyte_utils.stockout_events_scd 2022-07-30 02:59:35 normalization > 02:58:43.497762 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.stockout_events_scd" 2022-07-30 02:59:35 normalization > 02:58:43.498432 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:43.498640 [debug] [Thread-3 ]: Began executing node model.airbyte_utils.stockout_events_scd 2022-07-30 02:59:35 normalization > 02:58:43.501972 [debug] [Thread-3 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:43.678971 [debug] [Thread-3 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/stockout_events_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.stockout_events_scd 2022-07-30 02:59:35 normalization > 02:58:43.680172 [info ] [Thread-3 ]: 02:58:43 + `dwcasa`.airbyte_cdc.`stockout_events_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:43.685995 [debug] [Thread-3 ]: Writing runtime SQL for node "model.airbyte_utils.stockout_events_scd" 2022-07-30 02:59:35 normalization > 02:58:43.686435 [debug] [Thread-3 ]: On model.airbyte_utils.stockout_events_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.stockout_events_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`stockout_events_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('stockout_events_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`stockout_events_stg` 2022-07-30 02:59:35 normalization > -- stockout_events from `dwcasa`.airbyte_cdc._airbyte_raw_stockout_events 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > order_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > created_by, 2022-07-30 02:59:35 normalization > product_id, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > price_when_deleted, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_stockout_events_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > order_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > created_by, 2022-07-30 02:59:35 normalization > product_id, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > price_when_deleted, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_stockout_events_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:43.987463 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:43.988365 [info ] [Thread-2 ]: 121 of 201 OK created incremental model airbyte_cdc.store_order_quotes_scd.............................................. [CREATE TABLE (58.9k rows, 25.6 MB processed) in 9.41s] 2022-07-30 02:59:35 normalization > 02:58:43.994155 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.store_order_quotes_scd 2022-07-30 02:59:35 normalization > 02:58:43.994603 [debug] [Thread-2 ]: Began running node model.airbyte_utils.transfeera_batches_scd 2022-07-30 02:59:35 normalization > 02:58:43.995576 [info ] [Thread-2 ]: 127 of 201 START incremental model airbyte_cdc.transfeera_batches_scd................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:43.997102 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.transfeera_batches_scd" 2022-07-30 02:59:35 normalization > 02:58:43.997263 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.transfeera_batches_scd 2022-07-30 02:59:35 normalization > 02:58:43.997386 [debug] [Thread-2 ]: Compiling model.airbyte_utils.transfeera_batches_scd 2022-07-30 02:59:35 normalization > 02:58:44.022358 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.transfeera_batches_scd" 2022-07-30 02:59:35 normalization > 02:58:44.022808 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:44.023129 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.transfeera_batches_scd 2022-07-30 02:59:35 normalization > 02:58:44.027282 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:44.193341 [debug] [Thread-2 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/transfeera_batches_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.transfeera_batches_scd 2022-07-30 02:59:35 normalization > 02:58:44.194505 [info ] [Thread-2 ]: 02:58:44 + `dwcasa`.airbyte_cdc.`transfeera_batches_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:44.199385 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.transfeera_batches_scd" 2022-07-30 02:59:35 normalization > 02:58:44.199819 [debug] [Thread-2 ]: On model.airbyte_utils.transfeera_batches_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.transfeera_batches_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`transfeera_batches_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('transfeera_batches_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`transfeera_batches_stg` 2022-07-30 02:59:35 normalization > -- transfeera_batches from `dwcasa`.airbyte_cdc._airbyte_raw_transfeera_batches 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > transfeera_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_transfeera_batches_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > transfeera_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_transfeera_batches_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:45.265851 [debug] [Thread-5 ]: On model.airbyte_utils.store_categories_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.store_categories_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.store_categories_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:45.432309 [debug] [Thread-1 ]: On model.airbyte_utils.product_reports_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.product_reports_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.product_reports_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:45.679859 [debug] [Thread-6 ]: On model.airbyte_utils.sidekiq_sequence_records_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.sidekiq_sequence_records_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`sidekiq_sequence_records_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:45.688995 [debug] [Thread-7 ]: On model.airbyte_utils.product_orders_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.product_orders_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > drop view _airbyte_airbyte_cdc.product_orders_stg 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:45.818997 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:45.820419 [info ] [Thread-5 ]: 123 of 201 OK created incremental model airbyte_cdc.store_categories_scd................................................ [CREATE TABLE (2.4k rows, 661.8 KB processed) in 8.41s] 2022-07-30 02:59:35 normalization > 02:58:45.822212 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.store_categories_scd 2022-07-30 02:59:35 normalization > 02:58:45.822600 [debug] [Thread-5 ]: Began running node model.airbyte_utils.terms_scd 2022-07-30 02:59:35 normalization > 02:58:45.826997 [info ] [Thread-5 ]: 128 of 201 START incremental model airbyte_cdc.terms_scd................................................................ [RUN] 2022-07-30 02:59:35 normalization > 02:58:45.831294 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.terms_scd" 2022-07-30 02:59:35 normalization > 02:58:45.831522 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.terms_scd 2022-07-30 02:59:35 normalization > 02:58:45.832183 [debug] [Thread-5 ]: Compiling model.airbyte_utils.terms_scd 2022-07-30 02:59:35 normalization > 02:58:45.864454 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.terms_scd" 2022-07-30 02:59:35 normalization > 02:58:45.864903 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:45.865173 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.terms_scd 2022-07-30 02:59:35 normalization > 02:58:45.872955 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:45.990767 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:45.992189 [info ] [Thread-1 ]: 124 of 201 OK created incremental model airbyte_cdc.product_reports_scd................................................. [CREATE TABLE (211.0 rows, 71.8 KB processed) in 5.73s] 2022-07-30 02:59:35 normalization > 02:58:45.992944 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.product_reports_scd 2022-07-30 02:59:35 normalization > 02:58:45.993337 [debug] [Thread-1 ]: Began running node model.airbyte_utils.responsible_deliveries_scd 2022-07-30 02:59:35 normalization > 02:58:45.993701 [info ] [Thread-1 ]: 129 of 201 START incremental model airbyte_cdc.responsible_deliveries_scd............................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:45.997366 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.responsible_deliveries_scd" 2022-07-30 02:59:35 normalization > 02:58:45.997562 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.responsible_deliveries_scd 2022-07-30 02:59:35 normalization > 02:58:45.997700 [debug] [Thread-1 ]: Compiling model.airbyte_utils.responsible_deliveries_scd 2022-07-30 02:59:35 normalization > 02:58:46.025938 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.responsible_deliveries_scd" 2022-07-30 02:59:35 normalization > 02:58:46.026732 [debug] [Thread-5 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/terms_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.terms_scd 2022-07-30 02:59:35 normalization > 02:58:46.033426 [info ] [Thread-5 ]: 02:58:46 + `dwcasa`.airbyte_cdc.`terms_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:46.034434 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:46.035819 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.responsible_deliveries_scd 2022-07-30 02:59:35 normalization > 02:58:46.047654 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:46.048757 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.terms_scd" 2022-07-30 02:59:35 normalization > 02:58:46.049619 [debug] [Thread-5 ]: On model.airbyte_utils.terms_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.terms_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`terms_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('terms_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`terms_stg` 2022-07-30 02:59:35 normalization > -- terms from `dwcasa`.airbyte_cdc._airbyte_raw_terms 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > link, 2022-07-30 02:59:35 normalization > type, 2022-07-30 02:59:35 normalization > version, 2022-07-30 02:59:35 normalization > mandatory, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_terms_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > link, 2022-07-30 02:59:35 normalization > type, 2022-07-30 02:59:35 normalization > version, 2022-07-30 02:59:35 normalization > mandatory, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_terms_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:46.197346 [debug] [Thread-1 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/responsible_deliveries_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.responsible_deliveries_scd 2022-07-30 02:59:35 normalization > 02:58:46.198604 [info ] [Thread-1 ]: 02:58:46 + `dwcasa`.airbyte_cdc.`responsible_deliveries_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:46.204418 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.responsible_deliveries_scd" 2022-07-30 02:59:35 normalization > 02:58:46.206116 [debug] [Thread-1 ]: On model.airbyte_utils.responsible_deliveries_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.responsible_deliveries_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`responsible_deliveries_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('responsible_deliveries_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`responsible_deliveries_stg` 2022-07-30 02:59:35 normalization > -- responsible_deliveries from `dwcasa`.airbyte_cdc._airbyte_raw_responsible_deliveries 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > email, 2022-07-30 02:59:35 normalization > buyer_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > phone_number, 2022-07-30 02:59:35 normalization > buyer_location_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_responsible_deliveries_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:35 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > scd_data.* 2022-07-30 02:59:35 normalization > from scd_data 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > email, 2022-07-30 02:59:35 normalization > buyer_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > phone_number, 2022-07-30 02:59:35 normalization > buyer_location_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_end_at, 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:35 normalization > _airbyte_responsible_deliveries_hashid 2022-07-30 02:59:35 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:35 normalization > ); 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:46.272145 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:46.273015 [info ] [Thread-7 ]: 113 of 201 OK created incremental model airbyte_cdc.product_orders_scd.................................................. [CREATE TABLE (84.8k rows, 67.4 MB processed) in 20.95s] 2022-07-30 02:59:35 normalization > 02:58:46.274218 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.product_orders_scd 2022-07-30 02:59:35 normalization > 02:58:46.274449 [debug] [Thread-7 ]: Began running node model.airbyte_utils.store_locations_scd 2022-07-30 02:59:35 normalization > 02:58:46.274927 [info ] [Thread-7 ]: 130 of 201 START incremental model airbyte_cdc.store_locations_scd...................................................... [RUN] 2022-07-30 02:59:35 normalization > 02:58:46.275987 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.store_locations_scd" 2022-07-30 02:59:35 normalization > 02:58:46.276157 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.store_locations_scd 2022-07-30 02:59:35 normalization > 02:58:46.276296 [debug] [Thread-7 ]: Compiling model.airbyte_utils.store_locations_scd 2022-07-30 02:59:35 normalization > 02:58:46.295490 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.store_locations_scd" 2022-07-30 02:59:35 normalization > 02:58:46.295916 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:35 normalization > 02:58:46.296075 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.store_locations_scd 2022-07-30 02:59:35 normalization > 02:58:46.299159 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:35 normalization > 02:58:46.373775 [debug] [Thread-3 ]: On model.airbyte_utils.stockout_events_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.stockout_events_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:35 normalization > delete from `dwcasa`.airbyte_cdc.`stockout_events_scd` where 1=0 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 02:58:46.412799 [debug] [Thread-7 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/store_locations_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.store_locations_scd 2022-07-30 02:59:35 normalization > 02:58:46.414275 [info ] [Thread-7 ]: 02:58:46 + `dwcasa`.airbyte_cdc.`store_locations_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:35 normalization > 02:58:46.418367 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.store_locations_scd" 2022-07-30 02:59:35 normalization > 02:58:46.418759 [debug] [Thread-7 ]: On model.airbyte_utils.store_locations_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.store_locations_scd"} */ 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > create or replace table `dwcasa`.airbyte_cdc.`store_locations_scd` 2022-07-30 02:59:35 normalization > partition by range_bucket( 2022-07-30 02:59:35 normalization > _airbyte_active_row, 2022-07-30 02:59:35 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:35 normalization > OPTIONS() 2022-07-30 02:59:35 normalization > as ( 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > -- depends_on: ref('store_locations_stg') 2022-07-30 02:59:35 normalization > with 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > input_data as ( 2022-07-30 02:59:35 normalization > select * 2022-07-30 02:59:35 normalization > from `dwcasa`._airbyte_airbyte_cdc.`store_locations_stg` 2022-07-30 02:59:35 normalization > -- store_locations from `dwcasa`.airbyte_cdc._airbyte_raw_store_locations 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > 2022-07-30 02:59:35 normalization > scd_data as ( 2022-07-30 02:59:35 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), '')) as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:35 normalization > id, 2022-07-30 02:59:35 normalization > lat, 2022-07-30 02:59:35 normalization > lng, 2022-07-30 02:59:35 normalization > city, 2022-07-30 02:59:35 normalization > name, 2022-07-30 02:59:35 normalization > state, 2022-07-30 02:59:35 normalization > street, 2022-07-30 02:59:35 normalization > zipcode, 2022-07-30 02:59:35 normalization > location, 2022-07-30 02:59:35 normalization > store_id, 2022-07-30 02:59:35 normalization > pipefy_id, 2022-07-30 02:59:35 normalization > created_at, 2022-07-30 02:59:35 normalization > updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_lsn, 2022-07-30 02:59:35 normalization > address_details, 2022-07-30 02:59:35 normalization > google_place_id, 2022-07-30 02:59:35 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:35 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:35 normalization > case when row_number() over ( 2022-07-30 02:59:35 normalization > partition by cast(id as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:35 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:35 normalization > _airbyte_ab_id, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, 2022-07-30 02:59:35 normalization > _airbyte_store_locations_hashid 2022-07-30 02:59:35 normalization > from input_data 2022-07-30 02:59:35 normalization > ), 2022-07-30 02:59:35 normalization > dedup_data as ( 2022-07-30 02:59:35 normalization > select 2022-07-30 02:59:35 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:35 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:35 normalization > row_number() over ( 2022-07-30 02:59:35 normalization > partition by 2022-07-30 02:59:35 normalization > _airbyte_unique_key, 2022-07-30 02:59:35 normalization > _airbyte_start_at, 2022-07-30 02:59:35 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:35 normalization > string 2022-07-30 02:59:35 normalization > ) 2022-07-30 02:59:35 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:36 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:36 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), '')) as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:36 normalization > scd_data.* 2022-07-30 02:59:36 normalization > from scd_data 2022-07-30 02:59:36 normalization > ) 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > lat, 2022-07-30 02:59:36 normalization > lng, 2022-07-30 02:59:36 normalization > city, 2022-07-30 02:59:36 normalization > name, 2022-07-30 02:59:36 normalization > state, 2022-07-30 02:59:36 normalization > street, 2022-07-30 02:59:36 normalization > zipcode, 2022-07-30 02:59:36 normalization > location, 2022-07-30 02:59:36 normalization > store_id, 2022-07-30 02:59:36 normalization > pipefy_id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > address_details, 2022-07-30 02:59:36 normalization > google_place_id, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_start_at, 2022-07-30 02:59:36 normalization > _airbyte_end_at, 2022-07-30 02:59:36 normalization > _airbyte_active_row, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_store_locations_hashid 2022-07-30 02:59:36 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:46.928457 [debug] [Thread-2 ]: On model.airbyte_utils.transfeera_batches_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.transfeera_batches_scd"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:36 normalization > delete from `dwcasa`.airbyte_cdc.`transfeera_batches_scd` where 1=0 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:48.306385 [debug] [Thread-6 ]: On model.airbyte_utils.sidekiq_sequence_records_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.sidekiq_sequence_records_scd"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > drop view _airbyte_airbyte_cdc.sidekiq_sequence_records_stg 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:48.505847 [debug] [Thread-5 ]: On model.airbyte_utils.terms_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.terms_scd"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:36 normalization > delete from `dwcasa`.airbyte_cdc.`terms_scd` where 1=0 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:48.535918 [debug] [Thread-3 ]: On model.airbyte_utils.stockout_events_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.stockout_events_scd"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > drop view _airbyte_airbyte_cdc.stockout_events_stg 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:48.871322 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:48.872712 [debug] [Thread-1 ]: On model.airbyte_utils.responsible_deliveries_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.responsible_deliveries_scd"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:36 normalization > delete from `dwcasa`.airbyte_cdc.`responsible_deliveries_scd` where 1=0 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:48.874134 [info ] [Thread-6 ]: 125 of 201 OK created incremental model airbyte_cdc.sidekiq_sequence_records_scd........................................ [CREATE TABLE (2.0 rows, 751.0 Bytes processed) in 5.79s] 2022-07-30 02:59:36 normalization > 02:58:48.879712 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.sidekiq_sequence_records_scd 2022-07-30 02:59:36 normalization > 02:58:48.880282 [debug] [Thread-6 ]: Began running node model.airbyte_utils.stores_scd 2022-07-30 02:59:36 normalization > 02:58:48.880819 [info ] [Thread-6 ]: 131 of 201 START incremental model airbyte_cdc.stores_scd............................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:58:48.882173 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.stores_scd" 2022-07-30 02:59:36 normalization > 02:58:48.882416 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.stores_scd 2022-07-30 02:59:36 normalization > 02:58:48.882557 [debug] [Thread-6 ]: Compiling model.airbyte_utils.stores_scd 2022-07-30 02:59:36 normalization > 02:58:48.914670 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.stores_scd" 2022-07-30 02:59:36 normalization > 02:58:48.918821 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:48.919170 [debug] [Thread-6 ]: Began executing node model.airbyte_utils.stores_scd 2022-07-30 02:59:36 normalization > 02:58:48.924402 [debug] [Thread-6 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:58:48.990414 [debug] [Thread-2 ]: On model.airbyte_utils.transfeera_batches_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.transfeera_batches_scd"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > drop view _airbyte_airbyte_cdc.transfeera_batches_stg 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:49.096361 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:49.097793 [info ] [Thread-3 ]: 126 of 201 OK created incremental model airbyte_cdc.stockout_events_scd................................................. [CREATE TABLE (1.1k rows, 388.5 KB processed) in 5.62s] 2022-07-30 02:59:36 normalization > 02:58:49.098419 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.stockout_events_scd 2022-07-30 02:59:36 normalization > 02:58:49.098765 [debug] [Thread-3 ]: Began running node model.airbyte_utils.term_acceptances_scd 2022-07-30 02:59:36 normalization > 02:58:49.100572 [info ] [Thread-3 ]: 132 of 201 START incremental model airbyte_cdc.term_acceptances_scd..................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:58:49.101856 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.term_acceptances_scd" 2022-07-30 02:59:36 normalization > 02:58:49.102088 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.term_acceptances_scd 2022-07-30 02:59:36 normalization > 02:58:49.102395 [debug] [Thread-3 ]: Compiling model.airbyte_utils.term_acceptances_scd 2022-07-30 02:59:36 normalization > 02:58:49.121690 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.term_acceptances_scd" 2022-07-30 02:59:36 normalization > 02:58:49.122206 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:49.122367 [debug] [Thread-3 ]: Began executing node model.airbyte_utils.term_acceptances_scd 2022-07-30 02:59:36 normalization > 02:58:49.127136 [debug] [Thread-3 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:58:49.155724 [debug] [Thread-6 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/stores_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.stores_scd 2022-07-30 02:59:36 normalization > 02:58:49.166481 [debug] [Thread-7 ]: On model.airbyte_utils.store_locations_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.store_locations_scd"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:36 normalization > delete from `dwcasa`.airbyte_cdc.`store_locations_scd` where 1=0 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:49.170731 [info ] [Thread-6 ]: 02:58:49 + `dwcasa`.airbyte_cdc.`stores_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:58:49.178576 [debug] [Thread-6 ]: Writing runtime SQL for node "model.airbyte_utils.stores_scd" 2022-07-30 02:59:36 normalization > 02:58:49.179701 [debug] [Thread-6 ]: On model.airbyte_utils.stores_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.stores_scd"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`stores_scd` 2022-07-30 02:59:36 normalization > partition by range_bucket( 2022-07-30 02:59:36 normalization > _airbyte_active_row, 2022-07-30 02:59:36 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:36 normalization > ) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- depends_on: ref('stores_stg') 2022-07-30 02:59:36 normalization > with 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > input_data as ( 2022-07-30 02:59:36 normalization > select * 2022-07-30 02:59:36 normalization > from `dwcasa`._airbyte_airbyte_cdc.`stores_stg` 2022-07-30 02:59:36 normalization > -- stores from `dwcasa`.airbyte_cdc._airbyte_raw_stores 2022-07-30 02:59:36 normalization > ), 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > scd_data as ( 2022-07-30 02:59:36 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), '')) as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > cnae, 2022-07-30 02:59:36 normalization > cnpj, 2022-07-30 02:59:36 normalization > block, 2022-07-30 02:59:36 normalization > omie_id, 2022-07-30 02:59:36 normalization > pix_key, 2022-07-30 02:59:36 normalization > website, 2022-07-30 02:59:36 normalization > activity, 2022-07-30 02:59:36 normalization > priority, 2022-07-30 02:59:36 normalization > bank_code, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > store_type, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > bank_branch, 2022-07-30 02:59:36 normalization > sales_email, 2022-07-30 02:59:36 normalization > bank_account, 2022-07-30 02:59:36 normalization > manufacturer, 2022-07-30 02:59:36 normalization > oico_partner, 2022-07-30 02:59:36 normalization > payment_type, 2022-07-30 02:59:36 normalization > trading_name, 2022-07-30 02:59:36 normalization > business_name, 2022-07-30 02:59:36 normalization > sales_whatsapp, 2022-07-30 02:59:36 normalization > national_simple, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > state_registration, 2022-07-30 02:59:36 normalization > minimum_response_time, 2022-07-30 02:59:36 normalization > municipal_registration, 2022-07-30 02:59:36 normalization > sales_point_of_contact, 2022-07-30 02:59:36 normalization > payment_recommendations, 2022-07-30 02:59:36 normalization > bank_account_check_digit, 2022-07-30 02:59:36 normalization > bank_account_holder_name, 2022-07-30 02:59:36 normalization > bank_account_holder_document, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:36 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:36 normalization > partition by cast(id as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ) 2022-07-30 02:59:36 normalization > order by 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:36 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:36 normalization > case when row_number() over ( 2022-07-30 02:59:36 normalization > partition by cast(id as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ) 2022-07-30 02:59:36 normalization > order by 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:36 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > _airbyte_stores_hashid 2022-07-30 02:59:36 normalization > from input_data 2022-07-30 02:59:36 normalization > ), 2022-07-30 02:59:36 normalization > dedup_data as ( 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:36 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:36 normalization > row_number() over ( 2022-07-30 02:59:36 normalization > partition by 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > _airbyte_start_at, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ) 2022-07-30 02:59:36 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:36 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:36 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), '')) as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:36 normalization > scd_data.* 2022-07-30 02:59:36 normalization > from scd_data 2022-07-30 02:59:36 normalization > ) 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > cnae, 2022-07-30 02:59:36 normalization > cnpj, 2022-07-30 02:59:36 normalization > block, 2022-07-30 02:59:36 normalization > omie_id, 2022-07-30 02:59:36 normalization > pix_key, 2022-07-30 02:59:36 normalization > website, 2022-07-30 02:59:36 normalization > activity, 2022-07-30 02:59:36 normalization > priority, 2022-07-30 02:59:36 normalization > bank_code, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > store_type, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > bank_branch, 2022-07-30 02:59:36 normalization > sales_email, 2022-07-30 02:59:36 normalization > bank_account, 2022-07-30 02:59:36 normalization > manufacturer, 2022-07-30 02:59:36 normalization > oico_partner, 2022-07-30 02:59:36 normalization > payment_type, 2022-07-30 02:59:36 normalization > trading_name, 2022-07-30 02:59:36 normalization > business_name, 2022-07-30 02:59:36 normalization > sales_whatsapp, 2022-07-30 02:59:36 normalization > national_simple, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > state_registration, 2022-07-30 02:59:36 normalization > minimum_response_time, 2022-07-30 02:59:36 normalization > municipal_registration, 2022-07-30 02:59:36 normalization > sales_point_of_contact, 2022-07-30 02:59:36 normalization > payment_recommendations, 2022-07-30 02:59:36 normalization > bank_account_check_digit, 2022-07-30 02:59:36 normalization > bank_account_holder_name, 2022-07-30 02:59:36 normalization > bank_account_holder_document, 2022-07-30 02:59:36 normalization > _airbyte_start_at, 2022-07-30 02:59:36 normalization > _airbyte_end_at, 2022-07-30 02:59:36 normalization > _airbyte_active_row, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_stores_hashid 2022-07-30 02:59:36 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:49.308284 [debug] [Thread-3 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/term_acceptances_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.term_acceptances_scd 2022-07-30 02:59:36 normalization > 02:58:49.309435 [info ] [Thread-3 ]: 02:58:49 + `dwcasa`.airbyte_cdc.`term_acceptances_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:58:49.314419 [debug] [Thread-3 ]: Writing runtime SQL for node "model.airbyte_utils.term_acceptances_scd" 2022-07-30 02:59:36 normalization > 02:58:49.314858 [debug] [Thread-3 ]: On model.airbyte_utils.term_acceptances_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.term_acceptances_scd"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`term_acceptances_scd` 2022-07-30 02:59:36 normalization > partition by range_bucket( 2022-07-30 02:59:36 normalization > _airbyte_active_row, 2022-07-30 02:59:36 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:36 normalization > ) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- depends_on: ref('term_acceptances_stg') 2022-07-30 02:59:36 normalization > with 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > input_data as ( 2022-07-30 02:59:36 normalization > select * 2022-07-30 02:59:36 normalization > from `dwcasa`._airbyte_airbyte_cdc.`term_acceptances_stg` 2022-07-30 02:59:36 normalization > -- term_acceptances from `dwcasa`.airbyte_cdc._airbyte_raw_term_acceptances 2022-07-30 02:59:36 normalization > ), 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > scd_data as ( 2022-07-30 02:59:36 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), '')) as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > term_id, 2022-07-30 02:59:36 normalization > buyer_id, 2022-07-30 02:59:36 normalization > store_id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:36 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:36 normalization > partition by cast(id as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ) 2022-07-30 02:59:36 normalization > order by 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:36 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:36 normalization > case when row_number() over ( 2022-07-30 02:59:36 normalization > partition by cast(id as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ) 2022-07-30 02:59:36 normalization > order by 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:36 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > _airbyte_term_acceptances_hashid 2022-07-30 02:59:36 normalization > from input_data 2022-07-30 02:59:36 normalization > ), 2022-07-30 02:59:36 normalization > dedup_data as ( 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:36 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:36 normalization > row_number() over ( 2022-07-30 02:59:36 normalization > partition by 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > _airbyte_start_at, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ) 2022-07-30 02:59:36 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:36 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:36 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), '')) as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:36 normalization > scd_data.* 2022-07-30 02:59:36 normalization > from scd_data 2022-07-30 02:59:36 normalization > ) 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > term_id, 2022-07-30 02:59:36 normalization > buyer_id, 2022-07-30 02:59:36 normalization > store_id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_start_at, 2022-07-30 02:59:36 normalization > _airbyte_end_at, 2022-07-30 02:59:36 normalization > _airbyte_active_row, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_term_acceptances_hashid 2022-07-30 02:59:36 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:49.549929 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:49.550874 [info ] [Thread-2 ]: 127 of 201 OK created incremental model airbyte_cdc.transfeera_batches_scd.............................................. [CREATE TABLE (1.8k rows, 535.0 KB processed) in 5.55s] 2022-07-30 02:59:36 normalization > 02:58:49.551604 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.transfeera_batches_scd 2022-07-30 02:59:36 normalization > 02:58:49.551965 [debug] [Thread-2 ]: Began running node model.airbyte_utils.store_users_scd 2022-07-30 02:59:36 normalization > 02:58:49.552620 [info ] [Thread-2 ]: 133 of 201 START incremental model airbyte_cdc.store_users_scd.......................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:58:49.553561 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.store_users_scd" 2022-07-30 02:59:36 normalization > 02:58:49.553735 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.store_users_scd 2022-07-30 02:59:36 normalization > 02:58:49.553869 [debug] [Thread-2 ]: Compiling model.airbyte_utils.store_users_scd 2022-07-30 02:59:36 normalization > 02:58:49.573009 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.store_users_scd" 2022-07-30 02:59:36 normalization > 02:58:49.573459 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:49.573612 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.store_users_scd 2022-07-30 02:59:36 normalization > 02:58:49.579157 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:58:49.700306 [debug] [Thread-2 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/store_users_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.store_users_scd 2022-07-30 02:59:36 normalization > 02:58:49.702125 [info ] [Thread-2 ]: 02:58:49 + `dwcasa`.airbyte_cdc.`store_users_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:58:49.707347 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.store_users_scd" 2022-07-30 02:59:36 normalization > 02:58:49.707806 [debug] [Thread-2 ]: On model.airbyte_utils.store_users_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.store_users_scd"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`store_users_scd` 2022-07-30 02:59:36 normalization > partition by range_bucket( 2022-07-30 02:59:36 normalization > _airbyte_active_row, 2022-07-30 02:59:36 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:36 normalization > ) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- depends_on: ref('store_users_stg') 2022-07-30 02:59:36 normalization > with 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > input_data as ( 2022-07-30 02:59:36 normalization > select * 2022-07-30 02:59:36 normalization > from `dwcasa`._airbyte_airbyte_cdc.`store_users_stg` 2022-07-30 02:59:36 normalization > -- store_users from `dwcasa`.airbyte_cdc._airbyte_raw_store_users 2022-07-30 02:59:36 normalization > ), 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > scd_data as ( 2022-07-30 02:59:36 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), '')) as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > name, 2022-07-30 02:59:36 normalization > email, 2022-07-30 02:59:36 normalization > active, 2022-07-30 02:59:36 normalization > store_id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > phone_number, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > encrypted_password, 2022-07-30 02:59:36 normalization > remember_created_at, 2022-07-30 02:59:36 normalization > reset_password_token, 2022-07-30 02:59:36 normalization > reset_password_sent_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:36 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:36 normalization > partition by cast(id as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ) 2022-07-30 02:59:36 normalization > order by 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:36 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:36 normalization > case when row_number() over ( 2022-07-30 02:59:36 normalization > partition by cast(id as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ) 2022-07-30 02:59:36 normalization > order by 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:36 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > _airbyte_store_users_hashid 2022-07-30 02:59:36 normalization > from input_data 2022-07-30 02:59:36 normalization > ), 2022-07-30 02:59:36 normalization > dedup_data as ( 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:36 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:36 normalization > row_number() over ( 2022-07-30 02:59:36 normalization > partition by 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > _airbyte_start_at, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ) 2022-07-30 02:59:36 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:36 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:36 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), '')) as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:36 normalization > scd_data.* 2022-07-30 02:59:36 normalization > from scd_data 2022-07-30 02:59:36 normalization > ) 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > name, 2022-07-30 02:59:36 normalization > email, 2022-07-30 02:59:36 normalization > active, 2022-07-30 02:59:36 normalization > store_id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > phone_number, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > encrypted_password, 2022-07-30 02:59:36 normalization > remember_created_at, 2022-07-30 02:59:36 normalization > reset_password_token, 2022-07-30 02:59:36 normalization > reset_password_sent_at, 2022-07-30 02:59:36 normalization > _airbyte_start_at, 2022-07-30 02:59:36 normalization > _airbyte_end_at, 2022-07-30 02:59:36 normalization > _airbyte_active_row, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_store_users_hashid 2022-07-30 02:59:36 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:50.535056 [debug] [Thread-5 ]: On model.airbyte_utils.terms_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.terms_scd"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > drop view _airbyte_airbyte_cdc.terms_stg 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:50.879143 [debug] [Thread-1 ]: On model.airbyte_utils.responsible_deliveries_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.responsible_deliveries_scd"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > drop view _airbyte_airbyte_cdc.responsible_deliveries_stg 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:51.097881 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:51.098870 [info ] [Thread-5 ]: 128 of 201 OK created incremental model airbyte_cdc.terms_scd........................................................... [CREATE TABLE (2.0 rows, 718.0 Bytes processed) in 5.27s] 2022-07-30 02:59:36 normalization > 02:58:51.099286 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.terms_scd 2022-07-30 02:59:36 normalization > 02:58:51.099587 [debug] [Thread-5 ]: Began running node model.airbyte_utils.store_orders_scd 2022-07-30 02:59:36 normalization > 02:58:51.100243 [info ] [Thread-5 ]: 134 of 201 START incremental model airbyte_cdc.store_orders_scd......................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:58:51.101154 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.store_orders_scd" 2022-07-30 02:59:36 normalization > 02:58:51.101321 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.store_orders_scd 2022-07-30 02:59:36 normalization > 02:58:51.101455 [debug] [Thread-5 ]: Compiling model.airbyte_utils.store_orders_scd 2022-07-30 02:59:36 normalization > 02:58:51.128049 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.store_orders_scd" 2022-07-30 02:59:36 normalization > 02:58:51.128686 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:51.128888 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.store_orders_scd 2022-07-30 02:59:36 normalization > 02:58:51.134243 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:58:51.259088 [debug] [Thread-5 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/store_orders_scd?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.store_orders_scd 2022-07-30 02:59:36 normalization > 02:58:51.260288 [info ] [Thread-5 ]: 02:58:51 + `dwcasa`.airbyte_cdc.`store_orders_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:58:51.264224 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.store_orders_scd" 2022-07-30 02:59:36 normalization > 02:58:51.264627 [debug] [Thread-5 ]: On model.airbyte_utils.store_orders_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.store_orders_scd"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`store_orders_scd` 2022-07-30 02:59:36 normalization > partition by range_bucket( 2022-07-30 02:59:36 normalization > _airbyte_active_row, 2022-07-30 02:59:36 normalization > generate_array(0, 1, 1) 2022-07-30 02:59:36 normalization > ) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- depends_on: ref('store_orders_stg') 2022-07-30 02:59:36 normalization > with 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > input_data as ( 2022-07-30 02:59:36 normalization > select * 2022-07-30 02:59:36 normalization > from `dwcasa`._airbyte_airbyte_cdc.`store_orders_stg` 2022-07-30 02:59:36 normalization > -- store_orders from `dwcasa`.airbyte_cdc._airbyte_raw_store_orders 2022-07-30 02:59:36 normalization > ), 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > scd_data as ( 2022-07-30 02:59:36 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), '')) as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ))) as _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > order_id, 2022-07-30 02:59:36 normalization > store_id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > campaign_last_sent_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at as _airbyte_start_at, 2022-07-30 02:59:36 normalization > lag(_ab_cdc_updated_at) over ( 2022-07-30 02:59:36 normalization > partition by cast(id as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ) 2022-07-30 02:59:36 normalization > order by 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:36 normalization > ) as _airbyte_end_at, 2022-07-30 02:59:36 normalization > case when row_number() over ( 2022-07-30 02:59:36 normalization > partition by cast(id as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ) 2022-07-30 02:59:36 normalization > order by 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at is null asc, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at desc, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at desc 2022-07-30 02:59:36 normalization > ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > _airbyte_store_orders_hashid 2022-07-30 02:59:36 normalization > from input_data 2022-07-30 02:59:36 normalization > ), 2022-07-30 02:59:36 normalization > dedup_data as ( 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-07-30 02:59:36 normalization > -- additionally, we generate a unique key for the scd table 2022-07-30 02:59:36 normalization > row_number() over ( 2022-07-30 02:59:36 normalization > partition by 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > _airbyte_start_at, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), cast(_ab_cdc_updated_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ) 2022-07-30 02:59:36 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-07-30 02:59:36 normalization > ) as _airbyte_row_num, 2022-07-30 02:59:36 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ), '')) as 2022-07-30 02:59:36 normalization > string 2022-07-30 02:59:36 normalization > ))) as _airbyte_unique_key_scd, 2022-07-30 02:59:36 normalization > scd_data.* 2022-07-30 02:59:36 normalization > from scd_data 2022-07-30 02:59:36 normalization > ) 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > _airbyte_unique_key_scd, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > order_id, 2022-07-30 02:59:36 normalization > store_id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > campaign_last_sent_at, 2022-07-30 02:59:36 normalization > _airbyte_start_at, 2022-07-30 02:59:36 normalization > _airbyte_end_at, 2022-07-30 02:59:36 normalization > _airbyte_active_row, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_store_orders_hashid 2022-07-30 02:59:36 normalization > from dedup_data where _airbyte_row_num = 1 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:51.438081 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:51.439101 [info ] [Thread-1 ]: 129 of 201 OK created incremental model airbyte_cdc.responsible_deliveries_scd.......................................... [CREATE TABLE (2.7k rows, 947.2 KB processed) in 5.44s] 2022-07-30 02:59:36 normalization > 02:58:51.439566 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.responsible_deliveries_scd 2022-07-30 02:59:36 normalization > 02:58:51.439910 [debug] [Thread-1 ]: Began running node model.airbyte_utils.active_storage_variant_records 2022-07-30 02:59:36 normalization > 02:58:51.440274 [info ] [Thread-1 ]: 135 of 201 START incremental model airbyte_cdc.active_storage_variant_records........................................... [RUN] 2022-07-30 02:59:36 normalization > 02:58:51.441748 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.active_storage_variant_records" 2022-07-30 02:59:36 normalization > 02:58:51.441915 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.active_storage_variant_records 2022-07-30 02:59:36 normalization > 02:58:51.442048 [debug] [Thread-1 ]: Compiling model.airbyte_utils.active_storage_variant_records 2022-07-30 02:59:36 normalization > 02:58:51.450857 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.active_storage_variant_records" 2022-07-30 02:59:36 normalization > 02:58:51.451310 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:51.451512 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.active_storage_variant_records 2022-07-30 02:59:36 normalization > 02:58:51.454811 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:58:51.474292 [debug] [Thread-7 ]: On model.airbyte_utils.store_locations_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.store_locations_scd"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > drop view _airbyte_airbyte_cdc.store_locations_stg 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:51.585812 [debug] [Thread-1 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/active_storage_variant_records?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.active_storage_variant_records 2022-07-30 02:59:36 normalization > 02:58:51.587216 [info ] [Thread-1 ]: 02:58:51 + `dwcasa`.airbyte_cdc.`active_storage_variant_records`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:58:51.592475 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.active_storage_variant_records" 2022-07-30 02:59:36 normalization > 02:58:51.592934 [debug] [Thread-1 ]: On model.airbyte_utils.active_storage_variant_records: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.active_storage_variant_records"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`active_storage_variant_records` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`active_storage_variant_records_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > blob_id, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > variation_digest, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_active_storage_variant_records_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`active_storage_variant_records_scd` 2022-07-30 02:59:36 normalization > -- active_storage_variant_records from `dwcasa`.airbyte_cdc._airbyte_raw_active_storage_variant_records 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:51.820924 [debug] [Thread-6 ]: On model.airbyte_utils.stores_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.stores_scd"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:36 normalization > delete from `dwcasa`.airbyte_cdc.`stores_scd` where 1=0 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:51.975460 [debug] [Thread-3 ]: On model.airbyte_utils.term_acceptances_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.term_acceptances_scd"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:36 normalization > delete from `dwcasa`.airbyte_cdc.`term_acceptances_scd` where 1=0 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:52.038734 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:52.040914 [info ] [Thread-7 ]: 130 of 201 OK created incremental model airbyte_cdc.store_locations_scd................................................. [CREATE TABLE (1.3k rows, 808.6 KB processed) in 5.77s] 2022-07-30 02:59:36 normalization > 02:58:52.042157 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.store_locations_scd 2022-07-30 02:59:36 normalization > 02:58:52.042536 [debug] [Thread-7 ]: Began running node model.airbyte_utils.buyer_contacts 2022-07-30 02:59:36 normalization > 02:58:52.045471 [info ] [Thread-7 ]: 136 of 201 START incremental model airbyte_cdc.buyer_contacts........................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:58:52.047035 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_contacts" 2022-07-30 02:59:36 normalization > 02:58:52.047229 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.buyer_contacts 2022-07-30 02:59:36 normalization > 02:58:52.047353 [debug] [Thread-7 ]: Compiling model.airbyte_utils.buyer_contacts 2022-07-30 02:59:36 normalization > 02:58:52.069302 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.buyer_contacts" 2022-07-30 02:59:36 normalization > 02:58:52.070292 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:52.070496 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.buyer_contacts 2022-07-30 02:59:36 normalization > 02:58:52.077319 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:58:52.276440 [debug] [Thread-7 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/buyer_contacts?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.buyer_contacts 2022-07-30 02:59:36 normalization > 02:58:52.277786 [info ] [Thread-7 ]: 02:58:52 + `dwcasa`.airbyte_cdc.`buyer_contacts`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:58:52.287245 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.buyer_contacts" 2022-07-30 02:59:36 normalization > 02:58:52.288518 [debug] [Thread-7 ]: On model.airbyte_utils.buyer_contacts: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_contacts"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`buyer_contacts` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`buyer_contacts_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > name, 2022-07-30 02:59:36 normalization > email, 2022-07-30 02:59:36 normalization > buyer_id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > phone_number, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_buyer_contacts_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`buyer_contacts_scd` 2022-07-30 02:59:36 normalization > -- buyer_contacts from `dwcasa`.airbyte_cdc._airbyte_raw_buyer_contacts 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:52.362804 [debug] [Thread-8 ]: On model.airbyte_utils.product_canonical_categories_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.product_canonical_categories_scd"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:36 normalization > delete from `dwcasa`.airbyte_cdc.`product_canonical_categories_scd` where 1=0 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:52.406381 [debug] [Thread-2 ]: On model.airbyte_utils.store_users_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.store_users_scd"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:36 normalization > delete from `dwcasa`.airbyte_cdc.`store_users_scd` where 1=0 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:53.861145 [debug] [Thread-6 ]: On model.airbyte_utils.stores_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.stores_scd"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > drop view _airbyte_airbyte_cdc.stores_stg 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:54.191916 [debug] [Thread-5 ]: On model.airbyte_utils.store_orders_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.store_orders_scd"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:36 normalization > delete from `dwcasa`.airbyte_cdc.`store_orders_scd` where 1=0 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:54.343080 [debug] [Thread-3 ]: On model.airbyte_utils.term_acceptances_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.term_acceptances_scd"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > drop view _airbyte_airbyte_cdc.term_acceptances_stg 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:54.382018 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:54.385836 [info ] [Thread-7 ]: 136 of 201 OK created incremental model airbyte_cdc.buyer_contacts...................................................... [CREATE TABLE (5.0 rows, 1.2 KB processed) in 2.34s] 2022-07-30 02:59:36 normalization > 02:58:54.387547 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.buyer_contacts 2022-07-30 02:59:36 normalization > 02:58:54.387985 [debug] [Thread-7 ]: Began running node model.airbyte_utils.buyer_locations 2022-07-30 02:59:36 normalization > 02:58:54.388553 [info ] [Thread-7 ]: 137 of 201 START incremental model airbyte_cdc.buyer_locations.......................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:58:54.389571 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_locations" 2022-07-30 02:59:36 normalization > 02:58:54.389748 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.buyer_locations 2022-07-30 02:59:36 normalization > 02:58:54.389882 [debug] [Thread-7 ]: Compiling model.airbyte_utils.buyer_locations 2022-07-30 02:59:36 normalization > 02:58:54.400904 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.buyer_locations" 2022-07-30 02:59:36 normalization > 02:58:54.401485 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:54.401661 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.buyer_locations 2022-07-30 02:59:36 normalization > 02:58:54.405796 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:58:54.449828 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:54.450975 [info ] [Thread-6 ]: 131 of 201 OK created incremental model airbyte_cdc.stores_scd.......................................................... [CREATE TABLE (1.2k rows, 1.1 MB processed) in 5.57s] 2022-07-30 02:59:36 normalization > 02:58:54.451503 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.stores_scd 2022-07-30 02:59:36 normalization > 02:58:54.451855 [debug] [Thread-6 ]: Began running node model.airbyte_utils.buyer_contact_rules 2022-07-30 02:59:36 normalization > 02:58:54.452236 [info ] [Thread-6 ]: 138 of 201 START incremental model airbyte_cdc.buyer_contact_rules...................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:58:54.455888 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_contact_rules" 2022-07-30 02:59:36 normalization > 02:58:54.456332 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.buyer_contact_rules 2022-07-30 02:59:36 normalization > 02:58:54.458204 [debug] [Thread-6 ]: Compiling model.airbyte_utils.buyer_contact_rules 2022-07-30 02:59:36 normalization > 02:58:54.475753 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.buyer_contact_rules" 2022-07-30 02:59:36 normalization > 02:58:54.476629 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:54.476964 [debug] [Thread-6 ]: Began executing node model.airbyte_utils.buyer_contact_rules 2022-07-30 02:59:36 normalization > 02:58:54.483973 [debug] [Thread-6 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:58:54.607682 [debug] [Thread-7 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/buyer_locations?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.buyer_locations 2022-07-30 02:59:36 normalization > 02:58:54.609288 [info ] [Thread-7 ]: 02:58:54 + `dwcasa`.airbyte_cdc.`buyer_locations`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:58:54.615020 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.buyer_locations" 2022-07-30 02:59:36 normalization > 02:58:54.615911 [debug] [Thread-7 ]: On model.airbyte_utils.buyer_locations: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_locations"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`buyer_locations` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`buyer_locations_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > lat, 2022-07-30 02:59:36 normalization > lng, 2022-07-30 02:59:36 normalization > city, 2022-07-30 02:59:36 normalization > name, 2022-07-30 02:59:36 normalization > state, 2022-07-30 02:59:36 normalization > street, 2022-07-30 02:59:36 normalization > zipcode, 2022-07-30 02:59:36 normalization > buyer_id, 2022-07-30 02:59:36 normalization > location, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > address_details, 2022-07-30 02:59:36 normalization > google_place_id, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_buyer_locations_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`buyer_locations_scd` 2022-07-30 02:59:36 normalization > -- buyer_locations from `dwcasa`.airbyte_cdc._airbyte_raw_buyer_locations 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:54.624992 [debug] [Thread-6 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/buyer_contact_rules?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.buyer_contact_rules 2022-07-30 02:59:36 normalization > 02:58:54.632021 [info ] [Thread-6 ]: 02:58:54 + `dwcasa`.airbyte_cdc.`buyer_contact_rules`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:58:54.635356 [debug] [Thread-8 ]: On model.airbyte_utils.product_canonical_categories_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.product_canonical_categories_scd"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > drop view _airbyte_airbyte_cdc.product_canonical_categories_stg 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:54.640524 [debug] [Thread-6 ]: Writing runtime SQL for node "model.airbyte_utils.buyer_contact_rules" 2022-07-30 02:59:36 normalization > 02:58:54.646596 [debug] [Thread-6 ]: On model.airbyte_utils.buyer_contact_rules: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_contact_rules"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`buyer_contact_rules` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`buyer_contact_rules_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > order_id, 2022-07-30 02:59:36 normalization > categories, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > buyer_contact_id, 2022-07-30 02:59:36 normalization > buyer_location_id, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_buyer_contact_rules_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`buyer_contact_rules_scd` 2022-07-30 02:59:36 normalization > -- buyer_contact_rules from `dwcasa`.airbyte_cdc._airbyte_raw_buyer_contact_rules 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:54.702800 [debug] [Thread-2 ]: On model.airbyte_utils.store_users_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.store_users_scd"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > drop view _airbyte_airbyte_cdc.store_users_stg 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:54.874864 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:54.877178 [info ] [Thread-1 ]: 135 of 201 OK created incremental model airbyte_cdc.active_storage_variant_records...................................... [CREATE TABLE (0.0 rows, 0 processed) in 3.44s] 2022-07-30 02:59:36 normalization > 02:58:54.879786 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.active_storage_variant_records 2022-07-30 02:59:36 normalization > 02:58:54.881590 [debug] [Thread-1 ]: Began running node model.airbyte_utils.categories 2022-07-30 02:59:36 normalization > 02:58:54.882213 [info ] [Thread-1 ]: 139 of 201 START incremental model airbyte_cdc.categories............................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:58:54.884679 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.categories" 2022-07-30 02:59:36 normalization > 02:58:54.884909 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.categories 2022-07-30 02:59:36 normalization > 02:58:54.885033 [debug] [Thread-1 ]: Compiling model.airbyte_utils.categories 2022-07-30 02:59:36 normalization > 02:58:54.908392 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:54.919347 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.categories" 2022-07-30 02:59:36 normalization > 02:58:54.922807 [info ] [Thread-3 ]: 132 of 201 OK created incremental model airbyte_cdc.term_acceptances_scd................................................ [CREATE TABLE (1.2k rows, 349.3 KB processed) in 5.82s] 2022-07-30 02:59:36 normalization > 02:58:54.926819 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:54.927155 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.categories 2022-07-30 02:59:36 normalization > 02:58:54.936355 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:58:54.939896 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.term_acceptances_scd 2022-07-30 02:59:36 normalization > 02:58:54.940306 [debug] [Thread-3 ]: Began running node model.airbyte_utils.buyer_uploads 2022-07-30 02:59:36 normalization > 02:58:54.942187 [info ] [Thread-3 ]: 140 of 201 START incremental model airbyte_cdc.buyer_uploads............................................................ [RUN] 2022-07-30 02:59:36 normalization > 02:58:54.946307 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_uploads" 2022-07-30 02:59:36 normalization > 02:58:54.948914 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.buyer_uploads 2022-07-30 02:59:36 normalization > 02:58:54.949166 [debug] [Thread-3 ]: Compiling model.airbyte_utils.buyer_uploads 2022-07-30 02:59:36 normalization > 02:58:54.980369 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.buyer_uploads" 2022-07-30 02:59:36 normalization > 02:58:54.982308 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:54.982763 [debug] [Thread-3 ]: Began executing node model.airbyte_utils.buyer_uploads 2022-07-30 02:59:36 normalization > 02:58:55.008125 [debug] [Thread-3 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:58:55.189725 [debug] [Thread-1 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/categories?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.categories 2022-07-30 02:59:36 normalization > 02:58:55.191523 [info ] [Thread-1 ]: 02:58:55 + `dwcasa`.airbyte_cdc.`categories`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:58:55.196942 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.categories" 2022-07-30 02:59:36 normalization > 02:58:55.197463 [debug] [Thread-1 ]: On model.airbyte_utils.categories: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.categories"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`categories` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`categories_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > name, 2022-07-30 02:59:36 normalization > level, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > category_id, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > visible_on_store_sign_up, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_categories_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`categories_scd` 2022-07-30 02:59:36 normalization > -- categories from `dwcasa`.airbyte_cdc._airbyte_raw_categories 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:55.223673 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:55.224962 [info ] [Thread-8 ]: 115 of 201 OK created incremental model airbyte_cdc.product_canonical_categories_scd.................................... [CREATE TABLE (65.9k rows, 18.4 MB processed) in 28.40s] 2022-07-30 02:59:36 normalization > 02:58:55.226894 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.product_canonical_categories_scd 2022-07-30 02:59:36 normalization > 02:58:55.227156 [debug] [Thread-8 ]: Began running node model.airbyte_utils.buyer_public_informations 2022-07-30 02:59:36 normalization > 02:58:55.228162 [info ] [Thread-8 ]: 141 of 201 START incremental model airbyte_cdc.buyer_public_informations................................................ [RUN] 2022-07-30 02:59:36 normalization > 02:58:55.229694 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_public_informations" 2022-07-30 02:59:36 normalization > 02:58:55.229853 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.buyer_public_informations 2022-07-30 02:59:36 normalization > 02:58:55.229976 [debug] [Thread-8 ]: Compiling model.airbyte_utils.buyer_public_informations 2022-07-30 02:59:36 normalization > 02:58:55.340369 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:55.342159 [debug] [Thread-3 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/buyer_uploads?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.buyer_uploads 2022-07-30 02:59:36 normalization > 02:58:55.343147 [info ] [Thread-2 ]: 133 of 201 OK created incremental model airbyte_cdc.store_users_scd..................................................... [CREATE TABLE (226.0 rows, 141.6 KB processed) in 5.79s] 2022-07-30 02:59:36 normalization > 02:58:55.344950 [info ] [Thread-3 ]: 02:58:55 + `dwcasa`.airbyte_cdc.`buyer_uploads`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:58:55.345975 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.store_users_scd 2022-07-30 02:59:36 normalization > 02:58:55.347058 [debug] [Thread-2 ]: Began running node model.airbyte_utils.active_storage_attachments 2022-07-30 02:59:36 normalization > 02:58:55.347482 [info ] [Thread-2 ]: 142 of 201 START incremental model airbyte_cdc.active_storage_attachments............................................... [RUN] 2022-07-30 02:59:36 normalization > 02:58:55.352708 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.active_storage_attachments" 2022-07-30 02:59:36 normalization > 02:58:55.352907 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.active_storage_attachments 2022-07-30 02:59:36 normalization > 02:58:55.353043 [debug] [Thread-2 ]: Compiling model.airbyte_utils.active_storage_attachments 2022-07-30 02:59:36 normalization > 02:58:55.351328 [debug] [Thread-3 ]: Writing runtime SQL for node "model.airbyte_utils.buyer_uploads" 2022-07-30 02:59:36 normalization > 02:58:55.363191 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.active_storage_attachments" 2022-07-30 02:59:36 normalization > 02:58:55.363778 [debug] [Thread-3 ]: On model.airbyte_utils.buyer_uploads: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_uploads"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`buyer_uploads` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`buyer_uploads_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > done, 2022-07-30 02:59:36 normalization > buyer_id, 2022-07-30 02:59:36 normalization > file_url, 2022-07-30 02:59:36 normalization > filename, 2022-07-30 02:59:36 normalization > file_type, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > buyer_user_id, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_buyer_uploads_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`buyer_uploads_scd` 2022-07-30 02:59:36 normalization > -- buyer_uploads from `dwcasa`.airbyte_cdc._airbyte_raw_buyer_uploads 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:55.368976 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:55.370792 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.active_storage_attachments 2022-07-30 02:59:36 normalization > 02:58:55.376061 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:58:55.413787 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.buyer_public_informations" 2022-07-30 02:59:36 normalization > 02:58:55.418262 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:55.418693 [debug] [Thread-8 ]: Began executing node model.airbyte_utils.buyer_public_informations 2022-07-30 02:59:36 normalization > 02:58:55.464149 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:58:55.583569 [debug] [Thread-8 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/buyer_public_informations?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.buyer_public_informations 2022-07-30 02:59:36 normalization > 02:58:55.584745 [info ] [Thread-8 ]: 02:58:55 + `dwcasa`.airbyte_cdc.`buyer_public_informations`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:58:55.589246 [debug] [Thread-8 ]: Writing runtime SQL for node "model.airbyte_utils.buyer_public_informations" 2022-07-30 02:59:36 normalization > 02:58:55.589687 [debug] [Thread-8 ]: On model.airbyte_utils.buyer_public_informations: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_public_informations"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`buyer_public_informations` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`buyer_public_informations_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > type, 2022-07-30 02:59:36 normalization > score, 2022-07-30 02:59:36 normalization > buyer_id, 2022-07-30 02:59:36 normalization > response, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > recommended_term_limit, 2022-07-30 02:59:36 normalization > recommended_spend_limit, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_buyer_public_informations_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`buyer_public_informations_scd` 2022-07-30 02:59:36 normalization > -- buyer_public_informations from `dwcasa`.airbyte_cdc._airbyte_raw_buyer_public_informations 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:55.605004 [debug] [Thread-2 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/active_storage_attachments?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.active_storage_attachments 2022-07-30 02:59:36 normalization > 02:58:55.606185 [info ] [Thread-2 ]: 02:58:55 + `dwcasa`.airbyte_cdc.`active_storage_attachments`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:58:55.611547 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.active_storage_attachments" 2022-07-30 02:59:36 normalization > 02:58:55.611984 [debug] [Thread-2 ]: On model.airbyte_utils.active_storage_attachments: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.active_storage_attachments"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`active_storage_attachments` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`active_storage_attachments_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > name, 2022-07-30 02:59:36 normalization > blob_id, 2022-07-30 02:59:36 normalization > record_id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > record_type, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_active_storage_attachments_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`active_storage_attachments_scd` 2022-07-30 02:59:36 normalization > -- active_storage_attachments from `dwcasa`.airbyte_cdc._airbyte_raw_active_storage_attachments 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:56.144574 [debug] [Thread-4 ]: On model.airbyte_utils.products_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.products_scd"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-07-30 02:59:36 normalization > delete from `dwcasa`.airbyte_cdc.`products_scd` where 1=0 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:56.159012 [debug] [Thread-5 ]: On model.airbyte_utils.store_orders_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.store_orders_scd"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > drop view _airbyte_airbyte_cdc.store_orders_stg 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:56.711899 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:56.713296 [info ] [Thread-5 ]: 134 of 201 OK created incremental model airbyte_cdc.store_orders_scd.................................................... [CREATE TABLE (13.1k rows, 3.9 MB processed) in 5.61s] 2022-07-30 02:59:36 normalization > 02:58:56.714287 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.store_orders_scd 2022-07-30 02:59:36 normalization > 02:58:56.714614 [debug] [Thread-5 ]: Began running node model.airbyte_utils.ar_internal_metadata 2022-07-30 02:59:36 normalization > 02:58:56.715383 [info ] [Thread-5 ]: 143 of 201 START incremental model airbyte_cdc.ar_internal_metadata..................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:58:56.716483 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.ar_internal_metadata" 2022-07-30 02:59:36 normalization > 02:58:56.716653 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.ar_internal_metadata 2022-07-30 02:59:36 normalization > 02:58:56.716788 [debug] [Thread-5 ]: Compiling model.airbyte_utils.ar_internal_metadata 2022-07-30 02:59:36 normalization > 02:58:56.726812 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.ar_internal_metadata" 2022-07-30 02:59:36 normalization > 02:58:56.727399 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:56.727583 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.ar_internal_metadata 2022-07-30 02:59:36 normalization > 02:58:56.731168 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:58:56.858843 [debug] [Thread-5 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/ar_internal_metadata?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.ar_internal_metadata 2022-07-30 02:59:36 normalization > 02:58:56.860032 [info ] [Thread-5 ]: 02:58:56 + `dwcasa`.airbyte_cdc.`ar_internal_metadata`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:58:56.864656 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.ar_internal_metadata" 2022-07-30 02:59:36 normalization > 02:58:56.865248 [debug] [Thread-5 ]: On model.airbyte_utils.ar_internal_metadata: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.ar_internal_metadata"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`ar_internal_metadata` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`ar_internal_metadata_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > key, 2022-07-30 02:59:36 normalization > value, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_ar_internal_metadata_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`ar_internal_metadata_scd` 2022-07-30 02:59:36 normalization > -- ar_internal_metadata from `dwcasa`.airbyte_cdc._airbyte_raw_ar_internal_metadata 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:56.997273 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:56.998477 [info ] [Thread-6 ]: 138 of 201 OK created incremental model airbyte_cdc.buyer_contact_rules................................................. [CREATE TABLE (5.0 rows, 980.0 Bytes processed) in 2.54s] 2022-07-30 02:59:36 normalization > 02:58:56.998913 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.buyer_contact_rules 2022-07-30 02:59:36 normalization > 02:58:56.999171 [debug] [Thread-6 ]: Began running node model.airbyte_utils.faq_categories 2022-07-30 02:59:36 normalization > 02:58:56.999533 [info ] [Thread-6 ]: 144 of 201 START incremental model airbyte_cdc.faq_categories........................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:58:57.001062 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.faq_categories" 2022-07-30 02:59:36 normalization > 02:58:57.001229 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.faq_categories 2022-07-30 02:59:36 normalization > 02:58:57.001361 [debug] [Thread-6 ]: Compiling model.airbyte_utils.faq_categories 2022-07-30 02:59:36 normalization > 02:58:57.017187 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.faq_categories" 2022-07-30 02:59:36 normalization > 02:58:57.018181 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:57.018478 [debug] [Thread-6 ]: Began executing node model.airbyte_utils.faq_categories 2022-07-30 02:59:36 normalization > 02:58:57.022765 [debug] [Thread-6 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:58:57.210432 [debug] [Thread-6 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/faq_categories?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.faq_categories 2022-07-30 02:59:36 normalization > 02:58:57.212273 [info ] [Thread-6 ]: 02:58:57 + `dwcasa`.airbyte_cdc.`faq_categories`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:58:57.222578 [debug] [Thread-6 ]: Writing runtime SQL for node "model.airbyte_utils.faq_categories" 2022-07-30 02:59:36 normalization > 02:58:57.223347 [debug] [Thread-6 ]: On model.airbyte_utils.faq_categories: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.faq_categories"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`faq_categories` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`faq_categories_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > name, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_faq_categories_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`faq_categories_scd` 2022-07-30 02:59:36 normalization > -- faq_categories from `dwcasa`.airbyte_cdc._airbyte_raw_faq_categories 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:57.252473 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:57.253358 [info ] [Thread-1 ]: 139 of 201 OK created incremental model airbyte_cdc.categories.......................................................... [CREATE TABLE (43.0 rows, 8.6 KB processed) in 2.37s] 2022-07-30 02:59:36 normalization > 02:58:57.253948 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.categories 2022-07-30 02:59:36 normalization > 02:58:57.254297 [debug] [Thread-1 ]: Began running node model.airbyte_utils.changebase_metadata 2022-07-30 02:59:36 normalization > 02:58:57.254820 [info ] [Thread-1 ]: 145 of 201 START incremental model airbyte_cdc.changebase_metadata...................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:58:57.256204 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.changebase_metadata" 2022-07-30 02:59:36 normalization > 02:58:57.256376 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.changebase_metadata 2022-07-30 02:59:36 normalization > 02:58:57.256510 [debug] [Thread-1 ]: Compiling model.airbyte_utils.changebase_metadata 2022-07-30 02:59:36 normalization > 02:58:57.268060 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.changebase_metadata" 2022-07-30 02:59:36 normalization > 02:58:57.268518 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:57.268685 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.changebase_metadata 2022-07-30 02:59:36 normalization > 02:58:57.272587 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:58:57.288019 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:57.289415 [info ] [Thread-7 ]: 137 of 201 OK created incremental model airbyte_cdc.buyer_locations..................................................... [CREATE TABLE (4.2k rows, 1.5 MB processed) in 2.90s] 2022-07-30 02:59:36 normalization > 02:58:57.291403 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.buyer_locations 2022-07-30 02:59:36 normalization > 02:58:57.291755 [debug] [Thread-7 ]: Began running node model.airbyte_utils.buyer_store_recommendations 2022-07-30 02:59:36 normalization > 02:58:57.292313 [info ] [Thread-7 ]: 146 of 201 START incremental model airbyte_cdc.buyer_store_recommendations.............................................. [RUN] 2022-07-30 02:59:36 normalization > 02:58:57.294735 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_store_recommendations" 2022-07-30 02:59:36 normalization > 02:58:57.295398 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.buyer_store_recommendations 2022-07-30 02:59:36 normalization > 02:58:57.295784 [debug] [Thread-7 ]: Compiling model.airbyte_utils.buyer_store_recommendations 2022-07-30 02:59:36 normalization > 02:58:57.305475 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.buyer_store_recommendations" 2022-07-30 02:59:36 normalization > 02:58:57.306815 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:57.307010 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.buyer_store_recommendations 2022-07-30 02:59:36 normalization > 02:58:57.313936 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:58:57.421407 [debug] [Thread-1 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/changebase_metadata?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.changebase_metadata 2022-07-30 02:59:36 normalization > 02:58:57.423856 [info ] [Thread-1 ]: 02:58:57 + `dwcasa`.airbyte_cdc.`changebase_metadata`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:58:57.429105 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.changebase_metadata" 2022-07-30 02:59:36 normalization > 02:58:57.433096 [debug] [Thread-1 ]: On model.airbyte_utils.changebase_metadata: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.changebase_metadata"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`changebase_metadata` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`changebase_metadata_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > data, 2022-07-30 02:59:36 normalization > version, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_changebase_metadata_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`changebase_metadata_scd` 2022-07-30 02:59:36 normalization > -- changebase_metadata from `dwcasa`.airbyte_cdc._airbyte_raw_changebase_metadata 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:57.509918 [debug] [Thread-7 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/buyer_store_recommendations?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.buyer_store_recommendations 2022-07-30 02:59:36 normalization > 02:58:57.511132 [info ] [Thread-7 ]: 02:58:57 + `dwcasa`.airbyte_cdc.`buyer_store_recommendations`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:58:57.517163 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.buyer_store_recommendations" 2022-07-30 02:59:36 normalization > 02:58:57.517870 [debug] [Thread-7 ]: On model.airbyte_utils.buyer_store_recommendations: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_store_recommendations"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`buyer_store_recommendations` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`buyer_store_recommendations_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > buyer_id, 2022-07-30 02:59:36 normalization > store_id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > store_name, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > store_email, 2022-07-30 02:59:36 normalization > store_phone, 2022-07-30 02:59:36 normalization > contact_name, 2022-07-30 02:59:36 normalization > buyer_user_id, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_buyer_store_recommendations_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`buyer_store_recommendations_scd` 2022-07-30 02:59:36 normalization > -- buyer_store_recommendations from `dwcasa`.airbyte_cdc._airbyte_raw_buyer_store_recommendations 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:57.985414 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:57.986311 [info ] [Thread-8 ]: 141 of 201 OK created incremental model airbyte_cdc.buyer_public_informations........................................... [CREATE TABLE (2.0k rows, 4.4 MB processed) in 2.76s] 2022-07-30 02:59:36 normalization > 02:58:57.987308 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.buyer_public_informations 2022-07-30 02:59:36 normalization > 02:58:57.987744 [debug] [Thread-8 ]: Began running node model.airbyte_utils.flipper_features 2022-07-30 02:59:36 normalization > 02:58:57.988159 [info ] [Thread-8 ]: 147 of 201 START incremental model airbyte_cdc.flipper_features......................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:58:57.989119 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.flipper_features" 2022-07-30 02:59:36 normalization > 02:58:57.989285 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.flipper_features 2022-07-30 02:59:36 normalization > 02:58:57.989421 [debug] [Thread-8 ]: Compiling model.airbyte_utils.flipper_features 2022-07-30 02:59:36 normalization > 02:58:57.999588 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.flipper_features" 2022-07-30 02:59:36 normalization > 02:58:58.000145 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:58.000320 [debug] [Thread-8 ]: Began executing node model.airbyte_utils.flipper_features 2022-07-30 02:59:36 normalization > 02:58:58.004248 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:58:58.144569 [debug] [Thread-8 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/flipper_features?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.flipper_features 2022-07-30 02:59:36 normalization > 02:58:58.146658 [info ] [Thread-8 ]: 02:58:58 + `dwcasa`.airbyte_cdc.`flipper_features`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:58:58.151017 [debug] [Thread-8 ]: Writing runtime SQL for node "model.airbyte_utils.flipper_features" 2022-07-30 02:59:36 normalization > 02:58:58.151462 [debug] [Thread-8 ]: On model.airbyte_utils.flipper_features: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.flipper_features"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`flipper_features` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`flipper_features_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > key, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_flipper_features_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`flipper_features_scd` 2022-07-30 02:59:36 normalization > -- flipper_features from `dwcasa`.airbyte_cdc._airbyte_raw_flipper_features 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:58.441663 [debug] [Thread-4 ]: On model.airbyte_utils.products_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.products_scd"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > drop view _airbyte_airbyte_cdc.products_stg 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:59.032624 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:59.033702 [info ] [Thread-4 ]: 117 of 201 OK created incremental model airbyte_cdc.products_scd........................................................ [CREATE TABLE (142.4k rows, 122.9 MB processed) in 28.60s] 2022-07-30 02:59:36 normalization > 02:58:59.034760 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.products_scd 2022-07-30 02:59:36 normalization > 02:58:59.035136 [debug] [Thread-4 ]: Began running node model.airbyte_utils.faq 2022-07-30 02:59:36 normalization > 02:58:59.035965 [info ] [Thread-4 ]: 148 of 201 START incremental model airbyte_cdc.faq...................................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:58:59.037115 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.faq" 2022-07-30 02:59:36 normalization > 02:58:59.037533 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.faq 2022-07-30 02:59:36 normalization > 02:58:59.037678 [debug] [Thread-4 ]: Compiling model.airbyte_utils.faq 2022-07-30 02:59:36 normalization > 02:58:59.048705 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.faq" 2022-07-30 02:59:36 normalization > 02:58:59.049138 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:59.049380 [debug] [Thread-4 ]: Began executing node model.airbyte_utils.faq 2022-07-30 02:59:36 normalization > 02:58:59.053233 [debug] [Thread-4 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:58:59.218884 [debug] [Thread-4 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/faq?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.faq 2022-07-30 02:59:36 normalization > 02:58:59.220418 [info ] [Thread-4 ]: 02:58:59 + `dwcasa`.airbyte_cdc.`faq`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:58:59.224403 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:59.226397 [info ] [Thread-5 ]: 143 of 201 OK created incremental model airbyte_cdc.ar_internal_metadata................................................ [CREATE TABLE (1.0 rows, 197.0 Bytes processed) in 2.51s] 2022-07-30 02:59:36 normalization > 02:58:59.232752 [debug] [Thread-4 ]: Writing runtime SQL for node "model.airbyte_utils.faq" 2022-07-30 02:59:36 normalization > 02:58:59.233972 [debug] [Thread-4 ]: On model.airbyte_utils.faq: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.faq"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`faq` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`faq_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > title, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > description, 2022-07-30 02:59:36 normalization > faq_category_id, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_faq_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`faq_scd` 2022-07-30 02:59:36 normalization > -- faq from `dwcasa`.airbyte_cdc._airbyte_raw_faq 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:59.234399 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.ar_internal_metadata 2022-07-30 02:59:36 normalization > 02:58:59.236890 [debug] [Thread-5 ]: Began running node model.airbyte_utils.buyers 2022-07-30 02:59:36 normalization > 02:58:59.237822 [info ] [Thread-5 ]: 149 of 201 SKIP relation airbyte_cdc.buyers............................................................................. [SKIP] 2022-07-30 02:59:36 normalization > 02:58:59.238813 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.buyers 2022-07-30 02:59:36 normalization > 02:58:59.239179 [debug] [Thread-5 ]: Began running node model.airbyte_utils.active_storage_blobs 2022-07-30 02:59:36 normalization > 02:58:59.239836 [info ] [Thread-5 ]: 150 of 201 START incremental model airbyte_cdc.active_storage_blobs..................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:58:59.241087 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.active_storage_blobs" 2022-07-30 02:59:36 normalization > 02:58:59.241266 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.active_storage_blobs 2022-07-30 02:59:36 normalization > 02:58:59.241390 [debug] [Thread-5 ]: Compiling model.airbyte_utils.active_storage_blobs 2022-07-30 02:59:36 normalization > 02:58:59.252309 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.active_storage_blobs" 2022-07-30 02:59:36 normalization > 02:58:59.252803 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:59.252969 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.active_storage_blobs 2022-07-30 02:59:36 normalization > 02:58:59.256887 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:58:59.376941 [debug] [Thread-5 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/active_storage_blobs?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.active_storage_blobs 2022-07-30 02:59:36 normalization > 02:58:59.378110 [info ] [Thread-5 ]: 02:58:59 + `dwcasa`.airbyte_cdc.`active_storage_blobs`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:58:59.384961 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.active_storage_blobs" 2022-07-30 02:59:36 normalization > 02:58:59.385427 [debug] [Thread-5 ]: On model.airbyte_utils.active_storage_blobs: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.active_storage_blobs"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`active_storage_blobs` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`active_storage_blobs_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > key, 2022-07-30 02:59:36 normalization > checksum, 2022-07-30 02:59:36 normalization > filename, 2022-07-30 02:59:36 normalization > metadata, 2022-07-30 02:59:36 normalization > byte_size, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > content_type, 2022-07-30 02:59:36 normalization > service_name, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_active_storage_blobs_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`active_storage_blobs_scd` 2022-07-30 02:59:36 normalization > -- active_storage_blobs from `dwcasa`.airbyte_cdc._airbyte_raw_active_storage_blobs 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:59.430432 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:59.431310 [info ] [Thread-6 ]: 144 of 201 OK created incremental model airbyte_cdc.faq_categories...................................................... [CREATE TABLE (8.0 rows, 1.6 KB processed) in 2.43s] 2022-07-30 02:59:36 normalization > 02:58:59.432188 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.faq_categories 2022-07-30 02:59:36 normalization > 02:58:59.433308 [debug] [Thread-6 ]: Began running node model.airbyte_utils.freight_partners 2022-07-30 02:59:36 normalization > 02:58:59.433990 [info ] [Thread-6 ]: 151 of 201 START incremental model airbyte_cdc.freight_partners......................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:58:59.435434 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_partners" 2022-07-30 02:59:36 normalization > 02:58:59.435621 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.freight_partners 2022-07-30 02:59:36 normalization > 02:58:59.435744 [debug] [Thread-6 ]: Compiling model.airbyte_utils.freight_partners 2022-07-30 02:59:36 normalization > 02:58:59.445435 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.freight_partners" 2022-07-30 02:59:36 normalization > 02:58:59.445858 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:59.446016 [debug] [Thread-6 ]: Began executing node model.airbyte_utils.freight_partners 2022-07-30 02:59:36 normalization > 02:58:59.449260 [debug] [Thread-6 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:58:59.452614 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:59.453681 [info ] [Thread-2 ]: 142 of 201 OK created incremental model airbyte_cdc.active_storage_attachments.......................................... [CREATE TABLE (56.2k rows, 12.1 MB processed) in 4.10s] 2022-07-30 02:59:36 normalization > 02:58:59.455196 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.active_storage_attachments 2022-07-30 02:59:36 normalization > 02:58:59.455648 [debug] [Thread-2 ]: Began running node model.airbyte_utils.freight_partner_vehicles 2022-07-30 02:59:36 normalization > 02:58:59.456235 [info ] [Thread-2 ]: 152 of 201 START incremental model airbyte_cdc.freight_partner_vehicles................................................. [RUN] 2022-07-30 02:59:36 normalization > 02:58:59.457610 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_partner_vehicles" 2022-07-30 02:59:36 normalization > 02:58:59.458079 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.freight_partner_vehicles 2022-07-30 02:59:36 normalization > 02:58:59.458385 [debug] [Thread-2 ]: Compiling model.airbyte_utils.freight_partner_vehicles 2022-07-30 02:59:36 normalization > 02:58:59.476182 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.freight_partner_vehicles" 2022-07-30 02:59:36 normalization > 02:58:59.479186 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:59.479473 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.freight_partner_vehicles 2022-07-30 02:59:36 normalization > 02:58:59.483195 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:58:59.525695 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:59.526661 [info ] [Thread-1 ]: 145 of 201 OK created incremental model airbyte_cdc.changebase_metadata................................................. [CREATE TABLE (0.0 rows, 0 processed) in 2.27s] 2022-07-30 02:59:36 normalization > 02:58:59.530921 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.changebase_metadata 2022-07-30 02:59:36 normalization > 02:58:59.539951 [debug] [Thread-1 ]: Began running node model.airbyte_utils.heya_campaign_memberships 2022-07-30 02:59:36 normalization > 02:58:59.540752 [info ] [Thread-1 ]: 153 of 201 START incremental model airbyte_cdc.heya_campaign_memberships................................................ [RUN] 2022-07-30 02:59:36 normalization > 02:58:59.543220 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.heya_campaign_memberships" 2022-07-30 02:59:36 normalization > 02:58:59.543497 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.heya_campaign_memberships 2022-07-30 02:59:36 normalization > 02:58:59.543698 [debug] [Thread-1 ]: Compiling model.airbyte_utils.heya_campaign_memberships 2022-07-30 02:59:36 normalization > 02:58:59.556581 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.heya_campaign_memberships" 2022-07-30 02:59:36 normalization > 02:58:59.557325 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:59.557517 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.heya_campaign_memberships 2022-07-30 02:59:36 normalization > 02:58:59.564368 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:58:59.634519 [debug] [Thread-2 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/freight_partner_vehicles?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.freight_partner_vehicles 2022-07-30 02:59:36 normalization > 02:58:59.636067 [info ] [Thread-2 ]: 02:58:59 + `dwcasa`.airbyte_cdc.`freight_partner_vehicles`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:58:59.641134 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.freight_partner_vehicles" 2022-07-30 02:59:36 normalization > 02:58:59.641545 [debug] [Thread-2 ]: On model.airbyte_utils.freight_partner_vehicles: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_partner_vehicles"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`freight_partner_vehicles` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`freight_partner_vehicles_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > plate, 2022-07-30 02:59:36 normalization > start_lat, 2022-07-30 02:59:36 normalization > start_lng, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > start_location, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > freight_partner_id, 2022-07-30 02:59:36 normalization > freight_vehicle_type_id, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_freight_partner_vehicles_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`freight_partner_vehicles_scd` 2022-07-30 02:59:36 normalization > -- freight_partner_vehicles from `dwcasa`.airbyte_cdc._airbyte_raw_freight_partner_vehicles 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:59.680704 [debug] [Thread-6 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/freight_partners?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.freight_partners 2022-07-30 02:59:36 normalization > 02:58:59.681860 [info ] [Thread-6 ]: 02:58:59 + `dwcasa`.airbyte_cdc.`freight_partners`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:58:59.686090 [debug] [Thread-6 ]: Writing runtime SQL for node "model.airbyte_utils.freight_partners" 2022-07-30 02:59:36 normalization > 02:58:59.686574 [debug] [Thread-6 ]: On model.airbyte_utils.freight_partners: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_partners"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`freight_partners` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`freight_partners_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > cpf, 2022-07-30 02:59:36 normalization > cnpj, 2022-07-30 02:59:36 normalization > email, 2022-07-30 02:59:36 normalization > active, 2022-07-30 02:59:36 normalization > website, 2022-07-30 02:59:36 normalization > whatsapp, 2022-07-30 02:59:36 normalization > daily_fee, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > is_dedicated, 2022-07-30 02:59:36 normalization > payment_type, 2022-07-30 02:59:36 normalization > trading_name, 2022-07-30 02:59:36 normalization > business_name, 2022-07-30 02:59:36 normalization > point_of_contact, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_freight_partners_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`freight_partners_scd` 2022-07-30 02:59:36 normalization > -- freight_partners from `dwcasa`.airbyte_cdc._airbyte_raw_freight_partners 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:59.702194 [debug] [Thread-1 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/heya_campaign_memberships?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.heya_campaign_memberships 2022-07-30 02:59:36 normalization > 02:58:59.704178 [info ] [Thread-1 ]: 02:58:59 + `dwcasa`.airbyte_cdc.`heya_campaign_memberships`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:58:59.719474 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.heya_campaign_memberships" 2022-07-30 02:59:36 normalization > 02:58:59.722348 [debug] [Thread-1 ]: On model.airbyte_utils.heya_campaign_memberships: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.heya_campaign_memberships"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`heya_campaign_memberships` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`heya_campaign_memberships_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > user_id, 2022-07-30 02:59:36 normalization > step_gid, 2022-07-30 02:59:36 normalization > user_type, 2022-07-30 02:59:36 normalization > concurrent, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > campaign_gid, 2022-07-30 02:59:36 normalization > last_sent_at, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_heya_campaign_memberships_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`heya_campaign_memberships_scd` 2022-07-30 02:59:36 normalization > -- heya_campaign_memberships from `dwcasa`.airbyte_cdc._airbyte_raw_heya_campaign_memberships 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:58:59.895473 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:59.896407 [info ] [Thread-7 ]: 146 of 201 OK created incremental model airbyte_cdc.buyer_store_recommendations......................................... [CREATE TABLE (1.0 rows, 255.0 Bytes processed) in 2.60s] 2022-07-30 02:59:36 normalization > 02:58:59.897192 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.buyer_store_recommendations 2022-07-30 02:59:36 normalization > 02:58:59.897595 [debug] [Thread-7 ]: Began running node model.airbyte_utils.freight_route_partner_costs 2022-07-30 02:59:36 normalization > 02:58:59.897992 [info ] [Thread-7 ]: 154 of 201 START incremental model airbyte_cdc.freight_route_partner_costs.............................................. [RUN] 2022-07-30 02:59:36 normalization > 02:58:59.899033 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_route_partner_costs" 2022-07-30 02:59:36 normalization > 02:58:59.899199 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.freight_route_partner_costs 2022-07-30 02:59:36 normalization > 02:58:59.899337 [debug] [Thread-7 ]: Compiling model.airbyte_utils.freight_route_partner_costs 2022-07-30 02:59:36 normalization > 02:58:59.907838 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.freight_route_partner_costs" 2022-07-30 02:59:36 normalization > 02:58:59.917535 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:58:59.917907 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.freight_route_partner_costs 2022-07-30 02:59:36 normalization > 02:58:59.931422 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:00.109329 [debug] [Thread-7 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/freight_route_partner_costs?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.freight_route_partner_costs 2022-07-30 02:59:36 normalization > 02:59:00.110644 [info ] [Thread-7 ]: 02:59:00 + `dwcasa`.airbyte_cdc.`freight_route_partner_costs`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:00.115231 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.freight_route_partner_costs" 2022-07-30 02:59:36 normalization > 02:59:00.115698 [debug] [Thread-7 ]: On model.airbyte_utils.freight_route_partner_costs: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_route_partner_costs"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`freight_route_partner_costs` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`freight_route_partner_costs_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > cost, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > extra_cost, 2022-07-30 02:59:36 normalization > total_cost, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > is_dedicated, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > extra_cost_details, 2022-07-30 02:59:36 normalization > freight_partner_id, 2022-07-30 02:59:36 normalization > delivery_work_end_at, 2022-07-30 02:59:36 normalization > delivery_work_start_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_freight_route_partner_costs_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`freight_route_partner_costs_scd` 2022-07-30 02:59:36 normalization > -- freight_route_partner_costs from `dwcasa`.airbyte_cdc._airbyte_raw_freight_route_partner_costs 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:00.509075 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:00.509965 [info ] [Thread-8 ]: 147 of 201 OK created incremental model airbyte_cdc.flipper_features.................................................... [CREATE TABLE (10.0 rows, 1.9 KB processed) in 2.52s] 2022-07-30 02:59:36 normalization > 02:59:00.510503 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.flipper_features 2022-07-30 02:59:36 normalization > 02:59:00.510857 [debug] [Thread-8 ]: Began running node model.airbyte_utils.freight_product_orders 2022-07-30 02:59:36 normalization > 02:59:00.511461 [info ] [Thread-8 ]: 155 of 201 START incremental model airbyte_cdc.freight_product_orders................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:00.512812 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_product_orders" 2022-07-30 02:59:36 normalization > 02:59:00.512986 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.freight_product_orders 2022-07-30 02:59:36 normalization > 02:59:00.513378 [debug] [Thread-8 ]: Compiling model.airbyte_utils.freight_product_orders 2022-07-30 02:59:36 normalization > 02:59:00.526541 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.freight_product_orders" 2022-07-30 02:59:36 normalization > 02:59:00.527013 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:00.527315 [debug] [Thread-8 ]: Began executing node model.airbyte_utils.freight_product_orders 2022-07-30 02:59:36 normalization > 02:59:00.530890 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:00.665428 [debug] [Thread-8 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/freight_product_orders?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.freight_product_orders 2022-07-30 02:59:36 normalization > 02:59:00.666876 [info ] [Thread-8 ]: 02:59:00 + `dwcasa`.airbyte_cdc.`freight_product_orders`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:00.676030 [debug] [Thread-8 ]: Writing runtime SQL for node "model.airbyte_utils.freight_product_orders" 2022-07-30 02:59:36 normalization > 02:59:00.676683 [debug] [Thread-8 ]: On model.airbyte_utils.freight_product_orders: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_product_orders"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`freight_product_orders` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`freight_product_orders_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > freight_id, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > product_order_id, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > quantity_in_freight, 2022-07-30 02:59:36 normalization > internal_product_freight_note, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_freight_product_orders_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`freight_product_orders_scd` 2022-07-30 02:59:36 normalization > -- freight_product_orders from `dwcasa`.airbyte_cdc._airbyte_raw_freight_product_orders 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:01.608995 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:01.609987 [info ] [Thread-4 ]: 148 of 201 OK created incremental model airbyte_cdc.faq................................................................. [CREATE TABLE (23.0 rows, 13.6 KB processed) in 2.57s] 2022-07-30 02:59:36 normalization > 02:59:01.612900 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.faq 2022-07-30 02:59:36 normalization > 02:59:01.613270 [debug] [Thread-4 ]: Began running node model.airbyte_utils.freight_route_groupings 2022-07-30 02:59:36 normalization > 02:59:01.615264 [info ] [Thread-4 ]: 156 of 201 START incremental model airbyte_cdc.freight_route_groupings.................................................. [RUN] 2022-07-30 02:59:36 normalization > 02:59:01.617256 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_route_groupings" 2022-07-30 02:59:36 normalization > 02:59:01.617428 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.freight_route_groupings 2022-07-30 02:59:36 normalization > 02:59:01.618501 [debug] [Thread-4 ]: Compiling model.airbyte_utils.freight_route_groupings 2022-07-30 02:59:36 normalization > 02:59:01.630691 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.freight_route_groupings" 2022-07-30 02:59:36 normalization > 02:59:01.631136 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:01.631296 [debug] [Thread-4 ]: Began executing node model.airbyte_utils.freight_route_groupings 2022-07-30 02:59:36 normalization > 02:59:01.635331 [debug] [Thread-4 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:01.797908 [debug] [Thread-4 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/freight_route_groupings?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.freight_route_groupings 2022-07-30 02:59:36 normalization > 02:59:01.799102 [info ] [Thread-4 ]: 02:59:01 + `dwcasa`.airbyte_cdc.`freight_route_groupings`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:01.803834 [debug] [Thread-4 ]: Writing runtime SQL for node "model.airbyte_utils.freight_route_groupings" 2022-07-30 02:59:36 normalization > 02:59:01.804435 [debug] [Thread-4 ]: On model.airbyte_utils.freight_route_groupings: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_route_groupings"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`freight_route_groupings` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`freight_route_groupings_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > freight_id, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > freight_route_id, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > delivery_note_link, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_freight_route_groupings_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`freight_route_groupings_scd` 2022-07-30 02:59:36 normalization > -- freight_route_groupings from `dwcasa`.airbyte_cdc._airbyte_raw_freight_route_groupings 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:02.000436 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:02.001324 [info ] [Thread-2 ]: 152 of 201 OK created incremental model airbyte_cdc.freight_partner_vehicles............................................ [CREATE TABLE (113.0 rows, 24.7 KB processed) in 2.54s] 2022-07-30 02:59:36 normalization > 02:59:02.003419 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.freight_partner_vehicles 2022-07-30 02:59:36 normalization > 02:59:02.005922 [debug] [Thread-2 ]: Began running node model.airbyte_utils.freight_vehicle_types 2022-07-30 02:59:36 normalization > 02:59:02.006610 [info ] [Thread-2 ]: 157 of 201 START incremental model airbyte_cdc.freight_vehicle_types.................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:02.010418 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_vehicle_types" 2022-07-30 02:59:36 normalization > 02:59:02.010637 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.freight_vehicle_types 2022-07-30 02:59:36 normalization > 02:59:02.010762 [debug] [Thread-2 ]: Compiling model.airbyte_utils.freight_vehicle_types 2022-07-30 02:59:36 normalization > 02:59:02.026907 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.freight_vehicle_types" 2022-07-30 02:59:36 normalization > 02:59:02.033562 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:02.033784 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.freight_vehicle_types 2022-07-30 02:59:36 normalization > 02:59:02.041667 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:02.058651 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:02.070675 [info ] [Thread-6 ]: 151 of 201 OK created incremental model airbyte_cdc.freight_partners.................................................... [CREATE TABLE (99.0 rows, 27.8 KB processed) in 2.63s] 2022-07-30 02:59:36 normalization > 02:59:02.077186 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.freight_partners 2022-07-30 02:59:36 normalization > 02:59:02.077757 [debug] [Thread-6 ]: Began running node model.airbyte_utils.buyer_users 2022-07-30 02:59:36 normalization > 02:59:02.079730 [info ] [Thread-6 ]: 158 of 201 START incremental model airbyte_cdc.buyer_users.............................................................. [RUN] 2022-07-30 02:59:36 normalization > 02:59:02.083602 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.buyer_users" 2022-07-30 02:59:36 normalization > 02:59:02.083871 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.buyer_users 2022-07-30 02:59:36 normalization > 02:59:02.086743 [debug] [Thread-6 ]: Compiling model.airbyte_utils.buyer_users 2022-07-30 02:59:36 normalization > 02:59:02.108699 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.buyer_users" 2022-07-30 02:59:36 normalization > 02:59:02.111067 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:02.111360 [debug] [Thread-6 ]: Began executing node model.airbyte_utils.buyer_users 2022-07-30 02:59:36 normalization > 02:59:02.129811 [debug] [Thread-6 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:02.165325 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:02.166636 [info ] [Thread-1 ]: 153 of 201 OK created incremental model airbyte_cdc.heya_campaign_memberships........................................... [CREATE TABLE (14.0 rows, 4.9 KB processed) in 2.62s] 2022-07-30 02:59:36 normalization > 02:59:02.168794 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.heya_campaign_memberships 2022-07-30 02:59:36 normalization > 02:59:02.169185 [debug] [Thread-1 ]: Began running node model.airbyte_utils.location_store_products 2022-07-30 02:59:36 normalization > 02:59:02.173575 [info ] [Thread-1 ]: 159 of 201 START incremental model airbyte_cdc.location_store_products.................................................. [RUN] 2022-07-30 02:59:36 normalization > 02:59:02.175633 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.location_store_products" 2022-07-30 02:59:36 normalization > 02:59:02.175817 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.location_store_products 2022-07-30 02:59:36 normalization > 02:59:02.175940 [debug] [Thread-1 ]: Compiling model.airbyte_utils.location_store_products 2022-07-30 02:59:36 normalization > 02:59:02.199820 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.location_store_products" 2022-07-30 02:59:36 normalization > 02:59:02.200689 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:02.200929 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.location_store_products 2022-07-30 02:59:36 normalization > 02:59:02.205454 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:02.255653 [debug] [Thread-2 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/freight_vehicle_types?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.freight_vehicle_types 2022-07-30 02:59:36 normalization > 02:59:02.259892 [info ] [Thread-2 ]: 02:59:02 + `dwcasa`.airbyte_cdc.`freight_vehicle_types`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:02.267691 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.freight_vehicle_types" 2022-07-30 02:59:36 normalization > 02:59:02.268480 [debug] [Thread-2 ]: On model.airbyte_utils.freight_vehicle_types: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_vehicle_types"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`freight_vehicle_types` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`freight_vehicle_types_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > name, 2022-07-30 02:59:36 normalization > max_width, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > max_height, 2022-07-30 02:59:36 normalization > max_lenght, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > description, 2022-07-30 02:59:36 normalization > capacity_in_kg, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_freight_vehicle_types_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`freight_vehicle_types_scd` 2022-07-30 02:59:36 normalization > -- freight_vehicle_types from `dwcasa`.airbyte_cdc._airbyte_raw_freight_vehicle_types 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:02.302167 [debug] [Thread-6 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/buyer_users?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.buyer_users 2022-07-30 02:59:36 normalization > 02:59:02.303312 [info ] [Thread-6 ]: 02:59:02 + `dwcasa`.airbyte_cdc.`buyer_users`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:02.308279 [debug] [Thread-6 ]: Writing runtime SQL for node "model.airbyte_utils.buyer_users" 2022-07-30 02:59:36 normalization > 02:59:02.308734 [debug] [Thread-6 ]: On model.airbyte_utils.buyer_users: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.buyer_users"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`buyer_users` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`buyer_users_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > name, 2022-07-30 02:59:36 normalization > email, 2022-07-30 02:59:36 normalization > active, 2022-07-30 02:59:36 normalization > profile, 2022-07-30 02:59:36 normalization > buyer_id, 2022-07-30 02:59:36 normalization > whatsapp, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > spend_limit, 2022-07-30 02:59:36 normalization > confirmed_at, 2022-07-30 02:59:36 normalization > referral_code, 2022-07-30 02:59:36 normalization > stytch_user_id, 2022-07-30 02:59:36 normalization > own_referral_code, 2022-07-30 02:59:36 normalization > unconfirmed_email, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > confirmation_token, 2022-07-30 02:59:36 normalization > encrypted_password, 2022-07-30 02:59:36 normalization > remember_created_at, 2022-07-30 02:59:36 normalization > confirmation_sent_at, 2022-07-30 02:59:36 normalization > reset_password_token, 2022-07-30 02:59:36 normalization > reset_password_sent_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_buyer_users_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`buyer_users_scd` 2022-07-30 02:59:36 normalization > -- buyer_users from `dwcasa`.airbyte_cdc._airbyte_raw_buyer_users 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:02.432489 [debug] [Thread-1 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/location_store_products?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.location_store_products 2022-07-30 02:59:36 normalization > 02:59:02.433737 [info ] [Thread-1 ]: 02:59:02 + `dwcasa`.airbyte_cdc.`location_store_products`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:02.438836 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.location_store_products" 2022-07-30 02:59:36 normalization > 02:59:02.439248 [debug] [Thread-1 ]: On model.airbyte_utils.location_store_products: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.location_store_products"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`location_store_products` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`location_store_products_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > pipefy_id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > product_id, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > store_location_id, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > pipefy_product_store_id, 2022-07-30 02:59:36 normalization > pipefy_store_location_id, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_location_store_products_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`location_store_products_scd` 2022-07-30 02:59:36 normalization > -- location_store_products from `dwcasa`.airbyte_cdc._airbyte_raw_location_store_products 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:02.754327 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:02.755726 [info ] [Thread-7 ]: 154 of 201 OK created incremental model airbyte_cdc.freight_route_partner_costs......................................... [CREATE TABLE (73.0 rows, 17.8 KB processed) in 2.86s] 2022-07-30 02:59:36 normalization > 02:59:02.756210 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.freight_route_partner_costs 2022-07-30 02:59:36 normalization > 02:59:02.756929 [debug] [Thread-7 ]: Began running node model.airbyte_utils.oico_radars 2022-07-30 02:59:36 normalization > 02:59:02.757289 [info ] [Thread-7 ]: 160 of 201 START incremental model airbyte_cdc.oico_radars.............................................................. [RUN] 2022-07-30 02:59:36 normalization > 02:59:02.758260 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.oico_radars" 2022-07-30 02:59:36 normalization > 02:59:02.758513 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.oico_radars 2022-07-30 02:59:36 normalization > 02:59:02.758644 [debug] [Thread-7 ]: Compiling model.airbyte_utils.oico_radars 2022-07-30 02:59:36 normalization > 02:59:02.767523 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.oico_radars" 2022-07-30 02:59:36 normalization > 02:59:02.767932 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:02.768076 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.oico_radars 2022-07-30 02:59:36 normalization > 02:59:02.771048 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:02.902054 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:02.903146 [info ] [Thread-5 ]: 150 of 201 OK created incremental model airbyte_cdc.active_storage_blobs................................................ [CREATE TABLE (56.5k rows, 19.5 MB processed) in 3.66s] 2022-07-30 02:59:36 normalization > 02:59:02.903591 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.active_storage_blobs 2022-07-30 02:59:36 normalization > 02:59:02.903874 [debug] [Thread-5 ]: Began running node model.airbyte_utils.freight_routes 2022-07-30 02:59:36 normalization > 02:59:02.904218 [info ] [Thread-5 ]: 161 of 201 START incremental model airbyte_cdc.freight_routes........................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:02.905277 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.freight_routes" 2022-07-30 02:59:36 normalization > 02:59:02.905642 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.freight_routes 2022-07-30 02:59:36 normalization > 02:59:02.905801 [debug] [Thread-5 ]: Compiling model.airbyte_utils.freight_routes 2022-07-30 02:59:36 normalization > 02:59:02.914751 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.freight_routes" 2022-07-30 02:59:36 normalization > 02:59:02.915956 [debug] [Thread-7 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/oico_radars?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.oico_radars 2022-07-30 02:59:36 normalization > 02:59:02.917141 [info ] [Thread-7 ]: 02:59:02 + `dwcasa`.airbyte_cdc.`oico_radars`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:02.917620 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:02.917992 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.freight_routes 2022-07-30 02:59:36 normalization > 02:59:02.927645 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.oico_radars" 2022-07-30 02:59:36 normalization > 02:59:02.928417 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:02.929083 [debug] [Thread-7 ]: On model.airbyte_utils.oico_radars: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.oico_radars"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`oico_radars` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`oico_radars_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > name, 2022-07-30 02:59:36 normalization > email, 2022-07-30 02:59:36 normalization > document, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > notify_terms, 2022-07-30 02:59:36 normalization > phone_number, 2022-07-30 02:59:36 normalization > buyer_user_id, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > shareable_link_hash, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_oico_radars_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`oico_radars_scd` 2022-07-30 02:59:36 normalization > -- oico_radars from `dwcasa`.airbyte_cdc._airbyte_raw_oico_radars 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:03.083889 [debug] [Thread-5 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/freight_routes?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.freight_routes 2022-07-30 02:59:36 normalization > 02:59:03.085144 [info ] [Thread-5 ]: 02:59:03 + `dwcasa`.airbyte_cdc.`freight_routes`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:03.089582 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.freight_routes" 2022-07-30 02:59:36 normalization > 02:59:03.090088 [debug] [Thread-5 ]: On model.airbyte_utils.freight_routes: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freight_routes"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`freight_routes` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`freight_routes_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > sequence, 2022-07-30 02:59:36 normalization > pipefy_id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > freight_price, 2022-07-30 02:59:36 normalization > total_distance, 2022-07-30 02:59:36 normalization > product_problems, 2022-07-30 02:59:36 normalization > delivery_problems, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > shareable_link_hash, 2022-07-30 02:59:36 normalization > client_delivery_notes, 2022-07-30 02:59:36 normalization > freight_tracking_link, 2022-07-30 02:59:36 normalization > freight_delivery_poc_phone, 2022-07-30 02:59:36 normalization > freight_partner_vehicle_id, 2022-07-30 02:59:36 normalization > freight_partner_external_id, 2022-07-30 02:59:36 normalization > freight_route_partner_cost_id, 2022-07-30 02:59:36 normalization > freight_actual_delivery_datetime, 2022-07-30 02:59:36 normalization > freight_delivery_point_of_contact, 2022-07-30 02:59:36 normalization > freight_scheduled_delivery_datetime, 2022-07-30 02:59:36 normalization > freight_partner_dedicated_when_associated, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_freight_routes_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`freight_routes_scd` 2022-07-30 02:59:36 normalization > -- freight_routes from `dwcasa`.airbyte_cdc._airbyte_raw_freight_routes 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:03.566265 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:03.567509 [info ] [Thread-8 ]: 155 of 201 OK created incremental model airbyte_cdc.freight_product_orders.............................................. [CREATE TABLE (35.0k rows, 6.8 MB processed) in 3.06s] 2022-07-30 02:59:36 normalization > 02:59:03.568400 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.freight_product_orders 2022-07-30 02:59:36 normalization > 02:59:03.568742 [debug] [Thread-8 ]: Began running node model.airbyte_utils.freights 2022-07-30 02:59:36 normalization > 02:59:03.569242 [info ] [Thread-8 ]: 162 of 201 START incremental model airbyte_cdc.freights................................................................. [RUN] 2022-07-30 02:59:36 normalization > 02:59:03.570553 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.freights" 2022-07-30 02:59:36 normalization > 02:59:03.570721 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.freights 2022-07-30 02:59:36 normalization > 02:59:03.570860 [debug] [Thread-8 ]: Compiling model.airbyte_utils.freights 2022-07-30 02:59:36 normalization > 02:59:03.581767 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.freights" 2022-07-30 02:59:36 normalization > 02:59:03.582216 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:03.582471 [debug] [Thread-8 ]: Began executing node model.airbyte_utils.freights 2022-07-30 02:59:36 normalization > 02:59:03.586771 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:03.763796 [debug] [Thread-8 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/freights?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.freights 2022-07-30 02:59:36 normalization > 02:59:03.766799 [info ] [Thread-8 ]: 02:59:03 + `dwcasa`.airbyte_cdc.`freights`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:03.778228 [debug] [Thread-8 ]: Writing runtime SQL for node "model.airbyte_utils.freights" 2022-07-30 02:59:36 normalization > 02:59:03.778684 [debug] [Thread-8 ]: On model.airbyte_utils.freights: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.freights"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`freights` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`freights_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > distance, 2022-07-30 02:59:36 normalization > order_id, 2022-07-30 02:59:36 normalization > delivered, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > notified_at, 2022-07-30 02:59:36 normalization > received_by, 2022-07-30 02:59:36 normalization > picked_up_at, 2022-07-30 02:59:36 normalization > freight_weight, 2022-07-30 02:59:36 normalization > store_quote_id, 2022-07-30 02:59:36 normalization > reverse_freight, 2022-07-30 02:59:36 normalization > buyer_location_id, 2022-07-30 02:59:36 normalization > store_location_id, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > client_delivery_notes, 2022-07-30 02:59:36 normalization > internal_delivery_notes, 2022-07-30 02:59:36 normalization > actual_delivery_datetime, 2022-07-30 02:59:36 normalization > target_delivery_datetime, 2022-07-30 02:59:36 normalization > freight_actual_pickup_time, 2022-07-30 02:59:36 normalization > freight_scheduled_pickup_time, 2022-07-30 02:59:36 normalization > arrived_at_pick_up_location_at, 2022-07-30 02:59:36 normalization > arrived_at_drop_off_location_at, 2022-07-30 02:59:36 normalization > estimated_arrival_delivery_datetime, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_freights_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`freights_scd` 2022-07-30 02:59:36 normalization > -- freights from `dwcasa`.airbyte_cdc._airbyte_raw_freights 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:04.309332 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:04.310560 [info ] [Thread-2 ]: 157 of 201 OK created incremental model airbyte_cdc.freight_vehicle_types............................................... [CREATE TABLE (22.0 rows, 4.6 KB processed) in 2.30s] 2022-07-30 02:59:36 normalization > 02:59:04.311309 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.freight_vehicle_types 2022-07-30 02:59:36 normalization > 02:59:04.311641 [debug] [Thread-2 ]: Began running node model.airbyte_utils.memento_states 2022-07-30 02:59:36 normalization > 02:59:04.312086 [info ] [Thread-2 ]: 163 of 201 START incremental model airbyte_cdc.memento_states........................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:04.315581 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.memento_states" 2022-07-30 02:59:36 normalization > 02:59:04.315786 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.memento_states 2022-07-30 02:59:36 normalization > 02:59:04.315912 [debug] [Thread-2 ]: Compiling model.airbyte_utils.memento_states 2022-07-30 02:59:36 normalization > 02:59:04.327298 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.memento_states" 2022-07-30 02:59:36 normalization > 02:59:04.327901 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:04.328182 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.memento_states 2022-07-30 02:59:36 normalization > 02:59:04.334510 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:04.509769 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:04.510810 [info ] [Thread-1 ]: 159 of 201 OK created incremental model airbyte_cdc.location_store_products............................................. [CREATE TABLE (1.2k rows, 243.6 KB processed) in 2.34s] 2022-07-30 02:59:36 normalization > 02:59:04.511325 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.location_store_products 2022-07-30 02:59:36 normalization > 02:59:04.511786 [debug] [Thread-1 ]: Began running node model.airbyte_utils.oico_radar_products 2022-07-30 02:59:36 normalization > 02:59:04.512252 [info ] [Thread-1 ]: 164 of 201 START incremental model airbyte_cdc.oico_radar_products...................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:04.514882 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.oico_radar_products" 2022-07-30 02:59:36 normalization > 02:59:04.515212 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.oico_radar_products 2022-07-30 02:59:36 normalization > 02:59:04.515345 [debug] [Thread-1 ]: Compiling model.airbyte_utils.oico_radar_products 2022-07-30 02:59:36 normalization > 02:59:04.530378 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.oico_radar_products" 2022-07-30 02:59:36 normalization > 02:59:04.531198 [debug] [Thread-2 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/memento_states?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.memento_states 2022-07-30 02:59:36 normalization > 02:59:04.533284 [info ] [Thread-2 ]: 02:59:04 + `dwcasa`.airbyte_cdc.`memento_states`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:04.534168 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:04.534459 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.oico_radar_products 2022-07-30 02:59:36 normalization > 02:59:04.538513 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:04.545849 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.memento_states" 2022-07-30 02:59:36 normalization > 02:59:04.546781 [debug] [Thread-2 ]: On model.airbyte_utils.memento_states: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.memento_states"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`memento_states` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`memento_states_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > record_id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > session_id, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > action_type, 2022-07-30 02:59:36 normalization > record_data, 2022-07-30 02:59:36 normalization > record_type, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_memento_states_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`memento_states_scd` 2022-07-30 02:59:36 normalization > -- memento_states from `dwcasa`.airbyte_cdc._airbyte_raw_memento_states 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:04.692404 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:04.693347 [info ] [Thread-6 ]: 158 of 201 OK created incremental model airbyte_cdc.buyer_users......................................................... [CREATE TABLE (1.8k rows, 652.4 KB processed) in 2.61s] 2022-07-30 02:59:36 normalization > 02:59:04.695210 [debug] [Thread-1 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/oico_radar_products?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.oico_radar_products 2022-07-30 02:59:36 normalization > 02:59:04.696470 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.buyer_users 2022-07-30 02:59:36 normalization > 02:59:04.697615 [info ] [Thread-1 ]: 02:59:04 + `dwcasa`.airbyte_cdc.`oico_radar_products`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:04.697946 [debug] [Thread-6 ]: Began running node model.airbyte_utils.order_feedbacks 2022-07-30 02:59:36 normalization > 02:59:04.709467 [info ] [Thread-6 ]: 165 of 201 START incremental model airbyte_cdc.order_feedbacks.......................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:04.705959 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.oico_radar_products" 2022-07-30 02:59:36 normalization > 02:59:04.710880 [debug] [Thread-1 ]: On model.airbyte_utils.oico_radar_products: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.oico_radar_products"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`oico_radar_products` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`oico_radar_products_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > price, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > oico_radar_id, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > product_canonical_id, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_oico_radar_products_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`oico_radar_products_scd` 2022-07-30 02:59:36 normalization > -- oico_radar_products from `dwcasa`.airbyte_cdc._airbyte_raw_oico_radar_products 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:04.710469 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.order_feedbacks" 2022-07-30 02:59:36 normalization > 02:59:04.712680 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.order_feedbacks 2022-07-30 02:59:36 normalization > 02:59:04.713358 [debug] [Thread-6 ]: Compiling model.airbyte_utils.order_feedbacks 2022-07-30 02:59:36 normalization > 02:59:04.724455 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.order_feedbacks" 2022-07-30 02:59:36 normalization > 02:59:04.724877 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:04.725120 [debug] [Thread-6 ]: Began executing node model.airbyte_utils.order_feedbacks 2022-07-30 02:59:36 normalization > 02:59:04.728682 [debug] [Thread-6 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:04.847665 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:04.848566 [info ] [Thread-4 ]: 156 of 201 OK created incremental model airbyte_cdc.freight_route_groupings............................................. [CREATE TABLE (24.0k rows, 12.6 MB processed) in 3.23s] 2022-07-30 02:59:36 normalization > 02:59:04.849474 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.freight_route_groupings 2022-07-30 02:59:36 normalization > 02:59:04.849908 [debug] [Thread-4 ]: Began running node model.airbyte_utils.memento_sessions 2022-07-30 02:59:36 normalization > 02:59:04.850907 [info ] [Thread-4 ]: 166 of 201 START incremental model airbyte_cdc.memento_sessions......................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:04.852412 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.memento_sessions" 2022-07-30 02:59:36 normalization > 02:59:04.852606 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.memento_sessions 2022-07-30 02:59:36 normalization > 02:59:04.852756 [debug] [Thread-4 ]: Compiling model.airbyte_utils.memento_sessions 2022-07-30 02:59:36 normalization > 02:59:04.877612 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.memento_sessions" 2022-07-30 02:59:36 normalization > 02:59:04.878061 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:04.878236 [debug] [Thread-4 ]: Began executing node model.airbyte_utils.memento_sessions 2022-07-30 02:59:36 normalization > 02:59:04.885400 [debug] [Thread-4 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:04.897257 [debug] [Thread-6 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/order_feedbacks?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.order_feedbacks 2022-07-30 02:59:36 normalization > 02:59:04.898593 [info ] [Thread-6 ]: 02:59:04 + `dwcasa`.airbyte_cdc.`order_feedbacks`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:04.903940 [debug] [Thread-6 ]: Writing runtime SQL for node "model.airbyte_utils.order_feedbacks" 2022-07-30 02:59:36 normalization > 02:59:04.904786 [debug] [Thread-6 ]: On model.airbyte_utils.order_feedbacks: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.order_feedbacks"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`order_feedbacks` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`order_feedbacks_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > type, 2022-07-30 02:59:36 normalization > liked, 2022-07-30 02:59:36 normalization > order_id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_order_feedbacks_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`order_feedbacks_scd` 2022-07-30 02:59:36 normalization > -- order_feedbacks from `dwcasa`.airbyte_cdc._airbyte_raw_order_feedbacks 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:05.048312 [debug] [Thread-4 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/memento_sessions?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.memento_sessions 2022-07-30 02:59:36 normalization > 02:59:05.049971 [info ] [Thread-4 ]: 02:59:05 + `dwcasa`.airbyte_cdc.`memento_sessions`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:05.063997 [debug] [Thread-4 ]: Writing runtime SQL for node "model.airbyte_utils.memento_sessions" 2022-07-30 02:59:36 normalization > 02:59:05.064811 [debug] [Thread-4 ]: On model.airbyte_utils.memento_sessions: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.memento_sessions"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`memento_sessions` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`memento_sessions_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > user_id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_memento_sessions_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`memento_sessions_scd` 2022-07-30 02:59:36 normalization > -- memento_sessions from `dwcasa`.airbyte_cdc._airbyte_raw_memento_sessions 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:05.314096 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:05.315042 [info ] [Thread-7 ]: 160 of 201 OK created incremental model airbyte_cdc.oico_radars......................................................... [CREATE TABLE (3.0 rows, 823.0 Bytes processed) in 2.56s] 2022-07-30 02:59:36 normalization > 02:59:05.315539 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.oico_radars 2022-07-30 02:59:36 normalization > 02:59:05.315910 [debug] [Thread-7 ]: Began running node model.airbyte_utils.orders 2022-07-30 02:59:36 normalization > 02:59:05.316335 [info ] [Thread-7 ]: 167 of 201 SKIP relation airbyte_cdc.orders............................................................................. [SKIP] 2022-07-30 02:59:36 normalization > 02:59:05.316882 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.orders 2022-07-30 02:59:36 normalization > 02:59:05.317268 [debug] [Thread-7 ]: Began running node model.airbyte_utils.payer_buyer_locations 2022-07-30 02:59:36 normalization > 02:59:05.317781 [info ] [Thread-7 ]: 168 of 201 START incremental model airbyte_cdc.payer_buyer_locations.................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:05.320034 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.payer_buyer_locations" 2022-07-30 02:59:36 normalization > 02:59:05.320214 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.payer_buyer_locations 2022-07-30 02:59:36 normalization > 02:59:05.320358 [debug] [Thread-7 ]: Compiling model.airbyte_utils.payer_buyer_locations 2022-07-30 02:59:36 normalization > 02:59:05.328885 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.payer_buyer_locations" 2022-07-30 02:59:36 normalization > 02:59:05.329300 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:05.329446 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.payer_buyer_locations 2022-07-30 02:59:36 normalization > 02:59:05.332786 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:05.460783 [debug] [Thread-7 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/payer_buyer_locations?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.payer_buyer_locations 2022-07-30 02:59:36 normalization > 02:59:05.461926 [info ] [Thread-7 ]: 02:59:05 + `dwcasa`.airbyte_cdc.`payer_buyer_locations`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:05.466475 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.payer_buyer_locations" 2022-07-30 02:59:36 normalization > 02:59:05.466907 [debug] [Thread-7 ]: On model.airbyte_utils.payer_buyer_locations: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.payer_buyer_locations"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`payer_buyer_locations` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`payer_buyer_locations_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > buyer_id, 2022-07-30 02:59:36 normalization > payer_id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > buyer_location_id, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_payer_buyer_locations_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`payer_buyer_locations_scd` 2022-07-30 02:59:36 normalization > -- payer_buyer_locations from `dwcasa`.airbyte_cdc._airbyte_raw_payer_buyer_locations 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:06.385714 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:06.386660 [info ] [Thread-5 ]: 161 of 201 OK created incremental model airbyte_cdc.freight_routes...................................................... [CREATE TABLE (9.6k rows, 9.1 MB processed) in 3.48s] 2022-07-30 02:59:36 normalization > 02:59:06.387286 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.freight_routes 2022-07-30 02:59:36 normalization > 02:59:06.387607 [debug] [Thread-5 ]: Began running node model.airbyte_utils.oico_users 2022-07-30 02:59:36 normalization > 02:59:06.392491 [info ] [Thread-5 ]: 169 of 201 START incremental model airbyte_cdc.oico_users............................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:06.394418 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.oico_users" 2022-07-30 02:59:36 normalization > 02:59:06.394612 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.oico_users 2022-07-30 02:59:36 normalization > 02:59:06.394749 [debug] [Thread-5 ]: Compiling model.airbyte_utils.oico_users 2022-07-30 02:59:36 normalization > 02:59:06.417894 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.oico_users" 2022-07-30 02:59:36 normalization > 02:59:06.418344 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:06.418505 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.oico_users 2022-07-30 02:59:36 normalization > 02:59:06.666275 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:06.801376 [debug] [Thread-5 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/oico_users?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.oico_users 2022-07-30 02:59:36 normalization > 02:59:06.802654 [info ] [Thread-5 ]: 02:59:06 + `dwcasa`.airbyte_cdc.`oico_users`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:06.809983 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.oico_users" 2022-07-30 02:59:36 normalization > 02:59:06.810535 [debug] [Thread-5 ]: On model.airbyte_utils.oico_users: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.oico_users"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`oico_users` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`oico_users_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > email, 2022-07-30 02:59:36 normalization > active, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > encrypted_password, 2022-07-30 02:59:36 normalization > remember_created_at, 2022-07-30 02:59:36 normalization > reset_password_token, 2022-07-30 02:59:36 normalization > reset_password_sent_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_oico_users_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`oico_users_scd` 2022-07-30 02:59:36 normalization > -- oico_users from `dwcasa`.airbyte_cdc._airbyte_raw_oico_users 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:06.815723 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:06.818294 [info ] [Thread-8 ]: 162 of 201 OK created incremental model airbyte_cdc.freights............................................................ [CREATE TABLE (25.2k rows, 6.7 MB processed) in 3.25s] 2022-07-30 02:59:36 normalization > 02:59:06.818728 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.freights 2022-07-30 02:59:36 normalization > 02:59:06.819340 [debug] [Thread-8 ]: Began running node model.airbyte_utils.order_issues 2022-07-30 02:59:36 normalization > 02:59:06.820417 [info ] [Thread-8 ]: 170 of 201 START incremental model airbyte_cdc.order_issues............................................................. [RUN] 2022-07-30 02:59:36 normalization > 02:59:06.821664 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.order_issues" 2022-07-30 02:59:36 normalization > 02:59:06.821835 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.order_issues 2022-07-30 02:59:36 normalization > 02:59:06.821969 [debug] [Thread-8 ]: Compiling model.airbyte_utils.order_issues 2022-07-30 02:59:36 normalization > 02:59:06.833099 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.order_issues" 2022-07-30 02:59:36 normalization > 02:59:06.833534 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:06.833689 [debug] [Thread-8 ]: Began executing node model.airbyte_utils.order_issues 2022-07-30 02:59:36 normalization > 02:59:06.837258 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:06.972468 [debug] [Thread-8 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/order_issues?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.order_issues 2022-07-30 02:59:36 normalization > 02:59:06.973853 [info ] [Thread-8 ]: 02:59:06 + `dwcasa`.airbyte_cdc.`order_issues`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:06.980095 [debug] [Thread-8 ]: Writing runtime SQL for node "model.airbyte_utils.order_issues" 2022-07-30 02:59:36 normalization > 02:59:06.980704 [debug] [Thread-8 ]: On model.airbyte_utils.order_issues: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.order_issues"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`order_issues` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`order_issues_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > type, 2022-07-30 02:59:36 normalization > status, 2022-07-30 02:59:36 normalization > order_id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > canceled_at, 2022-07-30 02:59:36 normalization > description, 2022-07-30 02:59:36 normalization > confirmed_at, 2022-07-30 02:59:36 normalization > buyer_user_id, 2022-07-30 02:59:36 normalization > product_problems, 2022-07-30 02:59:36 normalization > delivery_problems, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_order_issues_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`order_issues_scd` 2022-07-30 02:59:36 normalization > -- order_issues from `dwcasa`.airbyte_cdc._airbyte_raw_order_issues 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:07.083112 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:07.084054 [info ] [Thread-1 ]: 164 of 201 OK created incremental model airbyte_cdc.oico_radar_products................................................. [CREATE TABLE (7.0 rows, 1.4 KB processed) in 2.57s] 2022-07-30 02:59:36 normalization > 02:59:07.085319 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.oico_radar_products 2022-07-30 02:59:36 normalization > 02:59:07.085574 [debug] [Thread-1 ]: Began running node model.airbyte_utils.heya_campaign_receipts 2022-07-30 02:59:36 normalization > 02:59:07.086922 [info ] [Thread-1 ]: 171 of 201 START incremental model airbyte_cdc.heya_campaign_receipts................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:07.089110 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.heya_campaign_receipts" 2022-07-30 02:59:36 normalization > 02:59:07.089463 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.heya_campaign_receipts 2022-07-30 02:59:36 normalization > 02:59:07.089668 [debug] [Thread-1 ]: Compiling model.airbyte_utils.heya_campaign_receipts 2022-07-30 02:59:36 normalization > 02:59:07.100480 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.heya_campaign_receipts" 2022-07-30 02:59:36 normalization > 02:59:07.100912 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:07.101322 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.heya_campaign_receipts 2022-07-30 02:59:36 normalization > 02:59:07.109374 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:07.246247 [debug] [Thread-1 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/heya_campaign_receipts?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.heya_campaign_receipts 2022-07-30 02:59:36 normalization > 02:59:07.248808 [info ] [Thread-1 ]: 02:59:07 + `dwcasa`.airbyte_cdc.`heya_campaign_receipts`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:07.256103 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.heya_campaign_receipts" 2022-07-30 02:59:36 normalization > 02:59:07.256715 [debug] [Thread-1 ]: On model.airbyte_utils.heya_campaign_receipts: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.heya_campaign_receipts"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`heya_campaign_receipts` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`heya_campaign_receipts_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > sent_at, 2022-07-30 02:59:36 normalization > user_id, 2022-07-30 02:59:36 normalization > step_gid, 2022-07-30 02:59:36 normalization > user_type, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_heya_campaign_receipts_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`heya_campaign_receipts_scd` 2022-07-30 02:59:36 normalization > -- heya_campaign_receipts from `dwcasa`.airbyte_cdc._airbyte_raw_heya_campaign_receipts 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:07.304629 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:07.306094 [info ] [Thread-6 ]: 165 of 201 OK created incremental model airbyte_cdc.order_feedbacks..................................................... [CREATE TABLE (324.0 rows, 62.3 KB processed) in 2.60s] 2022-07-30 02:59:36 normalization > 02:59:07.307595 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.order_feedbacks 2022-07-30 02:59:36 normalization > 02:59:07.307849 [debug] [Thread-6 ]: Began running node model.airbyte_utils.payers 2022-07-30 02:59:36 normalization > 02:59:07.308234 [info ] [Thread-6 ]: 172 of 201 START incremental model airbyte_cdc.payers................................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:07.309150 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.payers" 2022-07-30 02:59:36 normalization > 02:59:07.309331 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.payers 2022-07-30 02:59:36 normalization > 02:59:07.309464 [debug] [Thread-6 ]: Compiling model.airbyte_utils.payers 2022-07-30 02:59:36 normalization > 02:59:07.317879 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.payers" 2022-07-30 02:59:36 normalization > 02:59:07.318304 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:07.318460 [debug] [Thread-6 ]: Began executing node model.airbyte_utils.payers 2022-07-30 02:59:36 normalization > 02:59:07.321491 [debug] [Thread-6 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:07.384248 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:07.385173 [info ] [Thread-4 ]: 166 of 201 OK created incremental model airbyte_cdc.memento_sessions.................................................... [CREATE TABLE (3.4k rows, 618.7 KB processed) in 2.53s] 2022-07-30 02:59:36 normalization > 02:59:07.386447 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.memento_sessions 2022-07-30 02:59:36 normalization > 02:59:07.386705 [debug] [Thread-4 ]: Began running node model.airbyte_utils.omie_accounts 2022-07-30 02:59:36 normalization > 02:59:07.387135 [info ] [Thread-4 ]: 173 of 201 START incremental model airbyte_cdc.omie_accounts............................................................ [RUN] 2022-07-30 02:59:36 normalization > 02:59:07.388110 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.omie_accounts" 2022-07-30 02:59:36 normalization > 02:59:07.388281 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.omie_accounts 2022-07-30 02:59:36 normalization > 02:59:07.388415 [debug] [Thread-4 ]: Compiling model.airbyte_utils.omie_accounts 2022-07-30 02:59:36 normalization > 02:59:07.397270 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.omie_accounts" 2022-07-30 02:59:36 normalization > 02:59:07.397697 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:07.397847 [debug] [Thread-4 ]: Began executing node model.airbyte_utils.omie_accounts 2022-07-30 02:59:36 normalization > 02:59:07.400975 [debug] [Thread-4 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:07.442926 [debug] [Thread-6 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/payers?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.payers 2022-07-30 02:59:36 normalization > 02:59:07.444502 [info ] [Thread-6 ]: 02:59:07 + `dwcasa`.airbyte_cdc.`payers`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:07.449456 [debug] [Thread-6 ]: Writing runtime SQL for node "model.airbyte_utils.payers" 2022-07-30 02:59:36 normalization > 02:59:07.450016 [debug] [Thread-6 ]: On model.airbyte_utils.payers: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.payers"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`payers` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`payers_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > cpf, 2022-07-30 02:59:36 normalization > cnae, 2022-07-30 02:59:36 normalization > cnpj, 2022-07-30 02:59:36 normalization > name, 2022-07-30 02:59:36 normalization > email, 2022-07-30 02:59:36 normalization > omie_id, 2022-07-30 02:59:36 normalization > activity, 2022-07-30 02:59:36 normalization > bank_code, 2022-07-30 02:59:36 normalization > conta_azul, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > bank_branch, 2022-07-30 02:59:36 normalization > bank_account, 2022-07-30 02:59:36 normalization > credit_limit, 2022-07-30 02:59:36 normalization > phone_number, 2022-07-30 02:59:36 normalization > final_consumer, 2022-07-30 02:59:36 normalization > internal_notes, 2022-07-30 02:59:36 normalization > billing_address, 2022-07-30 02:59:36 normalization > national_simple, 2022-07-30 02:59:36 normalization > payer_confirmed, 2022-07-30 02:59:36 normalization > tax_mode_simples, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > payer_confirmed_at, 2022-07-30 02:59:36 normalization > payment_terms_days, 2022-07-30 02:59:36 normalization > state_registration, 2022-07-30 02:59:36 normalization > billing_address_city, 2022-07-30 02:59:36 normalization > billing_address_state, 2022-07-30 02:59:36 normalization > billing_address_street, 2022-07-30 02:59:36 normalization > billing_address_zipcode, 2022-07-30 02:59:36 normalization > bank_account_check_digit, 2022-07-30 02:59:36 normalization > bank_account_holder_name, 2022-07-30 02:59:36 normalization > billing_address_district, 2022-07-30 02:59:36 normalization > bank_account_holder_document, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_payers_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`payers_scd` 2022-07-30 02:59:36 normalization > -- payers from `dwcasa`.airbyte_cdc._airbyte_raw_payers 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:07.515157 [debug] [Thread-4 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/omie_accounts?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.omie_accounts 2022-07-30 02:59:36 normalization > 02:59:07.516314 [info ] [Thread-4 ]: 02:59:07 + `dwcasa`.airbyte_cdc.`omie_accounts`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:07.520951 [debug] [Thread-4 ]: Writing runtime SQL for node "model.airbyte_utils.omie_accounts" 2022-07-30 02:59:36 normalization > 02:59:07.521360 [debug] [Thread-4 ]: On model.airbyte_utils.omie_accounts: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.omie_accounts"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`omie_accounts` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`omie_accounts_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > name, 2022-07-30 02:59:36 normalization > document, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > credential, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_omie_accounts_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`omie_accounts_scd` 2022-07-30 02:59:36 normalization > -- omie_accounts from `dwcasa`.airbyte_cdc._airbyte_raw_omie_accounts 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:07.862540 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:07.863447 [info ] [Thread-7 ]: 168 of 201 OK created incremental model airbyte_cdc.payer_buyer_locations............................................... [CREATE TABLE (4.9k rows, 934.5 KB processed) in 2.55s] 2022-07-30 02:59:36 normalization > 02:59:07.863859 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.payer_buyer_locations 2022-07-30 02:59:36 normalization > 02:59:07.864143 [debug] [Thread-7 ]: Began running node model.airbyte_utils.popular_searches 2022-07-30 02:59:36 normalization > 02:59:07.864635 [info ] [Thread-7 ]: 174 of 201 START incremental model airbyte_cdc.popular_searches......................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:07.865594 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.popular_searches" 2022-07-30 02:59:36 normalization > 02:59:07.865764 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.popular_searches 2022-07-30 02:59:36 normalization > 02:59:07.865900 [debug] [Thread-7 ]: Compiling model.airbyte_utils.popular_searches 2022-07-30 02:59:36 normalization > 02:59:07.876933 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.popular_searches" 2022-07-30 02:59:36 normalization > 02:59:07.877365 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:07.877517 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.popular_searches 2022-07-30 02:59:36 normalization > 02:59:07.880713 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:08.003515 [debug] [Thread-7 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/popular_searches?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.popular_searches 2022-07-30 02:59:36 normalization > 02:59:08.004683 [info ] [Thread-7 ]: 02:59:08 + `dwcasa`.airbyte_cdc.`popular_searches`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:08.009567 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.popular_searches" 2022-07-30 02:59:36 normalization > 02:59:08.009998 [debug] [Thread-7 ]: On model.airbyte_utils.popular_searches: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.popular_searches"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`popular_searches` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`popular_searches_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > name, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_popular_searches_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`popular_searches_scd` 2022-07-30 02:59:36 normalization > -- popular_searches from `dwcasa`.airbyte_cdc._airbyte_raw_popular_searches 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:09.168838 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:09.171707 [info ] [Thread-5 ]: 169 of 201 OK created incremental model airbyte_cdc.oico_users.......................................................... [CREATE TABLE (13.0 rows, 3.4 KB processed) in 2.78s] 2022-07-30 02:59:36 normalization > 02:59:09.172213 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.oico_users 2022-07-30 02:59:36 normalization > 02:59:09.172511 [debug] [Thread-5 ]: Began running node model.airbyte_utils.payment_installments 2022-07-30 02:59:36 normalization > 02:59:09.172927 [info ] [Thread-5 ]: 175 of 201 SKIP relation airbyte_cdc.payment_installments............................................................... [SKIP] 2022-07-30 02:59:36 normalization > 02:59:09.173382 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.payment_installments 2022-07-30 02:59:36 normalization > 02:59:09.173716 [debug] [Thread-5 ]: Began running node model.airbyte_utils.flipper_gates 2022-07-30 02:59:36 normalization > 02:59:09.174227 [info ] [Thread-5 ]: 176 of 201 START incremental model airbyte_cdc.flipper_gates............................................................ [RUN] 2022-07-30 02:59:36 normalization > 02:59:09.175390 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.flipper_gates" 2022-07-30 02:59:36 normalization > 02:59:09.175640 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.flipper_gates 2022-07-30 02:59:36 normalization > 02:59:09.175770 [debug] [Thread-5 ]: Compiling model.airbyte_utils.flipper_gates 2022-07-30 02:59:36 normalization > 02:59:09.184787 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.flipper_gates" 2022-07-30 02:59:36 normalization > 02:59:09.185207 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:09.185444 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.flipper_gates 2022-07-30 02:59:36 normalization > 02:59:09.188959 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:09.393152 [debug] [Thread-5 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/flipper_gates?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.flipper_gates 2022-07-30 02:59:36 normalization > 02:59:09.394323 [info ] [Thread-5 ]: 02:59:09 + `dwcasa`.airbyte_cdc.`flipper_gates`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:09.399076 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.flipper_gates" 2022-07-30 02:59:36 normalization > 02:59:09.399544 [debug] [Thread-5 ]: On model.airbyte_utils.flipper_gates: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.flipper_gates"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`flipper_gates` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`flipper_gates_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > key, 2022-07-30 02:59:36 normalization > value, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > feature_key, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_flipper_gates_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`flipper_gates_scd` 2022-07-30 02:59:36 normalization > -- flipper_gates from `dwcasa`.airbyte_cdc._airbyte_raw_flipper_gates 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:09.604260 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:09.605131 [info ] [Thread-8 ]: 170 of 201 OK created incremental model airbyte_cdc.order_issues........................................................ [CREATE TABLE (6.5k rows, 1.7 MB processed) in 2.78s] 2022-07-30 02:59:36 normalization > 02:59:09.605681 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.order_issues 2022-07-30 02:59:36 normalization > 02:59:09.606015 [debug] [Thread-8 ]: Began running node model.airbyte_utils.order_categories 2022-07-30 02:59:36 normalization > 02:59:09.608763 [info ] [Thread-8 ]: 177 of 201 START incremental model airbyte_cdc.order_categories......................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:09.610040 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.order_categories" 2022-07-30 02:59:36 normalization > 02:59:09.610244 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.order_categories 2022-07-30 02:59:36 normalization > 02:59:09.610391 [debug] [Thread-8 ]: Compiling model.airbyte_utils.order_categories 2022-07-30 02:59:36 normalization > 02:59:09.619453 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.order_categories" 2022-07-30 02:59:36 normalization > 02:59:09.619872 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:09.620024 [debug] [Thread-8 ]: Began executing node model.airbyte_utils.order_categories 2022-07-30 02:59:36 normalization > 02:59:09.625186 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:09.765847 [debug] [Thread-8 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/order_categories?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.order_categories 2022-07-30 02:59:36 normalization > 02:59:09.767361 [info ] [Thread-8 ]: 02:59:09 + `dwcasa`.airbyte_cdc.`order_categories`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:09.772621 [debug] [Thread-8 ]: Writing runtime SQL for node "model.airbyte_utils.order_categories" 2022-07-30 02:59:36 normalization > 02:59:09.773173 [debug] [Thread-8 ]: On model.airbyte_utils.order_categories: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.order_categories"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`order_categories` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`order_categories_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > order_id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > category_id, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_order_categories_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`order_categories_scd` 2022-07-30 02:59:36 normalization > -- order_categories from `dwcasa`.airbyte_cdc._airbyte_raw_order_categories 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:09.810205 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:09.812165 [info ] [Thread-4 ]: 173 of 201 OK created incremental model airbyte_cdc.omie_accounts....................................................... [CREATE TABLE (1.0 rows, 253.0 Bytes processed) in 2.42s] 2022-07-30 02:59:36 normalization > 02:59:09.815581 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.omie_accounts 2022-07-30 02:59:36 normalization > 02:59:09.815922 [debug] [Thread-4 ]: Began running node model.airbyte_utils.roi_products 2022-07-30 02:59:36 normalization > 02:59:09.816476 [info ] [Thread-4 ]: 178 of 201 START incremental model airbyte_cdc.roi_products............................................................. [RUN] 2022-07-30 02:59:36 normalization > 02:59:09.817440 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.roi_products" 2022-07-30 02:59:36 normalization > 02:59:09.817662 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.roi_products 2022-07-30 02:59:36 normalization > 02:59:09.817969 [debug] [Thread-4 ]: Compiling model.airbyte_utils.roi_products 2022-07-30 02:59:36 normalization > 02:59:09.826807 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.roi_products" 2022-07-30 02:59:36 normalization > 02:59:09.827212 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:09.827354 [debug] [Thread-4 ]: Began executing node model.airbyte_utils.roi_products 2022-07-30 02:59:36 normalization > 02:59:09.830956 [debug] [Thread-4 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:09.894590 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:09.895759 [info ] [Thread-1 ]: 171 of 201 OK created incremental model airbyte_cdc.heya_campaign_receipts.............................................. [CREATE TABLE (30.7k rows, 8.7 MB processed) in 2.81s] 2022-07-30 02:59:36 normalization > 02:59:09.896353 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.heya_campaign_receipts 2022-07-30 02:59:36 normalization > 02:59:09.896740 [debug] [Thread-1 ]: Began running node model.airbyte_utils.requested_products 2022-07-30 02:59:36 normalization > 02:59:09.897184 [info ] [Thread-1 ]: 179 of 201 START incremental model airbyte_cdc.requested_products....................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:09.898212 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.requested_products" 2022-07-30 02:59:36 normalization > 02:59:09.898386 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.requested_products 2022-07-30 02:59:36 normalization > 02:59:09.898522 [debug] [Thread-1 ]: Compiling model.airbyte_utils.requested_products 2022-07-30 02:59:36 normalization > 02:59:09.907117 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.requested_products" 2022-07-30 02:59:36 normalization > 02:59:09.907752 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:09.907945 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.requested_products 2022-07-30 02:59:36 normalization > 02:59:09.911444 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:09.976326 [debug] [Thread-4 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/roi_products?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.roi_products 2022-07-30 02:59:36 normalization > 02:59:09.977479 [info ] [Thread-4 ]: 02:59:09 + `dwcasa`.airbyte_cdc.`roi_products`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:09.984602 [debug] [Thread-4 ]: Writing runtime SQL for node "model.airbyte_utils.roi_products" 2022-07-30 02:59:36 normalization > 02:59:09.985057 [debug] [Thread-4 ]: On model.airbyte_utils.roi_products: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.roi_products"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`roi_products` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`roi_products_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > name, 2022-07-30 02:59:36 normalization > price, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_roi_products_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`roi_products_scd` 2022-07-30 02:59:36 normalization > -- roi_products from `dwcasa`.airbyte_cdc._airbyte_raw_roi_products 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:10.041532 [debug] [Thread-1 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/requested_products?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.requested_products 2022-07-30 02:59:36 normalization > 02:59:10.042711 [info ] [Thread-1 ]: 02:59:10 + `dwcasa`.airbyte_cdc.`requested_products`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:10.047596 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.requested_products" 2022-07-30 02:59:36 normalization > 02:59:10.048273 [debug] [Thread-1 ]: On model.airbyte_utils.requested_products: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.requested_products"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`requested_products` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`requested_products_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > comment, 2022-07-30 02:59:36 normalization > order_id, 2022-07-30 02:59:36 normalization > quantity, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > deleted_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > description, 2022-07-30 02:59:36 normalization > unavailable, 2022-07-30 02:59:36 normalization > done_by_client, 2022-07-30 02:59:36 normalization > user_preference, 2022-07-30 02:59:36 normalization > product_order_id, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > original_description, 2022-07-30 02:59:36 normalization > product_canonical_id, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_requested_products_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`requested_products_scd` 2022-07-30 02:59:36 normalization > -- requested_products from `dwcasa`.airbyte_cdc._airbyte_raw_requested_products 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:10.418533 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:10.419517 [info ] [Thread-7 ]: 174 of 201 OK created incremental model airbyte_cdc.popular_searches.................................................... [CREATE TABLE (6.0 rows, 1.1 KB processed) in 2.55s] 2022-07-30 02:59:36 normalization > 02:59:10.419968 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.popular_searches 2022-07-30 02:59:36 normalization > 02:59:10.420330 [debug] [Thread-7 ]: Began running node model.airbyte_utils.reports 2022-07-30 02:59:36 normalization > 02:59:10.420817 [info ] [Thread-7 ]: 180 of 201 START incremental model airbyte_cdc.reports.................................................................. [RUN] 2022-07-30 02:59:36 normalization > 02:59:10.421930 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.reports" 2022-07-30 02:59:36 normalization > 02:59:10.422095 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.reports 2022-07-30 02:59:36 normalization > 02:59:10.422244 [debug] [Thread-7 ]: Compiling model.airbyte_utils.reports 2022-07-30 02:59:36 normalization > 02:59:10.431457 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.reports" 2022-07-30 02:59:36 normalization > 02:59:10.431877 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:10.432030 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.reports 2022-07-30 02:59:36 normalization > 02:59:10.435322 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:10.558094 [debug] [Thread-7 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/reports?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.reports 2022-07-30 02:59:36 normalization > 02:59:10.559772 [info ] [Thread-7 ]: 02:59:10 + `dwcasa`.airbyte_cdc.`reports`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:10.572056 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.reports" 2022-07-30 02:59:36 normalization > 02:59:10.572851 [debug] [Thread-7 ]: On model.airbyte_utils.reports: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.reports"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`reports` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`reports_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > sended, 2022-07-30 02:59:36 normalization > message, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > buyer_user_id, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_reports_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`reports_scd` 2022-07-30 02:59:36 normalization > -- reports from `dwcasa`.airbyte_cdc._airbyte_raw_reports 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:11.442360 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:11.443478 [info ] [Thread-5 ]: 176 of 201 OK created incremental model airbyte_cdc.flipper_gates....................................................... [CREATE TABLE (11.0 rows, 2.2 KB processed) in 2.27s] 2022-07-30 02:59:36 normalization > 02:59:11.443989 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.flipper_gates 2022-07-30 02:59:36 normalization > 02:59:11.444337 [debug] [Thread-5 ]: Began running node model.airbyte_utils.spatial_ref_sys 2022-07-30 02:59:36 normalization > 02:59:11.444691 [info ] [Thread-5 ]: 181 of 201 START incremental model airbyte_cdc.spatial_ref_sys.......................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:11.450074 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.spatial_ref_sys" 2022-07-30 02:59:36 normalization > 02:59:11.450330 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.spatial_ref_sys 2022-07-30 02:59:36 normalization > 02:59:11.450459 [debug] [Thread-5 ]: Compiling model.airbyte_utils.spatial_ref_sys 2022-07-30 02:59:36 normalization > 02:59:11.476704 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.spatial_ref_sys" 2022-07-30 02:59:36 normalization > 02:59:11.478281 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:11.478463 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.spatial_ref_sys 2022-07-30 02:59:36 normalization > 02:59:11.487922 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:11.642198 [debug] [Thread-5 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/spatial_ref_sys?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.spatial_ref_sys 2022-07-30 02:59:36 normalization > 02:59:11.643350 [info ] [Thread-5 ]: 02:59:11 + `dwcasa`.airbyte_cdc.`spatial_ref_sys`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:11.648213 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.spatial_ref_sys" 2022-07-30 02:59:36 normalization > 02:59:11.648626 [debug] [Thread-5 ]: On model.airbyte_utils.spatial_ref_sys: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.spatial_ref_sys"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`spatial_ref_sys` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`spatial_ref_sys_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > srid, 2022-07-30 02:59:36 normalization > srtext, 2022-07-30 02:59:36 normalization > auth_name, 2022-07-30 02:59:36 normalization > auth_srid, 2022-07-30 02:59:36 normalization > proj4text, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_spatial_ref_sys_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`spatial_ref_sys_scd` 2022-07-30 02:59:36 normalization > -- spatial_ref_sys from `dwcasa`.airbyte_cdc._airbyte_raw_spatial_ref_sys 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:12.029915 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:12.030883 [info ] [Thread-4 ]: 178 of 201 OK created incremental model airbyte_cdc.roi_products........................................................ [CREATE TABLE (5.0 rows, 1001.0 Bytes processed) in 2.21s] 2022-07-30 02:59:36 normalization > 02:59:12.031623 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.roi_products 2022-07-30 02:59:36 normalization > 02:59:12.031929 [debug] [Thread-4 ]: Began running node model.airbyte_utils.payments 2022-07-30 02:59:36 normalization > 02:59:12.032328 [info ] [Thread-4 ]: 182 of 201 START incremental model airbyte_cdc.payments................................................................. [RUN] 2022-07-30 02:59:36 normalization > 02:59:12.033547 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.payments" 2022-07-30 02:59:36 normalization > 02:59:12.033715 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.payments 2022-07-30 02:59:36 normalization > 02:59:12.033848 [debug] [Thread-4 ]: Compiling model.airbyte_utils.payments 2022-07-30 02:59:36 normalization > 02:59:12.045986 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.payments" 2022-07-30 02:59:36 normalization > 02:59:12.046641 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:12.046822 [debug] [Thread-4 ]: Began executing node model.airbyte_utils.payments 2022-07-30 02:59:36 normalization > 02:59:12.050742 [debug] [Thread-4 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:12.105056 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:12.106549 [info ] [Thread-8 ]: 177 of 201 OK created incremental model airbyte_cdc.order_categories.................................................... [CREATE TABLE (13.7k rows, 2.6 MB processed) in 2.50s] 2022-07-30 02:59:36 normalization > 02:59:12.107183 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.order_categories 2022-07-30 02:59:36 normalization > 02:59:12.107798 [debug] [Thread-8 ]: Began running node model.airbyte_utils.schema_migrations 2022-07-30 02:59:36 normalization > 02:59:12.108310 [info ] [Thread-8 ]: 183 of 201 START incremental model airbyte_cdc.schema_migrations........................................................ [RUN] 2022-07-30 02:59:36 normalization > 02:59:12.109506 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.schema_migrations" 2022-07-30 02:59:36 normalization > 02:59:12.109679 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.schema_migrations 2022-07-30 02:59:36 normalization > 02:59:12.109816 [debug] [Thread-8 ]: Compiling model.airbyte_utils.schema_migrations 2022-07-30 02:59:36 normalization > 02:59:12.122212 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.schema_migrations" 2022-07-30 02:59:36 normalization > 02:59:12.122644 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:12.122890 [debug] [Thread-8 ]: Began executing node model.airbyte_utils.schema_migrations 2022-07-30 02:59:36 normalization > 02:59:12.127292 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:12.191036 [debug] [Thread-4 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/payments?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.payments 2022-07-30 02:59:36 normalization > 02:59:12.192237 [info ] [Thread-4 ]: 02:59:12 + `dwcasa`.airbyte_cdc.`payments`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:12.196897 [debug] [Thread-4 ]: Writing runtime SQL for node "model.airbyte_utils.payments" 2022-07-30 02:59:36 normalization > 02:59:12.197310 [debug] [Thread-4 ]: On model.airbyte_utils.payments: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.payments"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`payments` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`payments_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > type, 2022-07-30 02:59:36 normalization > status, 2022-07-30 02:59:36 normalization > omie_id, 2022-07-30 02:59:36 normalization > discount, 2022-07-30 02:59:36 normalization > order_id, 2022-07-30 02:59:36 normalization > payer_id, 2022-07-30 02:59:36 normalization > store_id, 2022-07-30 02:59:36 normalization > xml_link, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > created_by, 2022-07-30 02:59:36 normalization > extra_fees, 2022-07-30 02:59:36 normalization > paid_value, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > canceled_at, 2022-07-30 02:59:36 normalization > payment_value, 2022-07-30 02:59:36 normalization > omie_account_id, 2022-07-30 02:59:36 normalization > postmark_read_at, 2022-07-30 02:59:36 normalization > purchase_order_id, 2022-07-30 02:59:36 normalization > tax_document_link, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > freight_partner_id, 2022-07-30 02:59:36 normalization > tax_note_issued_at, 2022-07-30 02:59:36 normalization > postmark_message_id, 2022-07-30 02:59:36 normalization > purchase_order_link, 2022-07-30 02:59:36 normalization > tax_document_number, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_payments_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`payments_scd` 2022-07-30 02:59:36 normalization > -- payments from `dwcasa`.airbyte_cdc._airbyte_raw_payments 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:12.251035 [debug] [Thread-8 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/schema_migrations?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.schema_migrations 2022-07-30 02:59:36 normalization > 02:59:12.252463 [info ] [Thread-8 ]: 02:59:12 + `dwcasa`.airbyte_cdc.`schema_migrations`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:12.257815 [debug] [Thread-8 ]: Writing runtime SQL for node "model.airbyte_utils.schema_migrations" 2022-07-30 02:59:36 normalization > 02:59:12.258320 [debug] [Thread-8 ]: On model.airbyte_utils.schema_migrations: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.schema_migrations"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`schema_migrations` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`schema_migrations_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > version, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_schema_migrations_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`schema_migrations_scd` 2022-07-30 02:59:36 normalization > -- schema_migrations from `dwcasa`.airbyte_cdc._airbyte_raw_schema_migrations 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:12.936392 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:12.937290 [info ] [Thread-7 ]: 180 of 201 OK created incremental model airbyte_cdc.reports............................................................. [CREATE TABLE (0.0 rows, 0 processed) in 2.52s] 2022-07-30 02:59:36 normalization > 02:59:12.939468 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.reports 2022-07-30 02:59:36 normalization > 02:59:12.939918 [debug] [Thread-7 ]: Began running node model.airbyte_utils.product_canonicals 2022-07-30 02:59:36 normalization > 02:59:12.941060 [info ] [Thread-7 ]: 184 of 201 START incremental model airbyte_cdc.product_canonicals....................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:12.944581 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.product_canonicals" 2022-07-30 02:59:36 normalization > 02:59:12.944771 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.product_canonicals 2022-07-30 02:59:36 normalization > 02:59:12.944951 [debug] [Thread-7 ]: Compiling model.airbyte_utils.product_canonicals 2022-07-30 02:59:36 normalization > 02:59:12.957220 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.product_canonicals" 2022-07-30 02:59:36 normalization > 02:59:12.957648 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:12.957800 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.product_canonicals 2022-07-30 02:59:36 normalization > 02:59:12.961462 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:13.075578 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:13.076915 [info ] [Thread-2 ]: 163 of 201 OK created incremental model airbyte_cdc.memento_states...................................................... [CREATE TABLE (9.2k rows, 4.1 MB processed) in 8.76s] 2022-07-30 02:59:36 normalization > 02:59:13.077981 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.memento_states 2022-07-30 02:59:36 normalization > 02:59:13.082041 [debug] [Thread-2 ]: Began running node model.airbyte_utils.shortened_urls 2022-07-30 02:59:36 normalization > 02:59:13.085292 [info ] [Thread-2 ]: 185 of 201 START incremental model airbyte_cdc.shortened_urls........................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:13.086574 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.shortened_urls" 2022-07-30 02:59:36 normalization > 02:59:13.086775 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.shortened_urls 2022-07-30 02:59:36 normalization > 02:59:13.086926 [debug] [Thread-2 ]: Compiling model.airbyte_utils.shortened_urls 2022-07-30 02:59:36 normalization > 02:59:13.102335 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.shortened_urls" 2022-07-30 02:59:36 normalization > 02:59:13.103157 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:13.105274 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.shortened_urls 2022-07-30 02:59:36 normalization > 02:59:13.115594 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:13.126451 [debug] [Thread-7 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/product_canonicals?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.product_canonicals 2022-07-30 02:59:36 normalization > 02:59:13.128012 [info ] [Thread-7 ]: 02:59:13 + `dwcasa`.airbyte_cdc.`product_canonicals`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:13.134408 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.product_canonicals" 2022-07-30 02:59:36 normalization > 02:59:13.136542 [debug] [Thread-7 ]: On model.airbyte_utils.product_canonicals: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.product_canonicals"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`product_canonicals` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):158 - Completing future exceptionally... io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:64) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] at java.lang.Thread.run(Thread.java:1589) [?:?] Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:61) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] ... 3 more Suppressed: io.airbyte.workers.exception.WorkerException: Normalization process wasn't successful at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:162) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:49) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] at java.lang.Thread.run(Thread.java:1589) [?:?] 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`product_canonicals_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > ean, 2022-07-30 02:59:36 normalization > code, 2022-07-30 02:59:36 normalization > gtin, 2022-07-30 02:59:36 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-07-30 02:59:36 normalization > name, 2022-07-30 02:59:36 normalization > brand, 2022-07-30 02:59:36 normalization > image, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > created_by, 2022-07-30 02:59:36 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):291 - Stopping temporal heartbeating... 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > width_per_unit, 2022-07-30 02:59:36 normalization > height_per_unit, 2022-07-30 02:59:36 normalization > lenght_per_unit, 2022-07-30 02:59:36 normalization > reference_price, 2022-07-30 02:59:36 normalization > weight_per_unit, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 WARN i.t.i.a.POJOActivityTaskHandler(activityFailureToResult):307 - Activity failure. ActivityId=383d3c0f-f919-3b71-94ec-4b817821625b, activityType=Normalize, attempt=1 java.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:289) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.normalize(NormalizationActivityImpl.java:75) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:578) ~[?:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:214) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:180) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:120) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:204) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:164) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.8.1.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) [?:?] at java.lang.Thread.run(Thread.java:1589) [?:?] Caused by: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.temporal.serviceclient.CheckedExceptionWrapper.wrap(CheckedExceptionWrapper.java:56) ~[temporal-serviceclient-1.8.1.jar:?] at io.temporal.internal.sync.WorkflowInternal.wrap(WorkflowInternal.java:448) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.activity.Activity.wrap(Activity.java:51) ~[temporal-sdk-1.8.1.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:135) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:103) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:284) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] ... 12 more Caused by: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed. at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:129) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:103) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:284) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] ... 12 more Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:64) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:61) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] ... 1 more Suppressed: io.airbyte.workers.exception.WorkerException: Normalization process wasn't successful at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:162) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:49) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.39.39-alpha.jar:?] at java.lang.Thread.run(Thread.java:1589) [?:?] 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_product_canonicals_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`product_canonicals_scd` 2022-07-30 02:59:36 normalization > -- product_canonicals from `dwcasa`.airbyte_cdc._airbyte_raw_product_canonicals 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:13.305401 [debug] [Thread-2 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/shortened_urls?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.shortened_urls 2022-07-30 02:59:36 normalization > 02:59:13.306941 [info ] [Thread-2 ]: 02:59:13 + `dwcasa`.airbyte_cdc.`shortened_urls`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:13.311933 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.shortened_urls" 2022-07-30 02:59:36 normalization > 02:59:13.312777 [debug] [Thread-2 ]: On model.airbyte_utils.shortened_urls: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.shortened_urls"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`shortened_urls` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`shortened_urls_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > url, 2022-07-30 02:59:36 normalization > category, 2022-07-30 02:59:36 normalization > owner_id, 2022-07-30 02:59:36 normalization > use_count, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > expires_at, 2022-07-30 02:59:36 normalization > owner_type, 2022-07-30 02:59:36 normalization > unique_key, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_shortened_urls_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`shortened_urls_scd` 2022-07-30 02:59:36 normalization > -- shortened_urls from `dwcasa`.airbyte_cdc._airbyte_raw_shortened_urls 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:13.324969 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:13.326241 [info ] [Thread-1 ]: 179 of 201 OK created incremental model airbyte_cdc.requested_products.................................................. [CREATE TABLE (38.7k rows, 12.2 MB processed) in 3.43s] 2022-07-30 02:59:36 normalization > 02:59:13.326810 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.requested_products 2022-07-30 02:59:36 normalization > 02:59:13.327137 [debug] [Thread-1 ]: Began running node model.airbyte_utils.store_order_quotes 2022-07-30 02:59:36 normalization > 02:59:13.327720 [info ] [Thread-1 ]: 186 of 201 START incremental model airbyte_cdc.store_order_quotes....................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:13.328958 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.store_order_quotes" 2022-07-30 02:59:36 normalization > 02:59:13.329142 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.store_order_quotes 2022-07-30 02:59:36 normalization > 02:59:13.329272 [debug] [Thread-1 ]: Compiling model.airbyte_utils.store_order_quotes 2022-07-30 02:59:36 normalization > 02:59:13.349125 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.store_order_quotes" 2022-07-30 02:59:36 normalization > 02:59:13.351967 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:13.353028 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.store_order_quotes 2022-07-30 02:59:36 normalization > 02:59:13.365580 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:13.530283 [debug] [Thread-1 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/store_order_quotes?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.store_order_quotes 2022-07-30 02:59:36 normalization > 02:59:13.531464 [info ] [Thread-1 ]: 02:59:13 + `dwcasa`.airbyte_cdc.`store_order_quotes`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:13.536938 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.store_order_quotes" 2022-07-30 02:59:36 normalization > 02:59:13.537372 [debug] [Thread-1 ]: On model.airbyte_utils.store_order_quotes: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.store_order_quotes"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`store_order_quotes` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`store_order_quotes_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > sent_at, 2022-07-30 02:59:36 normalization > order_id, 2022-07-30 02:59:36 normalization > store_id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > product_id, 2022-07-30 02:59:36 normalization > quote_link, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_store_order_quotes_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`store_order_quotes_scd` 2022-07-30 02:59:36 normalization > -- store_order_quotes from `dwcasa`.airbyte_cdc._airbyte_raw_store_order_quotes 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:14.007340 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:14.008528 [info ] [Thread-5 ]: 181 of 201 OK created incremental model airbyte_cdc.spatial_ref_sys..................................................... [CREATE TABLE (0.0 rows, 0 processed) in 2.56s] 2022-07-30 02:59:36 normalization > 02:59:14.009196 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.spatial_ref_sys 2022-07-30 02:59:36 normalization > 02:59:14.009624 [debug] [Thread-5 ]: Began running node model.airbyte_utils.store_categories 2022-07-30 02:59:36 normalization > 02:59:14.010004 [info ] [Thread-5 ]: 187 of 201 START incremental model airbyte_cdc.store_categories......................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:14.011253 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.store_categories" 2022-07-30 02:59:36 normalization > 02:59:14.011463 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.store_categories 2022-07-30 02:59:36 normalization > 02:59:14.011605 [debug] [Thread-5 ]: Compiling model.airbyte_utils.store_categories 2022-07-30 02:59:36 normalization > 02:59:14.021133 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.store_categories" 2022-07-30 02:59:36 normalization > 02:59:14.021579 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:14.021736 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.store_categories 2022-07-30 02:59:36 normalization > 02:59:14.025674 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:14.154921 [debug] [Thread-5 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/store_categories?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.store_categories 2022-07-30 02:59:36 normalization > 02:59:14.156499 [info ] [Thread-5 ]: 02:59:14 + `dwcasa`.airbyte_cdc.`store_categories`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:14.161656 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.store_categories" 2022-07-30 02:59:36 normalization > 02:59:14.162096 [debug] [Thread-5 ]: On model.airbyte_utils.store_categories: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.store_categories"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`store_categories` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`store_categories_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > store_id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > category_id, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_store_categories_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`store_categories_scd` 2022-07-30 02:59:36 normalization > -- store_categories from `dwcasa`.airbyte_cdc._airbyte_raw_store_categories 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:14.601422 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:14.602317 [info ] [Thread-8 ]: 183 of 201 OK created incremental model airbyte_cdc.schema_migrations................................................... [CREATE TABLE (385.0 rows, 64.7 KB processed) in 2.49s] 2022-07-30 02:59:36 normalization > 02:59:14.603205 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.schema_migrations 2022-07-30 02:59:36 normalization > 02:59:14.603912 [debug] [Thread-8 ]: Began running node model.airbyte_utils.product_reports 2022-07-30 02:59:36 normalization > 02:59:14.604354 [info ] [Thread-8 ]: 188 of 201 START incremental model airbyte_cdc.product_reports.......................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:14.605561 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.product_reports" 2022-07-30 02:59:36 normalization > 02:59:14.605732 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.product_reports 2022-07-30 02:59:36 normalization > 02:59:14.606239 [debug] [Thread-8 ]: Compiling model.airbyte_utils.product_reports 2022-07-30 02:59:36 normalization > 02:59:14.615940 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.product_reports" 2022-07-30 02:59:36 normalization > 02:59:14.616854 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:14.617015 [debug] [Thread-8 ]: Began executing node model.airbyte_utils.product_reports 2022-07-30 02:59:36 normalization > 02:59:14.620509 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:14.744299 [debug] [Thread-8 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/product_reports?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.product_reports 2022-07-30 02:59:36 normalization > 02:59:14.745847 [info ] [Thread-8 ]: 02:59:14 + `dwcasa`.airbyte_cdc.`product_reports`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:14.751157 [debug] [Thread-8 ]: Writing runtime SQL for node "model.airbyte_utils.product_reports" 2022-07-30 02:59:36 normalization > 02:59:14.751655 [debug] [Thread-8 ]: On model.airbyte_utils.product_reports: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.product_reports"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`product_reports` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`product_reports_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > type, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > product_id, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > buyer_user_id, 2022-07-30 02:59:36 normalization > product_order_id, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > price_when_reported, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_product_reports_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`product_reports_scd` 2022-07-30 02:59:36 normalization > -- product_reports from `dwcasa`.airbyte_cdc._airbyte_raw_product_reports 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:15.515296 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:15.516258 [info ] [Thread-4 ]: 182 of 201 OK created incremental model airbyte_cdc.payments............................................................ [CREATE TABLE (28.7k rows, 14.7 MB processed) in 3.48s] 2022-07-30 02:59:36 normalization > 02:59:15.516696 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.payments 2022-07-30 02:59:36 normalization > 02:59:15.517005 [debug] [Thread-4 ]: Began running node model.airbyte_utils.product_orders 2022-07-30 02:59:36 normalization > 02:59:15.518724 [info ] [Thread-4 ]: 189 of 201 START incremental model airbyte_cdc.product_orders........................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:15.519982 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.product_orders" 2022-07-30 02:59:36 normalization > 02:59:15.520158 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.product_orders 2022-07-30 02:59:36 normalization > 02:59:15.520294 [debug] [Thread-4 ]: Compiling model.airbyte_utils.product_orders 2022-07-30 02:59:36 normalization > 02:59:15.535622 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.product_orders" 2022-07-30 02:59:36 normalization > 02:59:15.536079 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:15.536233 [debug] [Thread-4 ]: Began executing node model.airbyte_utils.product_orders 2022-07-30 02:59:36 normalization > 02:59:15.542053 [debug] [Thread-4 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:15.716878 [debug] [Thread-4 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/product_orders?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.product_orders 2022-07-30 02:59:36 normalization > 02:59:15.718654 [info ] [Thread-4 ]: 02:59:15 + `dwcasa`.airbyte_cdc.`product_orders`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:15.727021 [debug] [Thread-4 ]: Writing runtime SQL for node "model.airbyte_utils.product_orders" 2022-07-30 02:59:36 normalization > 02:59:15.727518 [debug] [Thread-4 ]: On model.airbyte_utils.product_orders: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.product_orders"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`product_orders` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`product_orders_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > order_id, 2022-07-30 02:59:36 normalization > quantity, 2022-07-30 02:59:36 normalization > low_stock, 2022-07-30 02:59:36 normalization > oversized, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > dispatched, 2022-07-30 02:59:36 normalization > product_id, 2022-07-30 02:59:36 normalization > quote_link, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > returned_to, 2022-07-30 02:59:36 normalization > confirmed_by, 2022-07-30 02:59:36 normalization > under_review, 2022-07-30 02:59:36 normalization > type_quantity, 2022-07-30 02:59:36 normalization > custom_product, 2022-07-30 02:59:36 normalization > store_quote_id, 2022-07-30 02:59:36 normalization > pipefy_order_id, 2022-07-30 02:59:36 normalization > canceled_by_store, 2022-07-30 02:59:36 normalization > pipefy_product_id, 2022-07-30 02:59:36 normalization > store_location_id, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > fits_in_motorcycle, 2022-07-30 02:59:36 normalization > trusted_when_associated, 2022-07-30 02:59:36 normalization > pipefy_location_store_id, 2022-07-30 02:59:36 normalization > store_cancelation_reason, 2022-07-30 02:59:36 normalization > location_store_product_id, 2022-07-30 02:59:36 normalization > product_cost_when_associated, 2022-07-30 02:59:36 normalization > product_price_when_associated, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_product_orders_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`product_orders_scd` 2022-07-30 02:59:36 normalization > -- product_orders from `dwcasa`.airbyte_cdc._airbyte_raw_product_orders 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:16.571108 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:16.572257 [info ] [Thread-5 ]: 187 of 201 OK created incremental model airbyte_cdc.store_categories.................................................... [CREATE TABLE (2.4k rows, 464.5 KB processed) in 2.56s] 2022-07-30 02:59:36 normalization > 02:59:16.572711 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.store_categories 2022-07-30 02:59:36 normalization > 02:59:16.573190 [debug] [Thread-5 ]: Began running node model.airbyte_utils.sidekiq_sequence_records 2022-07-30 02:59:36 normalization > 02:59:16.577235 [info ] [Thread-5 ]: 190 of 201 START incremental model airbyte_cdc.sidekiq_sequence_records................................................. [RUN] 2022-07-30 02:59:36 normalization > 02:59:16.578379 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.sidekiq_sequence_records" 2022-07-30 02:59:36 normalization > 02:59:16.578582 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.sidekiq_sequence_records 2022-07-30 02:59:36 normalization > 02:59:16.578793 [debug] [Thread-5 ]: Compiling model.airbyte_utils.sidekiq_sequence_records 2022-07-30 02:59:36 normalization > 02:59:16.587788 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.sidekiq_sequence_records" 2022-07-30 02:59:36 normalization > 02:59:16.588326 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:16.588511 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.sidekiq_sequence_records 2022-07-30 02:59:36 normalization > 02:59:16.592654 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:16.720475 [debug] [Thread-5 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/sidekiq_sequence_records?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.sidekiq_sequence_records 2022-07-30 02:59:36 normalization > 02:59:16.721832 [info ] [Thread-5 ]: 02:59:16 + `dwcasa`.airbyte_cdc.`sidekiq_sequence_records`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:16.726999 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.sidekiq_sequence_records" 2022-07-30 02:59:36 normalization > 02:59:16.727428 [debug] [Thread-5 ]: On model.airbyte_utils.sidekiq_sequence_records: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.sidekiq_sequence_records"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`sidekiq_sequence_records` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`sidekiq_sequence_records_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > data, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > current_step, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_sidekiq_sequence_records_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`sidekiq_sequence_records_scd` 2022-07-30 02:59:36 normalization > -- sidekiq_sequence_records from `dwcasa`.airbyte_cdc._airbyte_raw_sidekiq_sequence_records 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:17.034770 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:17.035849 [info ] [Thread-7 ]: 184 of 201 OK created incremental model airbyte_cdc.product_canonicals.................................................. [CREATE TABLE (67.7k rows, 19.9 MB processed) in 4.09s] 2022-07-30 02:59:36 normalization > 02:59:17.037155 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.product_canonicals 2022-07-30 02:59:36 normalization > 02:59:17.037404 [debug] [Thread-7 ]: Began running node model.airbyte_utils.stockout_events 2022-07-30 02:59:36 normalization > 02:59:17.037977 [info ] [Thread-7 ]: 191 of 201 START incremental model airbyte_cdc.stockout_events.......................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:17.039278 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.stockout_events" 2022-07-30 02:59:36 normalization > 02:59:17.039485 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.stockout_events 2022-07-30 02:59:36 normalization > 02:59:17.039612 [debug] [Thread-7 ]: Compiling model.airbyte_utils.stockout_events 2022-07-30 02:59:36 normalization > 02:59:17.052323 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.stockout_events" 2022-07-30 02:59:36 normalization > 02:59:17.052889 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:17.053072 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.stockout_events 2022-07-30 02:59:36 normalization > 02:59:17.056408 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:17.084026 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:17.086024 [info ] [Thread-1 ]: 186 of 201 OK created incremental model airbyte_cdc.store_order_quotes.................................................. [CREATE TABLE (58.9k rows, 17.9 MB processed) in 3.76s] 2022-07-30 02:59:36 normalization > 02:59:17.086830 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.store_order_quotes 2022-07-30 02:59:36 normalization > 02:59:17.087129 [debug] [Thread-1 ]: Began running node model.airbyte_utils.transfeera_batches 2022-07-30 02:59:36 normalization > 02:59:17.087634 [info ] [Thread-1 ]: 192 of 201 START incremental model airbyte_cdc.transfeera_batches....................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:17.088774 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.transfeera_batches" 2022-07-30 02:59:36 normalization > 02:59:17.088949 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.transfeera_batches 2022-07-30 02:59:36 normalization > 02:59:17.089085 [debug] [Thread-1 ]: Compiling model.airbyte_utils.transfeera_batches 2022-07-30 02:59:36 normalization > 02:59:17.099825 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.transfeera_batches" 2022-07-30 02:59:36 normalization > 02:59:17.100439 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:17.100773 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.transfeera_batches 2022-07-30 02:59:36 normalization > 02:59:17.104287 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:17.213802 [debug] [Thread-7 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/stockout_events?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.stockout_events 2022-07-30 02:59:36 normalization > 02:59:17.215533 [info ] [Thread-7 ]: 02:59:17 + `dwcasa`.airbyte_cdc.`stockout_events`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:17.221163 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.stockout_events" 2022-07-30 02:59:36 normalization > 02:59:17.221600 [debug] [Thread-7 ]: On model.airbyte_utils.stockout_events: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.stockout_events"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`stockout_events` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`stockout_events_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > order_id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > created_by, 2022-07-30 02:59:36 normalization > product_id, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > price_when_deleted, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_stockout_events_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`stockout_events_scd` 2022-07-30 02:59:36 normalization > -- stockout_events from `dwcasa`.airbyte_cdc._airbyte_raw_stockout_events 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:17.227661 [debug] [Thread-1 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/transfeera_batches?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.transfeera_batches 2022-07-30 02:59:36 normalization > 02:59:17.228815 [info ] [Thread-1 ]: 02:59:17 + `dwcasa`.airbyte_cdc.`transfeera_batches`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:17.235493 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.transfeera_batches" 2022-07-30 02:59:36 normalization > 02:59:17.235884 [debug] [Thread-1 ]: On model.airbyte_utils.transfeera_batches: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.transfeera_batches"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`transfeera_batches` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`transfeera_batches_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > name, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > transfeera_id, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_transfeera_batches_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`transfeera_batches_scd` 2022-07-30 02:59:36 normalization > -- transfeera_batches from `dwcasa`.airbyte_cdc._airbyte_raw_transfeera_batches 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:17.609300 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:17.610259 [info ] [Thread-3 ]: 140 of 201 OK created incremental model airbyte_cdc.buyer_uploads....................................................... [CREATE TABLE (14.0 rows, 8.3 KB processed) in 22.67s] 2022-07-30 02:59:36 normalization > 02:59:17.611611 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.buyer_uploads 2022-07-30 02:59:36 normalization > 02:59:17.611867 [debug] [Thread-3 ]: Began running node model.airbyte_utils.terms 2022-07-30 02:59:36 normalization > 02:59:17.612235 [info ] [Thread-3 ]: 193 of 201 START incremental model airbyte_cdc.terms.................................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:17.613270 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.terms" 2022-07-30 02:59:36 normalization > 02:59:17.613444 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.terms 2022-07-30 02:59:36 normalization > 02:59:17.613687 [debug] [Thread-3 ]: Compiling model.airbyte_utils.terms 2022-07-30 02:59:36 normalization > 02:59:17.623523 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.terms" 2022-07-30 02:59:36 normalization > 02:59:17.624230 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:17.624385 [debug] [Thread-3 ]: Began executing node model.airbyte_utils.terms 2022-07-30 02:59:36 normalization > 02:59:17.629470 [debug] [Thread-3 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:17.764249 [debug] [Thread-3 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/terms?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.terms 2022-07-30 02:59:36 normalization > 02:59:17.765879 [info ] [Thread-3 ]: 02:59:17 + `dwcasa`.airbyte_cdc.`terms`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:17.771247 [debug] [Thread-3 ]: Writing runtime SQL for node "model.airbyte_utils.terms" 2022-07-30 02:59:36 normalization > 02:59:17.771774 [debug] [Thread-3 ]: On model.airbyte_utils.terms: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.terms"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`terms` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`terms_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > link, 2022-07-30 02:59:36 normalization > type, 2022-07-30 02:59:36 normalization > version, 2022-07-30 02:59:36 normalization > mandatory, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_terms_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`terms_scd` 2022-07-30 02:59:36 normalization > -- terms from `dwcasa`.airbyte_cdc._airbyte_raw_terms 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:18.148325 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:18.150793 [info ] [Thread-2 ]: 185 of 201 OK created incremental model airbyte_cdc.shortened_urls...................................................... [CREATE TABLE (19.4k rows, 6.0 MB processed) in 5.06s] 2022-07-30 02:59:36 normalization > 02:59:18.151398 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.shortened_urls 2022-07-30 02:59:36 normalization > 02:59:18.151951 [debug] [Thread-2 ]: Began running node model.airbyte_utils.responsible_deliveries 2022-07-30 02:59:36 normalization > 02:59:18.153167 [info ] [Thread-2 ]: 194 of 201 START incremental model airbyte_cdc.responsible_deliveries................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:18.155502 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.responsible_deliveries" 2022-07-30 02:59:36 normalization > 02:59:18.156168 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.responsible_deliveries 2022-07-30 02:59:36 normalization > 02:59:18.156805 [debug] [Thread-2 ]: Compiling model.airbyte_utils.responsible_deliveries 2022-07-30 02:59:36 normalization > 02:59:18.178917 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.responsible_deliveries" 2022-07-30 02:59:36 normalization > 02:59:18.179596 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:18.179794 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.responsible_deliveries 2022-07-30 02:59:36 normalization > 02:59:18.184955 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:18.356112 [debug] [Thread-2 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/responsible_deliveries?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.responsible_deliveries 2022-07-30 02:59:36 normalization > 02:59:18.357464 [info ] [Thread-2 ]: 02:59:18 + `dwcasa`.airbyte_cdc.`responsible_deliveries`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:18.363530 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.responsible_deliveries" 2022-07-30 02:59:36 normalization > 02:59:18.364342 [debug] [Thread-2 ]: On model.airbyte_utils.responsible_deliveries: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.responsible_deliveries"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`responsible_deliveries` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`responsible_deliveries_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > name, 2022-07-30 02:59:36 normalization > email, 2022-07-30 02:59:36 normalization > buyer_id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > phone_number, 2022-07-30 02:59:36 normalization > buyer_location_id, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_responsible_deliveries_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`responsible_deliveries_scd` 2022-07-30 02:59:36 normalization > -- responsible_deliveries from `dwcasa`.airbyte_cdc._airbyte_raw_responsible_deliveries 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:19.237518 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:19.238426 [info ] [Thread-7 ]: 191 of 201 OK created incremental model airbyte_cdc.stockout_events..................................................... [CREATE TABLE (1.1k rows, 255.9 KB processed) in 2.20s] 2022-07-30 02:59:36 normalization > 02:59:19.238940 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.stockout_events 2022-07-30 02:59:36 normalization > 02:59:19.239273 [debug] [Thread-7 ]: Began running node model.airbyte_utils.store_locations 2022-07-30 02:59:36 normalization > 02:59:19.239797 [info ] [Thread-7 ]: 195 of 201 START incremental model airbyte_cdc.store_locations.......................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:19.240775 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.store_locations" 2022-07-30 02:59:36 normalization > 02:59:19.241063 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.store_locations 2022-07-30 02:59:36 normalization > 02:59:19.241196 [debug] [Thread-7 ]: Compiling model.airbyte_utils.store_locations 2022-07-30 02:59:36 normalization > 02:59:19.250935 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.store_locations" 2022-07-30 02:59:36 normalization > 02:59:19.251394 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:19.251576 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.store_locations 2022-07-30 02:59:36 normalization > 02:59:19.254811 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:19.389303 [debug] [Thread-7 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/store_locations?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.store_locations 2022-07-30 02:59:36 normalization > 02:59:19.390588 [info ] [Thread-7 ]: 02:59:19 + `dwcasa`.airbyte_cdc.`store_locations`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:19.414843 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.store_locations" 2022-07-30 02:59:36 normalization > 02:59:19.416526 [debug] [Thread-7 ]: On model.airbyte_utils.store_locations: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.store_locations"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`store_locations` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`store_locations_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > lat, 2022-07-30 02:59:36 normalization > lng, 2022-07-30 02:59:36 normalization > city, 2022-07-30 02:59:36 normalization > name, 2022-07-30 02:59:36 normalization > state, 2022-07-30 02:59:36 normalization > street, 2022-07-30 02:59:36 normalization > zipcode, 2022-07-30 02:59:36 normalization > location, 2022-07-30 02:59:36 normalization > store_id, 2022-07-30 02:59:36 normalization > pipefy_id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > address_details, 2022-07-30 02:59:36 normalization > google_place_id, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_store_locations_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`store_locations_scd` 2022-07-30 02:59:36 normalization > -- store_locations from `dwcasa`.airbyte_cdc._airbyte_raw_store_locations 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:19.601665 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:19.602731 [info ] [Thread-1 ]: 192 of 201 OK created incremental model airbyte_cdc.transfeera_batches.................................................. [CREATE TABLE (1.8k rows, 376.0 KB processed) in 2.51s] 2022-07-30 02:59:36 normalization > 02:59:19.603326 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.transfeera_batches 2022-07-30 02:59:36 normalization > 02:59:19.603720 [debug] [Thread-1 ]: Began running node model.airbyte_utils.stores 2022-07-30 02:59:36 normalization > 02:59:19.604246 [info ] [Thread-1 ]: 196 of 201 START incremental model airbyte_cdc.stores................................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:19.605396 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.stores" 2022-07-30 02:59:36 normalization > 02:59:19.605563 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.stores 2022-07-30 02:59:36 normalization > 02:59:19.606075 [debug] [Thread-1 ]: Compiling model.airbyte_utils.stores 2022-07-30 02:59:36 normalization > 02:59:19.871118 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.stores" 2022-07-30 02:59:36 normalization > 02:59:19.874392 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:19.874619 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.stores 2022-07-30 02:59:36 normalization > 02:59:19.881948 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:19.930824 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:19.933400 [info ] [Thread-3 ]: 193 of 201 OK created incremental model airbyte_cdc.terms............................................................... [CREATE TABLE (2.0 rows, 520.0 Bytes processed) in 2.32s] 2022-07-30 02:59:36 normalization > 02:59:19.937571 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.terms 2022-07-30 02:59:36 normalization > 02:59:19.937975 [debug] [Thread-3 ]: Began running node model.airbyte_utils.term_acceptances 2022-07-30 02:59:36 normalization > 02:59:19.939162 [info ] [Thread-3 ]: 197 of 201 START incremental model airbyte_cdc.term_acceptances......................................................... [RUN] 2022-07-30 02:59:36 normalization > 02:59:19.941272 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.term_acceptances" 2022-07-30 02:59:36 normalization > 02:59:19.941524 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.term_acceptances 2022-07-30 02:59:36 normalization > 02:59:19.941965 [debug] [Thread-3 ]: Compiling model.airbyte_utils.term_acceptances 2022-07-30 02:59:36 normalization > 02:59:19.962889 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.term_acceptances" 2022-07-30 02:59:36 normalization > 02:59:19.963755 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:19.963962 [debug] [Thread-3 ]: Began executing node model.airbyte_utils.term_acceptances 2022-07-30 02:59:36 normalization > 02:59:19.973324 [debug] [Thread-3 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:20.014937 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:20.022382 [info ] [Thread-4 ]: 189 of 201 OK created incremental model airbyte_cdc.product_orders...................................................... [CREATE TABLE (84.8k rows, 21.1 MB processed) in 4.50s] 2022-07-30 02:59:36 normalization > 02:59:20.026613 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.product_orders 2022-07-30 02:59:36 normalization > 02:59:20.026953 [debug] [Thread-4 ]: Began running node model.airbyte_utils.product_canonical_categories 2022-07-30 02:59:36 normalization > 02:59:20.027913 [info ] [Thread-4 ]: 198 of 201 START incremental model airbyte_cdc.product_canonical_categories............................................. [RUN] 2022-07-30 02:59:36 normalization > 02:59:20.029320 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.product_canonical_categories" 2022-07-30 02:59:36 normalization > 02:59:20.029504 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.product_canonical_categories 2022-07-30 02:59:36 normalization > 02:59:20.029625 [debug] [Thread-4 ]: Compiling model.airbyte_utils.product_canonical_categories 2022-07-30 02:59:36 normalization > 02:59:20.038856 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.product_canonical_categories" 2022-07-30 02:59:36 normalization > 02:59:20.039647 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:20.039896 [debug] [Thread-4 ]: Began executing node model.airbyte_utils.product_canonical_categories 2022-07-30 02:59:36 normalization > 02:59:20.049808 [debug] [Thread-4 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:20.051959 [debug] [Thread-1 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/stores?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.stores 2022-07-30 02:59:36 normalization > 02:59:20.054113 [info ] [Thread-1 ]: 02:59:20 + `dwcasa`.airbyte_cdc.`stores`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:20.062671 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.stores" 2022-07-30 02:59:36 normalization > 02:59:20.064015 [debug] [Thread-1 ]: On model.airbyte_utils.stores: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.stores"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`stores` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`stores_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > cnae, 2022-07-30 02:59:36 normalization > cnpj, 2022-07-30 02:59:36 normalization > block, 2022-07-30 02:59:36 normalization > omie_id, 2022-07-30 02:59:36 normalization > pix_key, 2022-07-30 02:59:36 normalization > website, 2022-07-30 02:59:36 normalization > activity, 2022-07-30 02:59:36 normalization > priority, 2022-07-30 02:59:36 normalization > bank_code, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > store_type, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > bank_branch, 2022-07-30 02:59:36 normalization > sales_email, 2022-07-30 02:59:36 normalization > bank_account, 2022-07-30 02:59:36 normalization > manufacturer, 2022-07-30 02:59:36 normalization > oico_partner, 2022-07-30 02:59:36 normalization > payment_type, 2022-07-30 02:59:36 normalization > trading_name, 2022-07-30 02:59:36 normalization > business_name, 2022-07-30 02:59:36 normalization > sales_whatsapp, 2022-07-30 02:59:36 normalization > national_simple, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > state_registration, 2022-07-30 02:59:36 normalization > minimum_response_time, 2022-07-30 02:59:36 normalization > municipal_registration, 2022-07-30 02:59:36 normalization > sales_point_of_contact, 2022-07-30 02:59:36 normalization > payment_recommendations, 2022-07-30 02:59:36 normalization > bank_account_check_digit, 2022-07-30 02:59:36 normalization > bank_account_holder_name, 2022-07-30 02:59:36 normalization > bank_account_holder_document, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_stores_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`stores_scd` 2022-07-30 02:59:36 normalization > -- stores from `dwcasa`.airbyte_cdc._airbyte_raw_stores 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:20.145970 [debug] [Thread-3 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/term_acceptances?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.term_acceptances 2022-07-30 02:59:36 normalization > 02:59:20.147660 [info ] [Thread-3 ]: 02:59:20 + `dwcasa`.airbyte_cdc.`term_acceptances`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:20.153447 [debug] [Thread-3 ]: Writing runtime SQL for node "model.airbyte_utils.term_acceptances" 2022-07-30 02:59:36 normalization > 02:59:20.153908 [debug] [Thread-3 ]: On model.airbyte_utils.term_acceptances: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.term_acceptances"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`term_acceptances` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`term_acceptances_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > term_id, 2022-07-30 02:59:36 normalization > buyer_id, 2022-07-30 02:59:36 normalization > store_id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_term_acceptances_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`term_acceptances_scd` 2022-07-30 02:59:36 normalization > -- term_acceptances from `dwcasa`.airbyte_cdc._airbyte_raw_term_acceptances 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:20.193830 [debug] [Thread-4 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/product_canonical_categories?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.product_canonical_categories 2022-07-30 02:59:36 normalization > 02:59:20.195003 [info ] [Thread-4 ]: 02:59:20 + `dwcasa`.airbyte_cdc.`product_canonical_categories`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:20.201264 [debug] [Thread-4 ]: Writing runtime SQL for node "model.airbyte_utils.product_canonical_categories" 2022-07-30 02:59:36 normalization > 02:59:20.201687 [debug] [Thread-4 ]: On model.airbyte_utils.product_canonical_categories: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.product_canonical_categories"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`product_canonical_categories` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`product_canonical_categories_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > category_id, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > product_canonical_id, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_product_canonical_categories_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`product_canonical_categories_scd` 2022-07-30 02:59:36 normalization > -- product_canonical_categories from `dwcasa`.airbyte_cdc._airbyte_raw_product_canonical_categories 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:20.461532 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:20.462571 [info ] [Thread-2 ]: 194 of 201 OK created incremental model airbyte_cdc.responsible_deliveries.............................................. [CREATE TABLE (2.7k rows, 617.9 KB processed) in 2.31s] 2022-07-30 02:59:36 normalization > 02:59:20.463278 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.responsible_deliveries 2022-07-30 02:59:36 normalization > 02:59:20.463643 [debug] [Thread-2 ]: Began running node model.airbyte_utils.store_users 2022-07-30 02:59:36 normalization > 02:59:20.463993 [info ] [Thread-2 ]: 199 of 201 START incremental model airbyte_cdc.store_users.............................................................. [RUN] 2022-07-30 02:59:36 normalization > 02:59:20.465177 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.store_users" 2022-07-30 02:59:36 normalization > 02:59:20.465343 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.store_users 2022-07-30 02:59:36 normalization > 02:59:20.465476 [debug] [Thread-2 ]: Compiling model.airbyte_utils.store_users 2022-07-30 02:59:36 normalization > 02:59:20.473927 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.store_users" 2022-07-30 02:59:36 normalization > 02:59:20.474336 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:20.474482 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.store_users 2022-07-30 02:59:36 normalization > 02:59:20.477493 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:20.614137 [debug] [Thread-2 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/store_users?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.store_users 2022-07-30 02:59:36 normalization > 02:59:20.615286 [info ] [Thread-2 ]: 02:59:20 + `dwcasa`.airbyte_cdc.`store_users`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:20.620024 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.store_users" 2022-07-30 02:59:36 normalization > 02:59:20.620413 [debug] [Thread-2 ]: On model.airbyte_utils.store_users: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.store_users"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`store_users` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`store_users_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > name, 2022-07-30 02:59:36 normalization > email, 2022-07-30 02:59:36 normalization > active, 2022-07-30 02:59:36 normalization > store_id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > phone_number, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > encrypted_password, 2022-07-30 02:59:36 normalization > remember_created_at, 2022-07-30 02:59:36 normalization > reset_password_token, 2022-07-30 02:59:36 normalization > reset_password_sent_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_store_users_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`store_users_scd` 2022-07-30 02:59:36 normalization > -- store_users from `dwcasa`.airbyte_cdc._airbyte_raw_store_users 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:21.258101 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:21.259875 [info ] [Thread-5 ]: 190 of 201 OK created incremental model airbyte_cdc.sidekiq_sequence_records............................................ [CREATE TABLE (2.0 rows, 566.0 Bytes processed) in 4.68s] 2022-07-30 02:59:36 normalization > 02:59:21.260352 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.sidekiq_sequence_records 2022-07-30 02:59:36 normalization > 02:59:21.260691 [debug] [Thread-5 ]: Began running node model.airbyte_utils.store_orders 2022-07-30 02:59:36 normalization > 02:59:21.261010 [info ] [Thread-5 ]: 200 of 201 START incremental model airbyte_cdc.store_orders............................................................. [RUN] 2022-07-30 02:59:36 normalization > 02:59:21.262162 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.store_orders" 2022-07-30 02:59:36 normalization > 02:59:21.262328 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.store_orders 2022-07-30 02:59:36 normalization > 02:59:21.262462 [debug] [Thread-5 ]: Compiling model.airbyte_utils.store_orders 2022-07-30 02:59:36 normalization > 02:59:21.271357 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.store_orders" 2022-07-30 02:59:36 normalization > 02:59:21.271787 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:21.271932 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.store_orders 2022-07-30 02:59:36 normalization > 02:59:21.276884 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:21.399069 [debug] [Thread-5 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/store_orders?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.store_orders 2022-07-30 02:59:36 normalization > 02:59:21.400474 [info ] [Thread-5 ]: 02:59:21 + `dwcasa`.airbyte_cdc.`store_orders`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:21.406238 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.store_orders" 2022-07-30 02:59:36 normalization > 02:59:21.406819 [debug] [Thread-5 ]: On model.airbyte_utils.store_orders: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.store_orders"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`store_orders` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`store_orders_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > order_id, 2022-07-30 02:59:36 normalization > store_id, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > campaign_last_sent_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_store_orders_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`store_orders_scd` 2022-07-30 02:59:36 normalization > -- store_orders from `dwcasa`.airbyte_cdc._airbyte_raw_store_orders 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:21.547396 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:21.548390 [info ] [Thread-7 ]: 195 of 201 OK created incremental model airbyte_cdc.store_locations..................................................... [CREATE TABLE (1.3k rows, 533.4 KB processed) in 2.31s] 2022-07-30 02:59:36 normalization > 02:59:21.548854 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.store_locations 2022-07-30 02:59:36 normalization > 02:59:21.549197 [debug] [Thread-7 ]: Began running node model.airbyte_utils.products 2022-07-30 02:59:36 normalization > 02:59:21.549524 [info ] [Thread-7 ]: 201 of 201 START incremental model airbyte_cdc.products................................................................. [RUN] 2022-07-30 02:59:36 normalization > 02:59:21.550789 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.products" 2022-07-30 02:59:36 normalization > 02:59:21.550958 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.products 2022-07-30 02:59:36 normalization > 02:59:21.551102 [debug] [Thread-7 ]: Compiling model.airbyte_utils.products 2022-07-30 02:59:36 normalization > 02:59:21.560543 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.products" 2022-07-30 02:59:36 normalization > 02:59:21.561177 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:21.561349 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.products 2022-07-30 02:59:36 normalization > 02:59:21.564872 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-07-30 02:59:36 normalization > 02:59:21.693906 [debug] [Thread-7 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/dwcasa/datasets/airbyte_cdc/tables/products?prettyPrint=false: Not found: Table dwcasa:airbyte_cdc.products 2022-07-30 02:59:36 normalization > 02:59:21.695164 [info ] [Thread-7 ]: 02:59:21 + `dwcasa`.airbyte_cdc.`products`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-07-30 02:59:36 normalization > 02:59:21.700536 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.products" 2022-07-30 02:59:36 normalization > 02:59:21.700979 [debug] [Thread-7 ]: On model.airbyte_utils.products: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.products"} */ 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > create or replace table `dwcasa`.airbyte_cdc.`products` 2022-07-30 02:59:36 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-07-30 02:59:36 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-07-30 02:59:36 normalization > OPTIONS() 2022-07-30 02:59:36 normalization > as ( 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > -- Final base SQL model 2022-07-30 02:59:36 normalization > -- depends_on: `dwcasa`.airbyte_cdc.`products_scd` 2022-07-30 02:59:36 normalization > select 2022-07-30 02:59:36 normalization > _airbyte_unique_key, 2022-07-30 02:59:36 normalization > id, 2022-07-30 02:59:36 normalization > ncm, 2022-07-30 02:59:36 normalization > name, 2022-07-30 02:59:36 normalization > price, 2022-07-30 02:59:36 normalization > details, 2022-07-30 02:59:36 normalization > omie_id, 2022-07-30 02:59:36 normalization > trusted, 2022-07-30 02:59:36 normalization > on_offer, 2022-07-30 02:59:36 normalization > store_id, 2022-07-30 02:59:36 normalization > available, 2022-07-30 02:59:36 normalization > pipefy_id, 2022-07-30 02:59:36 normalization > changed_by, 2022-07-30 02:59:36 normalization > conta_azul, 2022-07-30 02:59:36 normalization > created_at, 2022-07-30 02:59:36 normalization > updated_at, 2022-07-30 02:59:36 normalization > _ab_cdc_lsn, 2022-07-30 02:59:36 normalization > description, 2022-07-30 02:59:36 normalization > inserted_by, 2022-07-30 02:59:36 normalization > type_quantity, 2022-07-30 02:59:36 normalization > width_per_unit, 2022-07-30 02:59:36 normalization > height_per_unit, 2022-07-30 02:59:36 normalization > lenght_per_unit, 2022-07-30 02:59:36 normalization > pipefy_store_id, 2022-07-30 02:59:36 normalization > weight_per_unit, 2022-07-30 02:59:36 normalization > minimum_quantity, 2022-07-30 02:59:36 normalization > problem_reported, 2022-07-30 02:59:36 normalization > external_identify, 2022-07-30 02:59:36 normalization > _ab_cdc_deleted_at, 2022-07-30 02:59:36 normalization > _ab_cdc_updated_at, 2022-07-30 02:59:36 normalization > oico_markup_retail, 2022-07-30 02:59:36 normalization > available_to_stores, 2022-07-30 02:59:36 normalization > product_canonical_id, 2022-07-30 02:59:36 normalization > oico_markup_wholesale, 2022-07-30 02:59:36 normalization > canonical_associated_at, 2022-07-30 02:59:36 normalization > _airbyte_ab_id, 2022-07-30 02:59:36 normalization > _airbyte_emitted_at, 2022-07-30 02:59:36 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-07-30 02:59:36 normalization > _airbyte_products_hashid 2022-07-30 02:59:36 normalization > from `dwcasa`.airbyte_cdc.`products_scd` 2022-07-30 02:59:36 normalization > -- products from `dwcasa`.airbyte_cdc._airbyte_raw_products 2022-07-30 02:59:36 normalization > where 1 = 1 2022-07-30 02:59:36 normalization > and _airbyte_active_row = 1 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > ); 2022-07-30 02:59:36 normalization > 2022-07-30 02:59:36 normalization > 02:59:22.135956 [debug] [Thread-8 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:22.136993 [info ] [Thread-8 ]: 188 of 201 OK created incremental model airbyte_cdc.product_reports..................................................... [CREATE TABLE (211.0 rows, 44.1 KB processed) in 7.53s] 2022-07-30 02:59:36 normalization > 02:59:22.137774 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.product_reports 2022-07-30 02:59:36 normalization > 02:59:22.210499 [debug] [Thread-1 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:22.211403 [info ] [Thread-1 ]: 196 of 201 OK created incremental model airbyte_cdc.stores.............................................................. [CREATE TABLE (1.2k rows, 397.0 KB processed) in 2.61s] 2022-07-30 02:59:36 normalization > 02:59:22.211802 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.stores 2022-07-30 02:59:36 normalization > 02:59:22.953557 [debug] [Thread-2 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:22.954598 [info ] [Thread-2 ]: 199 of 201 OK created incremental model airbyte_cdc.store_users......................................................... [CREATE TABLE (226.0 rows, 63.9 KB processed) in 2.49s] 2022-07-30 02:59:36 normalization > 02:59:22.955580 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.store_users 2022-07-30 02:59:36 normalization > 02:59:23.449390 [debug] [Thread-4 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:23.450450 [info ] [Thread-4 ]: 198 of 201 OK created incremental model airbyte_cdc.product_canonical_categories........................................ [CREATE TABLE (65.9k rows, 12.3 MB processed) in 3.42s] 2022-07-30 02:59:36 normalization > 02:59:23.452369 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.product_canonical_categories 2022-07-30 02:59:36 normalization > 02:59:23.794575 [debug] [Thread-5 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:23.796331 [info ] [Thread-5 ]: 200 of 201 OK created incremental model airbyte_cdc.store_orders........................................................ [CREATE TABLE (13.1k rows, 2.5 MB processed) in 2.53s] 2022-07-30 02:59:36 normalization > 02:59:23.797818 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.store_orders 2022-07-30 02:59:36 normalization > 02:59:26.043055 [debug] [Thread-3 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:26.045202 [info ] [Thread-3 ]: 197 of 201 OK created incremental model airbyte_cdc.term_acceptances.................................................... [CREATE TABLE (1.2k rows, 222.8 KB processed) in 6.11s] 2022-07-30 02:59:36 normalization > 02:59:26.046151 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.term_acceptances 2022-07-30 02:59:36 normalization > 02:59:27.196802 [debug] [Thread-7 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:27.200619 [info ] [Thread-7 ]: 201 of 201 OK created incremental model airbyte_cdc.products............................................................ [CREATE TABLE (142.4k rows, 46.5 MB processed) in 5.65s] 2022-07-30 02:59:36 normalization > 02:59:27.201925 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.products 2022-07-30 02:59:36 normalization > 02:59:31.068220 [debug] [Thread-6 ]: finished collecting timing info 2022-07-30 02:59:36 normalization > 02:59:31.069120 [info ] [Thread-6 ]: 172 of 201 OK created incremental model airbyte_cdc.payers.............................................................. [CREATE TABLE (1.9k rows, 772.5 KB processed) in 23.76s] 2022-07-30 02:59:36 normalization > 02:59:31.069580 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.payers 2022-07-30 02:59:36 normalization > 02:59:31.074741 [debug] [MainThread]: Acquiring new bigquery connection "master" 2022-07-30 02:59:36 normalization > 02:59:31.076887 [info ] [MainThread]: 2022-07-30 02:59:36 normalization > 02:59:31.077500 [info ] [MainThread]: Finished running 67 view models, 134 incremental models in 116.08s. 2022-07-30 02:59:36 normalization > 02:59:31.078024 [debug] [MainThread]: Connection 'master' was properly closed. 2022-07-30 02:59:36 normalization > 02:59:31.078338 [debug] [MainThread]: Connection 'model.airbyte_utils.store_users' was properly closed. 2022-07-30 02:59:36 normalization > 02:59:31.078663 [debug] [MainThread]: Connection 'model.airbyte_utils.stores' was properly closed. 2022-07-30 02:59:36 normalization > 02:59:31.078833 [debug] [MainThread]: Connection 'model.airbyte_utils.term_acceptances' was properly closed. 2022-07-30 02:59:36 normalization > 02:59:31.078935 [debug] [MainThread]: Connection 'model.airbyte_utils.product_canonical_categories' was properly closed. 2022-07-30 02:59:36 normalization > 02:59:31.079032 [debug] [MainThread]: Connection 'model.airbyte_utils.store_orders' was properly closed. 2022-07-30 02:59:36 normalization > 02:59:31.079127 [debug] [MainThread]: Connection 'model.airbyte_utils.payers' was properly closed. 2022-07-30 02:59:36 normalization > 02:59:31.079317 [debug] [MainThread]: Connection 'model.airbyte_utils.products' was properly closed. 2022-07-30 02:59:36 normalization > 02:59:31.079477 [debug] [MainThread]: Connection 'model.airbyte_utils.product_reports' was properly closed. 2022-07-30 02:59:36 normalization > 02:59:31.192454 [info ] [MainThread]: 2022-07-30 02:59:36 normalization > 02:59:31.192881 [info ] [MainThread]: Completed with 3 errors and 0 warnings: 2022-07-30 02:59:36 normalization > 02:59:31.193355 [info ] [MainThread]: 2022-07-30 02:59:36 normalization > 02:59:31.193815 [error] [MainThread]: Database Error in model buyers_scd (models/generated/airbyte_incremental/scd/airbyte_cdc/buyers_scd.sql) 2022-07-30 02:59:36 normalization > 02:59:31.194265 [error] [MainThread]: Invalid date: '2019-10-31T00:00:00Z' 2022-07-30 02:59:36 normalization > 02:59:31.194720 [error] [MainThread]: compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_incremental/scd/airbyte_cdc/buyers_scd.sql 2022-07-30 02:59:36 normalization > 02:59:31.195109 [info ] [MainThread]: 2022-07-30 02:59:36 normalization > 02:59:31.195650 [error] [MainThread]: Database Error in model orders_scd (models/generated/airbyte_incremental/scd/airbyte_cdc/orders_scd.sql) 2022-07-30 02:59:36 normalization > 02:59:31.196076 [error] [MainThread]: Invalid date: '2021-05-14T00:00:00Z' 2022-07-30 02:59:36 normalization > 02:59:31.196434 [error] [MainThread]: compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_incremental/scd/airbyte_cdc/orders_scd.sql 2022-07-30 02:59:36 normalization > 02:59:31.196866 [info ] [MainThread]: 2022-07-30 02:59:36 normalization > 02:59:31.197344 [error] [MainThread]: Database Error in model payment_installments_scd (models/generated/airbyte_incremental/scd/airbyte_cdc/payment_installments_scd.sql) 2022-07-30 02:59:36 normalization > 02:59:31.197826 [error] [MainThread]: Invalid date: '2022-07-15T00:00:00Z' 2022-07-30 02:59:36 normalization > 02:59:31.198207 [error] [MainThread]: compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_incremental/scd/airbyte_cdc/payment_installments_scd.sql 2022-07-30 02:59:36 normalization > 02:59:31.199238 [info ] [MainThread]: 2022-07-30 02:59:36 normalization > 02:59:31.199625 [info ] [MainThread]: Done. PASS=195 WARN=0 ERROR=3 SKIP=3 TOTAL=201