2022-04-21 10:59:03 INFO i.a.w.w.WorkerRun(call):49 - Executing worker wrapper. Airbyte version: 0.35.47-alpha 2022-04-21 10:59:03 INFO i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/224/0/logs.log 2022-04-21 10:59:03 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.35.47-alpha 2022-04-21 10:59:03 INFO i.a.w.DefaultReplicationWorker(run):103 - start sync worker. job id: 224 attempt id: 0 2022-04-21 10:59:03 INFO i.a.w.DefaultReplicationWorker(run):115 - configured sync modes: {business.ops_cogs_inventories=incremental - append} 2022-04-21 10:59:03 INFO i.a.w.p.a.DefaultAirbyteDestination(start):69 - Running destination... 2022-04-21 10:59:03 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-redshift:0.3.32 exists... 2022-04-21 10:59:03 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-redshift:0.3.32 was found locally. 2022-04-21 10:59:03 INFO i.a.w.p.DockerProcessFactory(create):104 - Creating docker job ID: 224 2022-04-21 10:59:03 INFO i.a.w.p.DockerProcessFactory(create):155 - Preparing command: docker run --rm --init -i -w /data/224/0 --log-driver none --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local airbyte/destination-redshift:0.3.32 write --config destination_config.json --catalog destination_catalog.json 2022-04-21 10:59:03 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-postgres:0.4.10 exists... 2022-04-21 10:59:03 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-postgres:0.4.10 was found locally. 2022-04-21 10:59:03 INFO i.a.w.p.DockerProcessFactory(create):104 - Creating docker job ID: 224 2022-04-21 10:59:03 INFO i.a.w.p.DockerProcessFactory(create):155 - Preparing command: docker run --rm --init -i -w /data/224/0 --log-driver none --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local airbyte/source-postgres:0.4.10 read --config source_config.json --catalog source_catalog.json 2022-04-21 10:59:03 INFO i.a.w.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$6):338 - Destination output thread started. 2022-04-21 10:59:03 INFO i.a.w.DefaultReplicationWorker(run):157 - Waiting for source and destination threads to complete. 2022-04-21 10:59:03 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):278 - Replication thread started. 2022-04-21 10:59:04 source > SLF4J: Class path contains multiple SLF4J bindings. 2022-04-21 10:59:04 source > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-04-21 10:59:04 source > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-04-21 10:59:04 source > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-04-21 10:59:04 destination > SLF4J: Class path contains multiple SLF4J bindings. 2022-04-21 10:59:04 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-04-21 10:59:04 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-04-21 10:59:04 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-04-21 10:59:04 source > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-04-21 10:59:04 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-04-21 10:59:06 source > 2022-04-21 10:59:06 INFO i.a.i.s.p.PostgresSource(main):364 - starting source: class io.airbyte.integrations.source.postgres.PostgresSource 2022-04-21 10:59:06 destination > 2022-04-21 10:59:06 INFO i.a.i.d.r.RedshiftDestination(main):70 - starting destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-04-21 10:59:06 source > 2022-04-21 10:59:06 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {read=null, catalog=source_catalog.json, config=source_config.json} 2022-04-21 10:59:06 source > 2022-04-21 10:59:06 INFO i.a.i.b.IntegrationRunner(runInternal):121 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2022-04-21 10:59:06 source > 2022-04-21 10:59:06 INFO i.a.i.b.IntegrationRunner(runInternal):122 - Command: READ 2022-04-21 10:59:06 source > 2022-04-21 10:59:06 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Integration config: IntegrationConfig{command=READ, configPath='source_config.json', catalogPath='source_catalog.json', statePath='null'} 2022-04-21 10:59:06 destination > 2022-04-21 10:59:06 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-04-21 10:59:06 destination > 2022-04-21 10:59:06 INFO i.a.i.b.IntegrationRunner(runInternal):121 - Running integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-04-21 10:59:06 destination > 2022-04-21 10:59:06 INFO i.a.i.b.IntegrationRunner(runInternal):122 - Command: WRITE 2022-04-21 10:59:06 destination > 2022-04-21 10:59:06 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-04-21 10:59:07 source > 2022-04-21 10:59:07 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-04-21 10:59:07 source > 2022-04-21 10:59:07 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-04-21 10:59:07 source > 2022-04-21 10:59:07 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-04-21 10:59:07 destination > 2022-04-21 10:59:07 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-04-21 10:59:07 destination > 2022-04-21 10:59:07 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-04-21 10:59:07 source > 2022-04-21 10:59:07 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-04-21 10:59:07 destination > 2022-04-21 10:59:07 WARN i.a.i.d.r.RedshiftDestination(determineUploadMode):56 - The "standard" upload mode is not performant, and is not recommended for production. Please use the Amazon S3 upload mode if you are syncing a large amount of data. 2022-04-21 10:59:07 destination > 2022-04-21 10:59:07 INFO i.a.i.d.j.c.SwitchingDestination(getConsumer):65 - Using destination type: INSERT_WITH_SUPER_TMP_TYPE 2022-04-21 10:59:07 source > 2022-04-21 10:59:07 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL 2022-04-21 10:59:07 destination > 2022-04-21 10:59:07 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=ops_cogs_inventories, namespace=null, outputSchemaName=entrepot, tmpTableName=_airbyte_tmp_psq_ops_cogs_inventories, outputTableName=_airbyte_raw_ops_cogs_inventories, syncMode=append} 2022-04-21 10:59:08 destination > 2022-04-21 10:59:08 INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):116 - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2022-04-21 10:59:08 destination > 2022-04-21 10:59:08 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):123 - Preparing tmp tables in destination started for 1 streams 2022-04-21 10:59:08 destination > 2022-04-21 10:59:08 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream ops_cogs_inventories. schema: entrepot, tmp table name: _airbyte_tmp_psq_ops_cogs_inventories 2022-04-21 10:59:08 source > 2022-04-21 10:59:08 INFO i.a.i.s.p.PostgresSource(isCdc):253 - using CDC: false 2022-04-21 10:59:08 source > 2022-04-21 10:59:08 INFO i.a.i.s.j.AbstractJdbcSource(lambda$getCheckOperations$1):88 - Attempting to get metadata from the database to see if we can connect. 2022-04-21 10:59:08 source > 2022-04-21 10:59:08 INFO i.a.i.s.r.CdcStateManager():26 - Initialized CDC state with: null 2022-04-21 10:59:08 source > 2022-04-21 10:59:08 INFO i.a.i.s.r.StateManager(createCursorInfoForStream):118 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='ops_cogs_inventories', namespace='business'}, New Cursor Field: created_at. Resetting cursor value 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table ops_cogs_inventories column item_id (type int4[10]) -> Json type io.airbyte.protocol.models.JsonSchemaType@f8f56b9 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table ops_cogs_inventories column sku (type varchar[20]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table ops_cogs_inventories column quantity (type int4[10]) -> Json type io.airbyte.protocol.models.JsonSchemaType@f8f56b9 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table ops_cogs_inventories column last_po_prices (type float4[8]) -> Json type io.airbyte.protocol.models.JsonSchemaType@f8f56b9 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table ops_cogs_inventories column avg_sofa (type float4[8]) -> Json type io.airbyte.protocol.models.JsonSchemaType@f8f56b9 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table ops_cogs_inventories column cogs_prices (type float4[8]) -> Json type io.airbyte.protocol.models.JsonSchemaType@f8f56b9 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table ops_cogs_inventories column preferred_prices (type float4[8]) -> Json type io.airbyte.protocol.models.JsonSchemaType@f8f56b9 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table ops_cogs_inventories column prices (type float4[8]) -> Json type io.airbyte.protocol.models.JsonSchemaType@f8f56b9 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table ops_cogs_inventories column inventory_values (type float4[8]) -> Json type io.airbyte.protocol.models.JsonSchemaType@f8f56b9 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table ops_cogs_inventories column created_at (type timestamptz[35]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table packages_avg column id (type uuid[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table packages_avg column country_code (type varchar[2]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table packages_avg column furniture_type (type varchar[20]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table packages_avg column packages_avg (type float8[17]) -> Json type io.airbyte.protocol.models.JsonSchemaType@f8f56b9 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table packages_avg column float_avg (type float8[17]) -> Json type io.airbyte.protocol.models.JsonSchemaType@f8f56b9 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table shipping_details column id (type uuid[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table shipping_details column default_id (type uuid[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table shipping_details column start_date (type date[13]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table shipping_details column end_date (type date[13]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table shipping_details column days (type int4[10]) -> Json type io.airbyte.protocol.models.JsonSchemaType@f8f56b9 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table shipping_details column created_at (type timestamptz[35]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table taxes column id (type uuid[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table taxes column rate (type float8[17]) -> Json type io.airbyte.protocol.models.JsonSchemaType@f8f56b9 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table taxes column type (type uuid[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table taxes column country (type int4[10]) -> Json type io.airbyte.protocol.models.JsonSchemaType@f8f56b9 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table furniture_types column furniture_type (type varchar[40]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table furniture_types column name (type varchar[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table furniture_types column product_system_id (type int4[10]) -> Json type io.airbyte.protocol.models.JsonSchemaType@f8f56b9 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table countries column id (type uuid[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table countries column name (type varchar[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table countries column code (type varchar[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table countries column currency (type int4[10]) -> Json type io.airbyte.protocol.models.JsonSchemaType@f8f56b9 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table countries column ns_item_price_name (type varchar[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table tax_type column id (type uuid[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table tax_type column description (type varchar[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table shipping_details_default column id (type uuid[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table shipping_details_default column country_code (type varchar[2]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table shipping_details_default column type_code (type varchar[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table shipping_details_default column shipping_method_id (type int4[10]) -> Json type io.airbyte.protocol.models.JsonSchemaType@f8f56b9 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table shipping_details_default column default_days (type int4[10]) -> Json type io.airbyte.protocol.models.JsonSchemaType@f8f56b9 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table shipping_details_default column is_workshop (type bool[1]) -> Json type io.airbyte.protocol.models.JsonSchemaType@7fab4be7 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table shipping_details_default column furniture_type (type varchar[20]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_load_units column id (type uuid[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_load_units column created_at (type timestamp[29]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_load_units column closed_at (type timestamp[29]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_load_units column dispatched_at (type timestamp[29]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_load_units column number (type serial[10]) -> Json type io.airbyte.protocol.models.JsonSchemaType@f8f56b9 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_load_units column dispatch_details (type int4[10]) -> Json type io.airbyte.protocol.models.JsonSchemaType@f8f56b9 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_load_units column shipping_agent (type int4[10]) -> Json type io.airbyte.protocol.models.JsonSchemaType@f8f56b9 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_load_units column owner (type varchar[255]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_load_units column length (type int4[10]) -> Json type io.airbyte.protocol.models.JsonSchemaType@f8f56b9 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_load_units column width (type int4[10]) -> Json type io.airbyte.protocol.models.JsonSchemaType@f8f56b9 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_load_units column pallet_type (type varchar[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_packages column id (type uuid[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_packages column package_id (type varchar[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_packages column created_at (type timestamp[29]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_packages column load_unit (type uuid[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_packages column order_id (type varchar[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_packages column event_payload (type xml[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_packages column scanned (type bool[1]) -> Json type io.airbyte.protocol.models.JsonSchemaType@7fab4be7 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_packages column weight (type varchar[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_packages column scanned_at (type timestamp[29]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_packages column packing_line (type varchar[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_packages column shipping_number (type varchar[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_packages column box_design (type int4[10]) -> Json type io.airbyte.protocol.models.JsonSchemaType@f8f56b9 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_packages column should_print_box (type bool[1]) -> Json type io.airbyte.protocol.models.JsonSchemaType@7fab4be7 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_packages column box_was_printed (type bool[1]) -> Json type io.airbyte.protocol.models.JsonSchemaType@7fab4be7 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_packages column height_in_cm (type varchar[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_packages column width_in_cm (type varchar[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_packages column length_in_cm (type varchar[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_packages column prolag_name (type varchar[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_packages column height_from_p_name (type varchar[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_dispatch_details column id (type serial[10]) -> Json type io.airbyte.protocol.models.JsonSchemaType@f8f56b9 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_dispatch_details column driver (type varchar[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_dispatch_details column truck (type varchar[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_dispatch_details column expected_arrival (type timestamp[29]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_dispatch_details column dispatch (type timestamp[29]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table outbound_dispatch_details column human_readable_id (type varchar[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table packages_items column id (type uuid[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table packages_items column package_id (type varchar[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table packages_items column sku (type varchar[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table packages_items column amount (type float4[8]) -> Json type io.airbyte.protocol.models.JsonSchemaType@f8f56b9 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table shipping_details_type column code (type varchar[60]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table shipping_details_type column name (type varchar[2147483647]) -> Json type io.airbyte.protocol.models.JsonSchemaType@4f186450 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):137 - Table shipping_details_type column step (type int4[10]) -> Json type io.airbyte.protocol.models.JsonSchemaType@f8f56b9 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.p.PostgresSource(isCdc):253 - using CDC: false 2022-04-21 10:59:09 source > 2022-04-21 10:59:09 INFO i.a.i.s.r.AbstractRelationalDbSource(queryTableFullRefresh):35 - Queueing query for table: ops_cogs_inventories 2022-04-21 10:59:10 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 1000 2022-04-21 10:59:11 destination > 2022-04-21 10:59:11 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):133 - Preparing tables in destination completed. 2022-04-21 10:59:11 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 2000 2022-04-21 10:59:12 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 3000 2022-04-21 10:59:12 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 4000 2022-04-21 10:59:12 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 5000 2022-04-21 10:59:12 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 6000 2022-04-21 10:59:13 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 7000 2022-04-21 10:59:13 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 8000 2022-04-21 10:59:13 source > 2022-04-21 10:59:13 INFO i.a.i.s.r.StateDecoratingIterator(computeNext):60 - State Report: stream name: AirbyteStreamNameNamespacePair{name='ops_cogs_inventories', namespace='business'}, original cursor field: null, original cursor null, cursor field: created_at, new cursor: 2022-03-03T00:00:00.000000Z 2022-04-21 10:59:13 source > 2022-04-21 10:59:13 INFO i.a.i.s.r.AbstractDbSource(lambda$read$2):124 - Closing database connection pool. 2022-04-21 10:59:13 source > 2022-04-21 10:59:13 INFO i.a.i.s.r.AbstractDbSource(lambda$read$2):126 - Closed database connection pool. 2022-04-21 10:59:13 source > 2022-04-21 10:59:13 INFO i.a.i.b.IntegrationRunner(runInternal):169 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2022-04-21 10:59:13 source > 2022-04-21 10:59:13 INFO i.a.i.s.p.PostgresSource(main):366 - completed source: class io.airbyte.integrations.source.postgres.PostgresSource 2022-04-21 10:59:13 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):304 - Total records read: 8994 2022-04-21 10:59:13 INFO i.a.w.DefaultReplicationWorker(run):162 - One of source or destination thread complete. Waiting on the other. 2022-04-21 10:59:13 destination > 2022-04-21 10:59:13 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded. 2022-04-21 10:59:13 destination > 2022-04-21 10:59:13 INFO i.a.i.d.b.BufferedStreamConsumer(close):170 - executing on success close procedure. 2022-04-21 10:59:13 destination > 2022-04-21 10:59:13 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):84 - Flushing ops_cogs_inventories: 8993 records (6 MB) 2022-04-21 10:59:13 destination > 2022-04-21 10:59:13 INFO i.a.i.d.r.RedshiftSqlOperations(insertRecordsInternal):76 - actual size of batch: 8993 2022-04-21 10:59:18 destination > 2022-04-21 10:59:18 INFO i.a.i.d.r.RedshiftSqlOperations(onDestinationCloseOperations):110 - Executing operations for Redshift Destination DB engine... 2022-04-21 10:59:18 destination > 2022-04-21 10:59:18 INFO i.a.i.d.r.RedshiftSqlOperations(discoverNotSuperTables):129 - Discovering NOT SUPER table types... 2022-04-21 10:59:18 destination > 2022-04-21 10:59:18 INFO i.a.i.d.r.RedshiftSqlOperations(onDestinationCloseOperations):118 - Executing operations for Redshift Destination DB engine completed. 2022-04-21 10:59:18 destination > 2022-04-21 10:59:18 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):163 - Finalizing tables in destination started for 1 streams 2022-04-21 10:59:18 destination > 2022-04-21 10:59:18 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):168 - Finalizing stream ops_cogs_inventories. schema entrepot, tmp table _airbyte_tmp_psq_ops_cogs_inventories, final table _airbyte_raw_ops_cogs_inventories 2022-04-21 10:59:19 destination > 2022-04-21 10:59:19 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):181 - Executing finalization of tables. 2022-04-21 10:59:22 destination > 2022-04-21 10:59:22 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):183 - Finalizing tables in destination completed. 2022-04-21 10:59:22 destination > 2022-04-21 10:59:22 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):186 - Cleaning tmp tables in destination started for 1 streams 2022-04-21 10:59:22 destination > 2022-04-21 10:59:22 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):190 - Cleaning tmp table in destination started for stream ops_cogs_inventories. schema entrepot, tmp table name: _airbyte_tmp_psq_ops_cogs_inventories 2022-04-21 10:59:23 destination > 2022-04-21 10:59:23 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):195 - Cleaning tmp tables in destination completed. 2022-04-21 10:59:23 INFO i.a.w.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$6):348 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@79421e1e[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@7785ef46[data={"cdc":false,"streams":[{"stream_name":"ops_cogs_inventories","stream_namespace":"business","cursor_field":["created_at"],"cursor":"2022-03-03T00:00:00.000000Z"}]},additionalProperties={}],additionalProperties={}] 2022-04-21 10:59:23 destination > 2022-04-21 10:59:23 INFO i.a.i.b.IntegrationRunner(runInternal):169 - Completed integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-04-21 10:59:23 destination > 2022-04-21 10:59:23 INFO i.a.i.d.r.RedshiftDestination(main):72 - completed destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-04-21 10:59:23 INFO i.a.w.DefaultReplicationWorker(run):164 - Source and destination threads complete. 2022-04-21 10:59:23 INFO i.a.w.DefaultReplicationWorker(run):227 - sync summary: io.airbyte.config.ReplicationAttemptSummary@4de1329e[status=completed,recordsSynced=8993,bytesSynced=1837407,startTime=1650538743539,endTime=1650538763492,totalStats=io.airbyte.config.SyncStats@368764fd[recordsEmitted=8993,bytesEmitted=1837407,stateMessagesEmitted=1,recordsCommitted=8993],streamStats=[io.airbyte.config.StreamSyncStats@6e7cec12[streamName=ops_cogs_inventories,stats=io.airbyte.config.SyncStats@5562cac4[recordsEmitted=8993,bytesEmitted=1837407,stateMessagesEmitted=,recordsCommitted=8993]]]] 2022-04-21 10:59:23 INFO i.a.w.DefaultReplicationWorker(run):247 - Source output at least one state message 2022-04-21 10:59:23 INFO i.a.w.DefaultReplicationWorker(run):253 - State capture: Updated state to: Optional[io.airbyte.config.State@11d36734[state={"cdc":false,"streams":[{"stream_name":"ops_cogs_inventories","stream_namespace":"business","cursor_field":["created_at"],"cursor":"2022-03-03T00:00:00.000000Z"}]}]] 2022-04-21 10:59:23 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-04-21 10:59:23 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$1):147 - sync summary: io.airbyte.config.StandardSyncOutput@5e93131b[standardSyncSummary=io.airbyte.config.StandardSyncSummary@7ae907f8[status=completed,recordsSynced=8993,bytesSynced=1837407,startTime=1650538743539,endTime=1650538763492,totalStats=io.airbyte.config.SyncStats@368764fd[recordsEmitted=8993,bytesEmitted=1837407,stateMessagesEmitted=1,recordsCommitted=8993],streamStats=[io.airbyte.config.StreamSyncStats@6e7cec12[streamName=ops_cogs_inventories,stats=io.airbyte.config.SyncStats@5562cac4[recordsEmitted=8993,bytesEmitted=1837407,stateMessagesEmitted=,recordsCommitted=8993]]]],state=io.airbyte.config.State@11d36734[state={"cdc":false,"streams":[{"stream_name":"ops_cogs_inventories","stream_namespace":"business","cursor_field":["created_at"],"cursor":"2022-03-03T00:00:00.000000Z"}]}],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@26f88103[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@2b473404[stream=io.airbyte.protocol.models.AirbyteStream@6d8af1bc[name=ops_cogs_inventories,jsonSchema={"type":"object","properties":{"sku":{"type":"string"},"prices":{"type":"number"},"item_id":{"type":"number"},"avg_sofa":{"type":"number"},"quantity":{"type":"number"},"created_at":{"type":"string"},"cogs_prices":{"type":"number"},"last_po_prices":{"type":"number"},"inventory_values":{"type":"number"},"preferred_prices":{"type":"number"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=,additionalProperties={}],syncMode=incremental,cursorField=[created_at],destinationSyncMode=append,primaryKey=[],additionalProperties={}]],additionalProperties={}],failures=[]] 2022-04-21 10:59:23 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):235 - Stopping temporal heartbeating... 2022-04-21 10:59:23 INFO i.a.c.p.ConfigRepository(updateConnectionState):594 - Updating connection 2145236a-a36f-418b-9829-1fb38ef3069a state: io.airbyte.config.State@2f096bea[state={"cdc":false,"streams":[{"stream_name":"ops_cogs_inventories","stream_namespace":"business","cursor_field":["created_at"],"cursor":"2022-03-03T00:00:00.000000Z"}]}] 2022-04-21 10:59:23 INFO i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/224/0/logs.log 2022-04-21 10:59:23 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.35.47-alpha 2022-04-21 10:59:23 INFO i.a.w.DefaultNormalizationWorker(run):46 - Running normalization. 2022-04-21 10:59:23 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):122 - Running with normalization version: airbyte/normalization:0.1.69 2022-04-21 10:59:23 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/normalization:0.1.69 exists... 2022-04-21 10:59:23 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/normalization:0.1.69 was found locally. 2022-04-21 10:59:23 INFO i.a.w.p.DockerProcessFactory(create):104 - Creating docker job ID: 224 2022-04-21 10:59:23 INFO i.a.w.p.DockerProcessFactory(create):155 - Preparing command: docker run --rm --init -i -w /data/224/0/normalize --log-driver none --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local airbyte/normalization:0.1.69 run --integration-type redshift --config destination_config.json --catalog destination_catalog.json 2022-04-21 10:59:24 normalization > Running: transform-config --config destination_config.json --integration-type redshift --out /data/224/0/normalize 2022-04-21 10:59:24 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/224/0/normalize') 2022-04-21 10:59:24 normalization > transform_redshift 2022-04-21 10:59:24 normalization > Running: transform-catalog --integration-type redshift --profile-config-dir /data/224/0/normalize --catalog destination_catalog.json --out /data/224/0/normalize/models/generated/ --json-column _airbyte_data 2022-04-21 10:59:24 normalization > Processing destination_catalog.json... 2022-04-21 10:59:24 normalization > Generating airbyte_ctes/entrepot/ops_cogs_inventories_ab1.sql from ops_cogs_inventories 2022-04-21 10:59:24 normalization > Generating airbyte_ctes/entrepot/ops_cogs_inventories_ab2.sql from ops_cogs_inventories 2022-04-21 10:59:24 normalization > Generating airbyte_ctes/entrepot/ops_cogs_inventories_ab3.sql from ops_cogs_inventories 2022-04-21 10:59:24 normalization > Generating airbyte_incremental/entrepot/ops_cogs_inventories.sql from ops_cogs_inventories 2022-04-21 10:59:24 normalization > detected no config file for ssh, assuming ssh is off. 2022-04-21 10:59:26 normalization > Running with dbt=0.21.1 2022-04-21 10:59:27 normalization > Unable to do partial parsing because ../build/partial_parse.msgpack not found 2022-04-21 10:59:28 normalization > [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. 2022-04-21 10:59:28 normalization > There are 2 unused configuration paths: 2022-04-21 10:59:28 normalization > - models.airbyte_utils.generated.airbyte_tables 2022-04-21 10:59:28 normalization > - models.airbyte_utils.generated.airbyte_views 2022-04-21 10:59:28 normalization > 2022-04-21 10:59:28 normalization > Found 4 models, 0 tests, 0 snapshots, 0 analyses, 520 macros, 0 operations, 0 seed files, 1 source, 0 exposures 2022-04-21 10:59:28 normalization > 2022-04-21 10:59:29 normalization > 10:59:29 | Concurrency: 4 threads (target='prod') 2022-04-21 10:59:29 normalization > 10:59:29 | 2022-04-21 10:59:29 normalization > 10:59:29 | 1 of 1 START incremental model entrepot.ops_cogs_inventories................................................. [RUN] 2022-04-21 10:59:29 normalization > 10:59:29 | 1 of 1 ERROR creating incremental model entrepot.ops_cogs_inventories........................................ [ERROR in 0.48s] 2022-04-21 10:59:29 normalization > 10:59:29 | 2022-04-21 10:59:29 normalization > 10:59:29 | Finished running 1 incremental model in 1.04s. 2022-04-21 10:59:29 normalization > 2022-04-21 10:59:29 normalization > Completed with 1 error and 0 warnings: 2022-04-21 10:59:29 normalization > 2022-04-21 10:59:29 normalization > Database Error in model ops_cogs_inventories (models/generated/airbyte_incremental/entrepot/ops_cogs_inventories.sql) 2022-04-21 10:59:29 normalization > function json_extract_path_text(super, "unknown", boolean) does not exist 2022-04-21 10:59:29 normalization > HINT: No function matches the given name and argument types. You may need to add explicit type casts. 2022-04-21 10:59:29 normalization > 2022-04-21 10:59:29 normalization > Done. PASS=0 WARN=0 ERROR=1 SKIP=0 TOTAL=1 2022-04-21 10:59:30 normalization > 2022-04-21 10:59:30 normalization > Diagnosing dbt debug to check if destination is available for dbt and well configured (1): 2022-04-21 10:59:30 normalization > 2022-04-21 10:59:32 normalization > Running with dbt=0.21.1 2022-04-21 10:59:32 normalization > dbt version: 0.21.1 2022-04-21 10:59:32 normalization > python version: 3.8.12 2022-04-21 10:59:32 normalization > python path: /usr/local/bin/python 2022-04-21 10:59:32 normalization > os info: Linux-4.14.173-137.229.amzn2.x86_64-x86_64-with-glibc2.2.5 2022-04-21 10:59:32 normalization > Using profiles.yml file at /data/224/0/normalize/profiles.yml 2022-04-21 10:59:32 normalization > Using dbt_project.yml file at /data/224/0/normalize/dbt_project.yml 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > Configuration: 2022-04-21 10:59:32 normalization > profiles.yml file [OK found and valid] 2022-04-21 10:59:32 normalization > dbt_project.yml file [OK found and valid] 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > Required dependencies: 2022-04-21 10:59:32 normalization > - git [OK found] 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > Connection: 2022-04-21 10:59:32 normalization > host: mycs-datawarehouse-redshiftdw-7yqke1abcqcl.cwiq3ymuzc7r.eu-west-1.redshift.amazonaws.com 2022-04-21 10:59:32 normalization > port: 5439 2022-04-21 10:59:32 normalization > user: airbyte_user 2022-04-21 10:59:32 normalization > database: dw 2022-04-21 10:59:32 normalization > schema: entrepot 2022-04-21 10:59:32 normalization > search_path: None 2022-04-21 10:59:32 normalization > keepalives_idle: 240 2022-04-21 10:59:32 normalization > sslmode: None 2022-04-21 10:59:32 normalization > method: database 2022-04-21 10:59:32 normalization > cluster_id: None 2022-04-21 10:59:32 normalization > iam_profile: None 2022-04-21 10:59:32 normalization > iam_duration_seconds: 900 2022-04-21 10:59:32 normalization > Connection test: [OK connection ok] 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > All checks passed! 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > Forward dbt output logs to diagnose/debug errors (0): 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:26.849858 (MainThread): Running with dbt=0.21.1 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.135157 (MainThread): running dbt with arguments Namespace(cls=, debug=False, defer=None, exclude=None, fail_fast=False, full_refresh=False, log_cache_events=False, log_format='default', partial_parse=None, profile=None, profiles_dir='/data/224/0/normalize', project_dir='/data/224/0/normalize', record_timing_info=None, rpc_method='run', select=None, selector_name=None, single_threaded=False, state=None, strict=False, target=None, test_new_parser=False, threads=None, use_cache=True, use_colors=None, use_experimental_parser=False, vars='{}', version_check=True, warn_error=False, which='run', write_json=True) 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.135909 (MainThread): Tracking: do not track 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.165294 (MainThread): Unable to do partial parsing because ../build/partial_parse.msgpack not found 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.191738 (MainThread): Parsing macros/get_custom_schema.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.193098 (MainThread): Parsing macros/incremental.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.201834 (MainThread): Parsing macros/should_full_refresh.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.208614 (MainThread): Parsing macros/star_intersect.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.216248 (MainThread): Parsing macros/cross_db_utils/array.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.233894 (MainThread): Parsing macros/cross_db_utils/concat.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.236815 (MainThread): Parsing macros/cross_db_utils/current_timestamp.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.237684 (MainThread): Parsing macros/cross_db_utils/datatypes.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.252025 (MainThread): Parsing macros/cross_db_utils/except.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.253160 (MainThread): Parsing macros/cross_db_utils/hash.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.253966 (MainThread): Parsing macros/cross_db_utils/json_operations.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.297516 (MainThread): Parsing macros/cross_db_utils/quote.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.299872 (MainThread): Parsing macros/cross_db_utils/surrogate_key.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.302477 (MainThread): Parsing macros/cross_db_utils/type_conversions.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.310141 (MainThread): Parsing macros/schema_tests/equal_rowcount.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.311781 (MainThread): Parsing macros/schema_tests/equality.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.320364 (MainThread): Parsing macros/adapters.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.356496 (MainThread): Parsing macros/catalog.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.372584 (MainThread): Parsing macros/relations.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.373461 (MainThread): Parsing macros/materializations/snapshot_merge.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.374333 (MainThread): Parsing macros/adapters.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.403358 (MainThread): Parsing macros/catalog.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.406349 (MainThread): Parsing macros/relations.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.408084 (MainThread): Parsing macros/materializations/snapshot_merge.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.410316 (MainThread): Parsing macros/core.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.415313 (MainThread): Parsing macros/adapters/common.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.486941 (MainThread): Parsing macros/etc/datetime.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.498669 (MainThread): Parsing macros/etc/get_custom_alias.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.500871 (MainThread): Parsing macros/etc/get_custom_database.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.503023 (MainThread): Parsing macros/etc/get_custom_schema.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.506368 (MainThread): Parsing macros/etc/is_incremental.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.508441 (MainThread): Parsing macros/etc/query.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.509768 (MainThread): Parsing macros/etc/where_subquery.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.512294 (MainThread): Parsing macros/materializations/helpers.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.525740 (MainThread): Parsing macros/materializations/test.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.534695 (MainThread): Parsing macros/materializations/common/merge.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.552911 (MainThread): Parsing macros/materializations/incremental/helpers.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.555343 (MainThread): Parsing macros/materializations/incremental/incremental.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.568753 (MainThread): Parsing macros/materializations/incremental/on_schema_change.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.595310 (MainThread): Parsing macros/materializations/seed/seed.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.627173 (MainThread): Parsing macros/materializations/snapshot/snapshot.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.667623 (MainThread): Parsing macros/materializations/snapshot/snapshot_merge.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.670083 (MainThread): Parsing macros/materializations/snapshot/strategies.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.693596 (MainThread): Parsing macros/materializations/table/table.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.703348 (MainThread): Parsing macros/materializations/view/create_or_replace_view.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.708749 (MainThread): Parsing macros/materializations/view/view.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.718009 (MainThread): Parsing macros/schema_tests/accepted_values.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.721106 (MainThread): Parsing macros/schema_tests/not_null.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.722795 (MainThread): Parsing macros/schema_tests/relationships.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.725104 (MainThread): Parsing macros/schema_tests/unique.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.726996 (MainThread): Parsing macros/cross_db_utils/_is_ephemeral.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.729617 (MainThread): Parsing macros/cross_db_utils/_is_relation.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.731167 (MainThread): Parsing macros/cross_db_utils/cast_bool_to_text.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.733238 (MainThread): Parsing macros/cross_db_utils/concat.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.734660 (MainThread): Parsing macros/cross_db_utils/current_timestamp.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.739809 (MainThread): Parsing macros/cross_db_utils/datatypes.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.748456 (MainThread): Parsing macros/cross_db_utils/date_trunc.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.750568 (MainThread): Parsing macros/cross_db_utils/dateadd.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.754601 (MainThread): Parsing macros/cross_db_utils/datediff.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.768028 (MainThread): Parsing macros/cross_db_utils/except.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.769640 (MainThread): Parsing macros/cross_db_utils/hash.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.771703 (MainThread): Parsing macros/cross_db_utils/identifier.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.774065 (MainThread): Parsing macros/cross_db_utils/intersect.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.775624 (MainThread): Parsing macros/cross_db_utils/last_day.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.780568 (MainThread): Parsing macros/cross_db_utils/length.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.782414 (MainThread): Parsing macros/cross_db_utils/literal.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.783821 (MainThread): Parsing macros/cross_db_utils/position.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.786224 (MainThread): Parsing macros/cross_db_utils/replace.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.788013 (MainThread): Parsing macros/cross_db_utils/right.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.791147 (MainThread): Parsing macros/cross_db_utils/safe_cast.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.793896 (MainThread): Parsing macros/cross_db_utils/split_part.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.796484 (MainThread): Parsing macros/cross_db_utils/width_bucket.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.803415 (MainThread): Parsing macros/jinja_helpers/log_info.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.805018 (MainThread): Parsing macros/jinja_helpers/pretty_log_format.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.807323 (MainThread): Parsing macros/jinja_helpers/pretty_time.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.809042 (MainThread): Parsing macros/jinja_helpers/slugify.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.810672 (MainThread): Parsing macros/materializations/insert_by_period_materialization.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.842974 (MainThread): Parsing macros/schema_tests/accepted_range.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.846558 (MainThread): Parsing macros/schema_tests/at_least_one.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.848385 (MainThread): Parsing macros/schema_tests/cardinality_equality.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.851098 (MainThread): Parsing macros/schema_tests/equal_rowcount.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.853417 (MainThread): Parsing macros/schema_tests/equality.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.858385 (MainThread): Parsing macros/schema_tests/expression_is_true.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.860951 (MainThread): Parsing macros/schema_tests/fewer_rows_than.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.863205 (MainThread): Parsing macros/schema_tests/mutually_exclusive_ranges.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.874992 (MainThread): Parsing macros/schema_tests/not_accepted_values.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.877961 (MainThread): Parsing macros/schema_tests/not_constant.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.879736 (MainThread): Parsing macros/schema_tests/not_null_proportion.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.882756 (MainThread): Parsing macros/schema_tests/recency.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.885230 (MainThread): Parsing macros/schema_tests/relationships_where.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.888289 (MainThread): Parsing macros/schema_tests/sequential_values.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.891915 (MainThread): Parsing macros/schema_tests/test_not_null_where.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.893916 (MainThread): Parsing macros/schema_tests/test_unique_where.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.895933 (MainThread): Parsing macros/schema_tests/unique_combination_of_columns.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.899837 (MainThread): Parsing macros/sql/date_spine.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.906323 (MainThread): Parsing macros/sql/generate_series.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.912264 (MainThread): Parsing macros/sql/get_column_values.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.918516 (MainThread): Parsing macros/sql/get_query_results_as_dict.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.921750 (MainThread): Parsing macros/sql/get_relations_by_pattern.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.926392 (MainThread): Parsing macros/sql/get_relations_by_prefix.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.931002 (MainThread): Parsing macros/sql/get_tables_by_pattern_sql.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.939565 (MainThread): Parsing macros/sql/get_tables_by_prefix_sql.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.941893 (MainThread): Parsing macros/sql/groupby.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.943823 (MainThread): Parsing macros/sql/haversine_distance.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.951819 (MainThread): Parsing macros/sql/nullcheck.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.954121 (MainThread): Parsing macros/sql/nullcheck_table.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.956422 (MainThread): Parsing macros/sql/pivot.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.961953 (MainThread): Parsing macros/sql/safe_add.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.964286 (MainThread): Parsing macros/sql/star.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.969470 (MainThread): Parsing macros/sql/surrogate_key.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.974319 (MainThread): Parsing macros/sql/union.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.985976 (MainThread): Parsing macros/sql/unpivot.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.997120 (MainThread): Parsing macros/web/get_url_host.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:27.999874 (MainThread): Parsing macros/web/get_url_parameter.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.002175 (MainThread): Parsing macros/web/get_url_path.sql 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.589277 (MainThread): Acquiring new redshift connection "model.airbyte_utils.ops_cogs_inventories_ab1". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.637903 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1. 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.644071 (MainThread): Acquiring new redshift connection "model.airbyte_utils.ops_cogs_inventories_ab2". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.661545 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1. 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.663494 (MainThread): Acquiring new redshift connection "model.airbyte_utils.ops_cogs_inventories_ab3". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.691377 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1. 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.693380 (MainThread): Acquiring new redshift connection "model.airbyte_utils.ops_cogs_inventories". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.701343 (MainThread): 'soft_unicode' has been renamed to 'soft_str'. The old name will be removed in MarkupSafe 2.1. 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.790942 (MainThread): [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. 2022-04-21 10:59:32 normalization > There are 2 unused configuration paths: 2022-04-21 10:59:32 normalization > - models.airbyte_utils.generated.airbyte_tables 2022-04-21 10:59:32 normalization > - models.airbyte_utils.generated.airbyte_views 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.811279 (MainThread): write_gpickle is deprecated and will be removed in 3.0.Use ``pickle.dump(G, path, protocol)`` 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.811862 (MainThread): Found 4 models, 0 tests, 0 snapshots, 0 analyses, 520 macros, 0 operations, 0 seed files, 1 source, 0 exposures 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.813574 (MainThread): 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.814127 (MainThread): Acquiring new redshift connection "master". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.815395 (ThreadPoolExecutor-0_0): Acquiring new redshift connection "list_dw". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.830307 (ThreadPoolExecutor-0_0): Using redshift connection "list_dw". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.830535 (ThreadPoolExecutor-0_0): On list_dw: /* {"app": "dbt", "dbt_version": "0.21.1", "profile_name": "normalize", "target_name": "prod", "connection_name": "list_dw"} */ 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > select distinct nspname from pg_namespace 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.830693 (ThreadPoolExecutor-0_0): Opening a new connection, currently in state init 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.830819 (ThreadPoolExecutor-0_0): Connecting to Redshift using 'database' credentials 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.856619 (ThreadPoolExecutor-0_0): SQL status: SELECT in 0.03 seconds 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.859648 (ThreadPoolExecutor-0_0): On list_dw: Close 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.861476 (ThreadPoolExecutor-1_0): Acquiring new redshift connection "list_dw_entrepot". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.871831 (ThreadPoolExecutor-1_0): Using redshift connection "list_dw_entrepot". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.872024 (ThreadPoolExecutor-1_0): On list_dw_entrepot: BEGIN 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.872179 (ThreadPoolExecutor-1_0): Opening a new connection, currently in state closed 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.872305 (ThreadPoolExecutor-1_0): Connecting to Redshift using 'database' credentials 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.889840 (ThreadPoolExecutor-1_0): SQL status: BEGIN in 0.02 seconds 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.890122 (ThreadPoolExecutor-1_0): Using redshift connection "list_dw_entrepot". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.890263 (ThreadPoolExecutor-1_0): On list_dw_entrepot: /* {"app": "dbt", "dbt_version": "0.21.1", "profile_name": "normalize", "target_name": "prod", "connection_name": "list_dw_entrepot"} */ 2022-04-21 10:59:32 normalization > select 2022-04-21 10:59:32 normalization > 'dw' as database, 2022-04-21 10:59:32 normalization > tablename as name, 2022-04-21 10:59:32 normalization > schemaname as schema, 2022-04-21 10:59:32 normalization > 'table' as type 2022-04-21 10:59:32 normalization > from pg_tables 2022-04-21 10:59:32 normalization > where schemaname ilike 'entrepot' 2022-04-21 10:59:32 normalization > union all 2022-04-21 10:59:32 normalization > select 2022-04-21 10:59:32 normalization > 'dw' as database, 2022-04-21 10:59:32 normalization > viewname as name, 2022-04-21 10:59:32 normalization > schemaname as schema, 2022-04-21 10:59:32 normalization > 'view' as type 2022-04-21 10:59:32 normalization > from pg_views 2022-04-21 10:59:32 normalization > where schemaname ilike 'entrepot' 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.924773 (ThreadPoolExecutor-1_0): SQL status: SELECT in 0.03 seconds 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.926566 (ThreadPoolExecutor-1_0): On list_dw_entrepot: ROLLBACK 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.929189 (ThreadPoolExecutor-1_0): On list_dw_entrepot: Close 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.936919 (MainThread): Using redshift connection "master". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.937136 (MainThread): On master: BEGIN 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.937296 (MainThread): Opening a new connection, currently in state init 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.937416 (MainThread): Connecting to Redshift using 'database' credentials 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.959476 (MainThread): SQL status: BEGIN in 0.02 seconds 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.959790 (MainThread): Using redshift connection "master". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:28.959933 (MainThread): On master: /* {"app": "dbt", "dbt_version": "0.21.1", "profile_name": "normalize", "target_name": "prod", "connection_name": "master"} */ 2022-04-21 10:59:32 normalization > with relation as ( 2022-04-21 10:59:32 normalization > select 2022-04-21 10:59:32 normalization > pg_rewrite.ev_class as class, 2022-04-21 10:59:32 normalization > pg_rewrite.oid as id 2022-04-21 10:59:32 normalization > from pg_rewrite 2022-04-21 10:59:32 normalization > ), 2022-04-21 10:59:32 normalization > class as ( 2022-04-21 10:59:32 normalization > select 2022-04-21 10:59:32 normalization > oid as id, 2022-04-21 10:59:32 normalization > relname as name, 2022-04-21 10:59:32 normalization > relnamespace as schema, 2022-04-21 10:59:32 normalization > relkind as kind 2022-04-21 10:59:32 normalization > from pg_class 2022-04-21 10:59:32 normalization > ), 2022-04-21 10:59:32 normalization > dependency as ( 2022-04-21 10:59:32 normalization > select 2022-04-21 10:59:32 normalization > pg_depend.objid as id, 2022-04-21 10:59:32 normalization > pg_depend.refobjid as ref 2022-04-21 10:59:32 normalization > from pg_depend 2022-04-21 10:59:32 normalization > ), 2022-04-21 10:59:32 normalization > schema as ( 2022-04-21 10:59:32 normalization > select 2022-04-21 10:59:32 normalization > pg_namespace.oid as id, 2022-04-21 10:59:32 normalization > pg_namespace.nspname as name 2022-04-21 10:59:32 normalization > from pg_namespace 2022-04-21 10:59:32 normalization > where nspname != 'information_schema' and nspname not like 'pg\_%' 2022-04-21 10:59:32 normalization > ), 2022-04-21 10:59:32 normalization > referenced as ( 2022-04-21 10:59:32 normalization > select 2022-04-21 10:59:32 normalization > relation.id AS id, 2022-04-21 10:59:32 normalization > referenced_class.name , 2022-04-21 10:59:32 normalization > referenced_class.schema , 2022-04-21 10:59:32 normalization > referenced_class.kind 2022-04-21 10:59:32 normalization > from relation 2022-04-21 10:59:32 normalization > join class as referenced_class on relation.class=referenced_class.id 2022-04-21 10:59:32 normalization > where referenced_class.kind in ('r', 'v') 2022-04-21 10:59:32 normalization > ), 2022-04-21 10:59:32 normalization > relationships as ( 2022-04-21 10:59:32 normalization > select 2022-04-21 10:59:32 normalization > referenced.name as referenced_name, 2022-04-21 10:59:32 normalization > referenced.schema as referenced_schema_id, 2022-04-21 10:59:32 normalization > dependent_class.name as dependent_name, 2022-04-21 10:59:32 normalization > dependent_class.schema as dependent_schema_id, 2022-04-21 10:59:32 normalization > referenced.kind as kind 2022-04-21 10:59:32 normalization > from referenced 2022-04-21 10:59:32 normalization > join dependency on referenced.id=dependency.id 2022-04-21 10:59:32 normalization > join class as dependent_class on dependency.ref=dependent_class.id 2022-04-21 10:59:32 normalization > where 2022-04-21 10:59:32 normalization > (referenced.name != dependent_class.name or 2022-04-21 10:59:32 normalization > referenced.schema != dependent_class.schema) 2022-04-21 10:59:32 normalization > ) 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > select 2022-04-21 10:59:32 normalization > referenced_schema.name as referenced_schema, 2022-04-21 10:59:32 normalization > relationships.referenced_name as referenced_name, 2022-04-21 10:59:32 normalization > dependent_schema.name as dependent_schema, 2022-04-21 10:59:32 normalization > relationships.dependent_name as dependent_name 2022-04-21 10:59:32 normalization > from relationships 2022-04-21 10:59:32 normalization > join schema as dependent_schema on relationships.dependent_schema_id=dependent_schema.id 2022-04-21 10:59:32 normalization > join schema as referenced_schema on relationships.referenced_schema_id=referenced_schema.id 2022-04-21 10:59:32 normalization > group by referenced_schema, referenced_name, dependent_schema, dependent_name 2022-04-21 10:59:32 normalization > order by referenced_schema, referenced_name, dependent_schema, dependent_name; 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.046494 (MainThread): SQL status: SELECT in 0.09 seconds 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.049367 (MainThread): On master: ROLLBACK 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.052011 (MainThread): Using redshift connection "master". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.052196 (MainThread): On master: BEGIN 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.056153 (MainThread): SQL status: BEGIN in 0.00 seconds 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.056397 (MainThread): On master: COMMIT 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.056537 (MainThread): Using redshift connection "master". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.056662 (MainThread): On master: COMMIT 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.058663 (MainThread): SQL status: COMMIT in 0.00 seconds 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.058875 (MainThread): On master: Close 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.059611 (MainThread): 10:59:29 | Concurrency: 4 threads (target='prod') 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.059837 (MainThread): 10:59:29 | 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.069600 (Thread-1): Began running node model.airbyte_utils.ops_cogs_inventories_ab1 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.070227 (Thread-1): Acquiring new redshift connection "model.airbyte_utils.ops_cogs_inventories_ab1". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.070444 (Thread-1): Compiling model.airbyte_utils.ops_cogs_inventories_ab1 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.140118 (Thread-1): On "model.airbyte_utils.ops_cogs_inventories_ab1": cache miss for schema "dw._airbyte_entrepot", this is inefficient 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.143334 (Thread-1): Using redshift connection "model.airbyte_utils.ops_cogs_inventories_ab1". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.143514 (Thread-1): On model.airbyte_utils.ops_cogs_inventories_ab1: BEGIN 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.143663 (Thread-1): Opening a new connection, currently in state closed 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.143791 (Thread-1): Connecting to Redshift using 'database' credentials 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.164078 (Thread-1): SQL status: BEGIN in 0.02 seconds 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.164342 (Thread-1): Using redshift connection "model.airbyte_utils.ops_cogs_inventories_ab1". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.164477 (Thread-1): On model.airbyte_utils.ops_cogs_inventories_ab1: /* {"app": "dbt", "dbt_version": "0.21.1", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.ops_cogs_inventories_ab1"} */ 2022-04-21 10:59:32 normalization > select 2022-04-21 10:59:32 normalization > 'dw' as database, 2022-04-21 10:59:32 normalization > tablename as name, 2022-04-21 10:59:32 normalization > schemaname as schema, 2022-04-21 10:59:32 normalization > 'table' as type 2022-04-21 10:59:32 normalization > from pg_tables 2022-04-21 10:59:32 normalization > where schemaname ilike '_airbyte_entrepot' 2022-04-21 10:59:32 normalization > union all 2022-04-21 10:59:32 normalization > select 2022-04-21 10:59:32 normalization > 'dw' as database, 2022-04-21 10:59:32 normalization > viewname as name, 2022-04-21 10:59:32 normalization > schemaname as schema, 2022-04-21 10:59:32 normalization > 'view' as type 2022-04-21 10:59:32 normalization > from pg_views 2022-04-21 10:59:32 normalization > where schemaname ilike '_airbyte_entrepot' 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.180538 (Thread-1): SQL status: SELECT in 0.02 seconds 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.182113 (Thread-1): with database=dw, schema=_airbyte_entrepot, relations=[] 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.182420 (Thread-1): Writing injected SQL for node "model.airbyte_utils.ops_cogs_inventories_ab1" 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.183011 (Thread-1): finished collecting timing info 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.183246 (Thread-1): On model.airbyte_utils.ops_cogs_inventories_ab1: ROLLBACK 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.186102 (Thread-1): On model.airbyte_utils.ops_cogs_inventories_ab1: Close 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.186789 (Thread-1): Finished running node model.airbyte_utils.ops_cogs_inventories_ab1 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.187815 (Thread-3): Began running node model.airbyte_utils.ops_cogs_inventories_ab2 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.188371 (Thread-3): Acquiring new redshift connection "model.airbyte_utils.ops_cogs_inventories_ab2". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.188563 (Thread-3): Compiling model.airbyte_utils.ops_cogs_inventories_ab2 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.199742 (Thread-3): On "model.airbyte_utils.ops_cogs_inventories_ab2": cache miss for schema "dw._airbyte_entrepot", this is inefficient 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.202639 (Thread-3): Using redshift connection "model.airbyte_utils.ops_cogs_inventories_ab2". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.202803 (Thread-3): On model.airbyte_utils.ops_cogs_inventories_ab2: BEGIN 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.202949 (Thread-3): Opening a new connection, currently in state init 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.203076 (Thread-3): Connecting to Redshift using 'database' credentials 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.222325 (Thread-3): SQL status: BEGIN in 0.02 seconds 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.222586 (Thread-3): Using redshift connection "model.airbyte_utils.ops_cogs_inventories_ab2". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.222722 (Thread-3): On model.airbyte_utils.ops_cogs_inventories_ab2: /* {"app": "dbt", "dbt_version": "0.21.1", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.ops_cogs_inventories_ab2"} */ 2022-04-21 10:59:32 normalization > select 2022-04-21 10:59:32 normalization > 'dw' as database, 2022-04-21 10:59:32 normalization > tablename as name, 2022-04-21 10:59:32 normalization > schemaname as schema, 2022-04-21 10:59:32 normalization > 'table' as type 2022-04-21 10:59:32 normalization > from pg_tables 2022-04-21 10:59:32 normalization > where schemaname ilike '_airbyte_entrepot' 2022-04-21 10:59:32 normalization > union all 2022-04-21 10:59:32 normalization > select 2022-04-21 10:59:32 normalization > 'dw' as database, 2022-04-21 10:59:32 normalization > viewname as name, 2022-04-21 10:59:32 normalization > schemaname as schema, 2022-04-21 10:59:32 normalization > 'view' as type 2022-04-21 10:59:32 normalization > from pg_views 2022-04-21 10:59:32 normalization > where schemaname ilike '_airbyte_entrepot' 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.238960 (Thread-3): SQL status: SELECT in 0.02 seconds 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.240553 (Thread-3): with database=dw, schema=_airbyte_entrepot, relations=[] 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.259776 (Thread-3): Writing injected SQL for node "model.airbyte_utils.ops_cogs_inventories_ab2" 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.260271 (Thread-3): finished collecting timing info 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.260513 (Thread-3): On model.airbyte_utils.ops_cogs_inventories_ab2: ROLLBACK 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.263517 (Thread-3): On model.airbyte_utils.ops_cogs_inventories_ab2: Close 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.264403 (Thread-3): Finished running node model.airbyte_utils.ops_cogs_inventories_ab2 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.265392 (Thread-2): Began running node model.airbyte_utils.ops_cogs_inventories_ab3 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.265948 (Thread-2): Acquiring new redshift connection "model.airbyte_utils.ops_cogs_inventories_ab3". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.266214 (Thread-2): Compiling model.airbyte_utils.ops_cogs_inventories_ab3 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.278683 (Thread-2): On "model.airbyte_utils.ops_cogs_inventories_ab3": cache miss for schema "dw._airbyte_entrepot", this is inefficient 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.281869 (Thread-2): Using redshift connection "model.airbyte_utils.ops_cogs_inventories_ab3". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.282064 (Thread-2): On model.airbyte_utils.ops_cogs_inventories_ab3: BEGIN 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.282225 (Thread-2): Opening a new connection, currently in state init 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.282367 (Thread-2): Connecting to Redshift using 'database' credentials 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.302366 (Thread-2): SQL status: BEGIN in 0.02 seconds 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.302692 (Thread-2): Using redshift connection "model.airbyte_utils.ops_cogs_inventories_ab3". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.302836 (Thread-2): On model.airbyte_utils.ops_cogs_inventories_ab3: /* {"app": "dbt", "dbt_version": "0.21.1", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.ops_cogs_inventories_ab3"} */ 2022-04-21 10:59:32 normalization > select 2022-04-21 10:59:32 normalization > 'dw' as database, 2022-04-21 10:59:32 normalization > tablename as name, 2022-04-21 10:59:32 normalization > schemaname as schema, 2022-04-21 10:59:32 normalization > 'table' as type 2022-04-21 10:59:32 normalization > from pg_tables 2022-04-21 10:59:32 normalization > where schemaname ilike '_airbyte_entrepot' 2022-04-21 10:59:32 normalization > union all 2022-04-21 10:59:32 normalization > select 2022-04-21 10:59:32 normalization > 'dw' as database, 2022-04-21 10:59:32 normalization > viewname as name, 2022-04-21 10:59:32 normalization > schemaname as schema, 2022-04-21 10:59:32 normalization > 'view' as type 2022-04-21 10:59:32 normalization > from pg_views 2022-04-21 10:59:32 normalization > where schemaname ilike '_airbyte_entrepot' 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.322231 (Thread-2): SQL status: SELECT in 0.02 seconds 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.323894 (Thread-2): with database=dw, schema=_airbyte_entrepot, relations=[] 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.340421 (Thread-2): Writing injected SQL for node "model.airbyte_utils.ops_cogs_inventories_ab3" 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.340866 (Thread-2): finished collecting timing info 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.341099 (Thread-2): On model.airbyte_utils.ops_cogs_inventories_ab3: ROLLBACK 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.344047 (Thread-2): On model.airbyte_utils.ops_cogs_inventories_ab3: Close 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.344723 (Thread-2): Finished running node model.airbyte_utils.ops_cogs_inventories_ab3 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.345652 (Thread-4): Began running node model.airbyte_utils.ops_cogs_inventories 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.346093 (Thread-4): 10:59:29 | 1 of 1 START incremental model entrepot.ops_cogs_inventories................................................. [RUN] 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.347056 (Thread-4): Acquiring new redshift connection "model.airbyte_utils.ops_cogs_inventories". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.347252 (Thread-4): Compiling model.airbyte_utils.ops_cogs_inventories 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.373903 (Thread-4): Using redshift connection "model.airbyte_utils.ops_cogs_inventories". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.374153 (Thread-4): On model.airbyte_utils.ops_cogs_inventories: BEGIN 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.374307 (Thread-4): Opening a new connection, currently in state init 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.374431 (Thread-4): Connecting to Redshift using 'database' credentials 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.394030 (Thread-4): SQL status: BEGIN in 0.02 seconds 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.394319 (Thread-4): Using redshift connection "model.airbyte_utils.ops_cogs_inventories". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.394460 (Thread-4): On model.airbyte_utils.ops_cogs_inventories: /* {"app": "dbt", "dbt_version": "0.21.1", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.ops_cogs_inventories"} */ 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > with bound_views as ( 2022-04-21 10:59:32 normalization > select 2022-04-21 10:59:32 normalization > ordinal_position, 2022-04-21 10:59:32 normalization > table_schema, 2022-04-21 10:59:32 normalization > column_name, 2022-04-21 10:59:32 normalization > data_type, 2022-04-21 10:59:32 normalization > character_maximum_length, 2022-04-21 10:59:32 normalization > numeric_precision, 2022-04-21 10:59:32 normalization > numeric_scale 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > from information_schema."columns" 2022-04-21 10:59:32 normalization > where table_name = 'ops_cogs_inventories' 2022-04-21 10:59:32 normalization > ), 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > unbound_views as ( 2022-04-21 10:59:32 normalization > select 2022-04-21 10:59:32 normalization > ordinal_position, 2022-04-21 10:59:32 normalization > view_schema, 2022-04-21 10:59:32 normalization > col_name, 2022-04-21 10:59:32 normalization > case 2022-04-21 10:59:32 normalization > when col_type ilike 'character varying%' then 2022-04-21 10:59:32 normalization > 'character varying' 2022-04-21 10:59:32 normalization > when col_type ilike 'numeric%' then 'numeric' 2022-04-21 10:59:32 normalization > else col_type 2022-04-21 10:59:32 normalization > end as col_type, 2022-04-21 10:59:32 normalization > case 2022-04-21 10:59:32 normalization > when col_type like 'character%' 2022-04-21 10:59:32 normalization > then nullif(REGEXP_SUBSTR(col_type, '[0-9]+'), '')::int 2022-04-21 10:59:32 normalization > else null 2022-04-21 10:59:32 normalization > end as character_maximum_length, 2022-04-21 10:59:32 normalization > case 2022-04-21 10:59:32 normalization > when col_type like 'numeric%' 2022-04-21 10:59:32 normalization > then nullif( 2022-04-21 10:59:32 normalization > SPLIT_PART(REGEXP_SUBSTR(col_type, '[0-9,]+'), ',', 1), 2022-04-21 10:59:32 normalization > '')::int 2022-04-21 10:59:32 normalization > else null 2022-04-21 10:59:32 normalization > end as numeric_precision, 2022-04-21 10:59:32 normalization > case 2022-04-21 10:59:32 normalization > when col_type like 'numeric%' 2022-04-21 10:59:32 normalization > then nullif( 2022-04-21 10:59:32 normalization > SPLIT_PART(REGEXP_SUBSTR(col_type, '[0-9,]+'), ',', 2), 2022-04-21 10:59:32 normalization > '')::int 2022-04-21 10:59:32 normalization > else null 2022-04-21 10:59:32 normalization > end as numeric_scale 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > from pg_get_late_binding_view_cols() 2022-04-21 10:59:32 normalization > cols(view_schema name, view_name name, col_name name, 2022-04-21 10:59:32 normalization > col_type varchar, ordinal_position int) 2022-04-21 10:59:32 normalization > where view_name = 'ops_cogs_inventories' 2022-04-21 10:59:32 normalization > ), 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > external_views as ( 2022-04-21 10:59:32 normalization > select 2022-04-21 10:59:32 normalization > columnnum, 2022-04-21 10:59:32 normalization > schemaname, 2022-04-21 10:59:32 normalization > columnname, 2022-04-21 10:59:32 normalization > case 2022-04-21 10:59:32 normalization > when external_type ilike 'character varying%' or external_type ilike 'varchar%' 2022-04-21 10:59:32 normalization > then 'character varying' 2022-04-21 10:59:32 normalization > when external_type ilike 'numeric%' then 'numeric' 2022-04-21 10:59:32 normalization > else external_type 2022-04-21 10:59:32 normalization > end as external_type, 2022-04-21 10:59:32 normalization > case 2022-04-21 10:59:32 normalization > when external_type like 'character%' or external_type like 'varchar%' 2022-04-21 10:59:32 normalization > then nullif( 2022-04-21 10:59:32 normalization > REGEXP_SUBSTR(external_type, '[0-9]+'), 2022-04-21 10:59:32 normalization > '')::int 2022-04-21 10:59:32 normalization > else null 2022-04-21 10:59:32 normalization > end as character_maximum_length, 2022-04-21 10:59:32 normalization > case 2022-04-21 10:59:32 normalization > when external_type like 'numeric%' 2022-04-21 10:59:32 normalization > then nullif( 2022-04-21 10:59:32 normalization > SPLIT_PART(REGEXP_SUBSTR(external_type, '[0-9,]+'), ',', 1), 2022-04-21 10:59:32 normalization > '')::int 2022-04-21 10:59:32 normalization > else null 2022-04-21 10:59:32 normalization > end as numeric_precision, 2022-04-21 10:59:32 normalization > case 2022-04-21 10:59:32 normalization > when external_type like 'numeric%' 2022-04-21 10:59:32 normalization > then nullif( 2022-04-21 10:59:32 normalization > SPLIT_PART(REGEXP_SUBSTR(external_type, '[0-9,]+'), ',', 2), 2022-04-21 10:59:32 normalization > '')::int 2022-04-21 10:59:32 normalization > else null 2022-04-21 10:59:32 normalization > end as numeric_scale 2022-04-21 10:59:32 normalization > from 2022-04-21 10:59:32 normalization > pg_catalog.svv_external_columns 2022-04-21 10:59:32 normalization > where 2022-04-21 10:59:32 normalization > schemaname = 'entrepot' 2022-04-21 10:59:32 normalization > and tablename = 'ops_cogs_inventories' 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > ), 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > unioned as ( 2022-04-21 10:59:32 normalization > select * from bound_views 2022-04-21 10:59:32 normalization > union all 2022-04-21 10:59:32 normalization > select * from unbound_views 2022-04-21 10:59:32 normalization > union all 2022-04-21 10:59:32 normalization > select * from external_views 2022-04-21 10:59:32 normalization > ) 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > select 2022-04-21 10:59:32 normalization > column_name, 2022-04-21 10:59:32 normalization > data_type, 2022-04-21 10:59:32 normalization > character_maximum_length, 2022-04-21 10:59:32 normalization > numeric_precision, 2022-04-21 10:59:32 normalization > numeric_scale 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > from unioned 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > where table_schema = 'entrepot' 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > order by ordinal_position 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.575516 (Thread-4): SQL status: SELECT in 0.18 seconds 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.593184 (Thread-4): Writing injected SQL for node "model.airbyte_utils.ops_cogs_inventories" 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.593781 (Thread-4): finished collecting timing info 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.640193 (Thread-4): Using redshift connection "model.airbyte_utils.ops_cogs_inventories". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.640473 (Thread-4): On model.airbyte_utils.ops_cogs_inventories: /* {"app": "dbt", "dbt_version": "0.21.1", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.ops_cogs_inventories"} */ 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > with bound_views as ( 2022-04-21 10:59:32 normalization > select 2022-04-21 10:59:32 normalization > ordinal_position, 2022-04-21 10:59:32 normalization > table_schema, 2022-04-21 10:59:32 normalization > column_name, 2022-04-21 10:59:32 normalization > data_type, 2022-04-21 10:59:32 normalization > character_maximum_length, 2022-04-21 10:59:32 normalization > numeric_precision, 2022-04-21 10:59:32 normalization > numeric_scale 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > from information_schema."columns" 2022-04-21 10:59:32 normalization > where table_name = 'ops_cogs_inventories' 2022-04-21 10:59:32 normalization > ), 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > unbound_views as ( 2022-04-21 10:59:32 normalization > select 2022-04-21 10:59:32 normalization > ordinal_position, 2022-04-21 10:59:32 normalization > view_schema, 2022-04-21 10:59:32 normalization > col_name, 2022-04-21 10:59:32 normalization > case 2022-04-21 10:59:32 normalization > when col_type ilike 'character varying%' then 2022-04-21 10:59:32 normalization > 'character varying' 2022-04-21 10:59:32 normalization > when col_type ilike 'numeric%' then 'numeric' 2022-04-21 10:59:32 normalization > else col_type 2022-04-21 10:59:32 normalization > end as col_type, 2022-04-21 10:59:32 normalization > case 2022-04-21 10:59:32 normalization > when col_type like 'character%' 2022-04-21 10:59:32 normalization > then nullif(REGEXP_SUBSTR(col_type, '[0-9]+'), '')::int 2022-04-21 10:59:32 normalization > else null 2022-04-21 10:59:32 normalization > end as character_maximum_length, 2022-04-21 10:59:32 normalization > case 2022-04-21 10:59:32 normalization > when col_type like 'numeric%' 2022-04-21 10:59:32 normalization > then nullif( 2022-04-21 10:59:32 normalization > SPLIT_PART(REGEXP_SUBSTR(col_type, '[0-9,]+'), ',', 1), 2022-04-21 10:59:32 normalization > '')::int 2022-04-21 10:59:32 normalization > else null 2022-04-21 10:59:32 normalization > end as numeric_precision, 2022-04-21 10:59:32 normalization > case 2022-04-21 10:59:32 normalization > when col_type like 'numeric%' 2022-04-21 10:59:32 normalization > then nullif( 2022-04-21 10:59:32 normalization > SPLIT_PART(REGEXP_SUBSTR(col_type, '[0-9,]+'), ',', 2), 2022-04-21 10:59:32 normalization > '')::int 2022-04-21 10:59:32 normalization > else null 2022-04-21 10:59:32 normalization > end as numeric_scale 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > from pg_get_late_binding_view_cols() 2022-04-21 10:59:32 normalization > cols(view_schema name, view_name name, col_name name, 2022-04-21 10:59:32 normalization > col_type varchar, ordinal_position int) 2022-04-21 10:59:32 normalization > where view_name = 'ops_cogs_inventories' 2022-04-21 10:59:32 normalization > ), 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > external_views as ( 2022-04-21 10:59:32 normalization > select 2022-04-21 10:59:32 normalization > columnnum, 2022-04-21 10:59:32 normalization > schemaname, 2022-04-21 10:59:32 normalization > columnname, 2022-04-21 10:59:32 normalization > case 2022-04-21 10:59:32 normalization > when external_type ilike 'character varying%' or external_type ilike 'varchar%' 2022-04-21 10:59:32 normalization > then 'character varying' 2022-04-21 10:59:32 normalization > when external_type ilike 'numeric%' then 'numeric' 2022-04-21 10:59:32 normalization > else external_type 2022-04-21 10:59:32 normalization > end as external_type, 2022-04-21 10:59:32 normalization > case 2022-04-21 10:59:32 normalization > when external_type like 'character%' or external_type like 'varchar%' 2022-04-21 10:59:32 normalization > then nullif( 2022-04-21 10:59:32 normalization > REGEXP_SUBSTR(external_type, '[0-9]+'), 2022-04-21 10:59:32 normalization > '')::int 2022-04-21 10:59:32 normalization > else null 2022-04-21 10:59:32 normalization > end as character_maximum_length, 2022-04-21 10:59:32 normalization > case 2022-04-21 10:59:32 normalization > when external_type like 'numeric%' 2022-04-21 10:59:32 normalization > then nullif( 2022-04-21 10:59:32 normalization > SPLIT_PART(REGEXP_SUBSTR(external_type, '[0-9,]+'), ',', 1), 2022-04-21 10:59:32 normalization > '')::int 2022-04-21 10:59:32 normalization > else null 2022-04-21 10:59:32 normalization > end as numeric_precision, 2022-04-21 10:59:32 normalization > case 2022-04-21 10:59:32 normalization > when external_type like 'numeric%' 2022-04-21 10:59:32 normalization > then nullif( 2022-04-21 10:59:32 normalization > SPLIT_PART(REGEXP_SUBSTR(external_type, '[0-9,]+'), ',', 2), 2022-04-21 10:59:32 normalization > '')::int 2022-04-21 10:59:32 normalization > else null 2022-04-21 10:59:32 normalization > end as numeric_scale 2022-04-21 10:59:32 normalization > from 2022-04-21 10:59:32 normalization > pg_catalog.svv_external_columns 2022-04-21 10:59:32 normalization > where 2022-04-21 10:59:32 normalization > schemaname = 'entrepot' 2022-04-21 10:59:32 normalization > and tablename = 'ops_cogs_inventories' 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > ), 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > unioned as ( 2022-04-21 10:59:32 normalization > select * from bound_views 2022-04-21 10:59:32 normalization > union all 2022-04-21 10:59:32 normalization > select * from unbound_views 2022-04-21 10:59:32 normalization > union all 2022-04-21 10:59:32 normalization > select * from external_views 2022-04-21 10:59:32 normalization > ) 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > select 2022-04-21 10:59:32 normalization > column_name, 2022-04-21 10:59:32 normalization > data_type, 2022-04-21 10:59:32 normalization > character_maximum_length, 2022-04-21 10:59:32 normalization > numeric_precision, 2022-04-21 10:59:32 normalization > numeric_scale 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > from unioned 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > where table_schema = 'entrepot' 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > order by ordinal_position 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.782588 (Thread-4): SQL status: SELECT in 0.14 seconds 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.817292 (Thread-4): Using redshift connection "model.airbyte_utils.ops_cogs_inventories". 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.817579 (Thread-4): On model.airbyte_utils.ops_cogs_inventories: /* {"app": "dbt", "dbt_version": "0.21.1", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.ops_cogs_inventories"} */ 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > create temporary table 2022-04-21 10:59:32 normalization > "ops_cogs_inventories__dbt_tmp105929634646" 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > compound sortkey(_airbyte_emitted_at) 2022-04-21 10:59:32 normalization > as ( 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > with __dbt__cte__ops_cogs_inventories_ab1 as ( 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-04-21 10:59:32 normalization > -- depends_on: "dw".entrepot._airbyte_raw_ops_cogs_inventories 2022-04-21 10:59:32 normalization > select 2022-04-21 10:59:32 normalization > case when json_extract_path_text(_airbyte_data, 'sku', true) != '' then json_extract_path_text(_airbyte_data, 'sku', true) end as sku, 2022-04-21 10:59:32 normalization > case when json_extract_path_text(_airbyte_data, 'prices', true) != '' then json_extract_path_text(_airbyte_data, 'prices', true) end as prices, 2022-04-21 10:59:32 normalization > case when json_extract_path_text(_airbyte_data, 'item_id', true) != '' then json_extract_path_text(_airbyte_data, 'item_id', true) end as item_id, 2022-04-21 10:59:32 normalization > case when json_extract_path_text(_airbyte_data, 'avg_sofa', true) != '' then json_extract_path_text(_airbyte_data, 'avg_sofa', true) end as avg_sofa, 2022-04-21 10:59:32 normalization > case when json_extract_path_text(_airbyte_data, 'quantity', true) != '' then json_extract_path_text(_airbyte_data, 'quantity', true) end as quantity, 2022-04-21 10:59:32 normalization > case when json_extract_path_text(_airbyte_data, 'created_at', true) != '' then json_extract_path_text(_airbyte_data, 'created_at', true) end as created_at, 2022-04-21 10:59:32 normalization > case when json_extract_path_text(_airbyte_data, 'cogs_prices', true) != '' then json_extract_path_text(_airbyte_data, 'cogs_prices', true) end as cogs_prices, 2022-04-21 10:59:32 normalization > case when json_extract_path_text(_airbyte_data, 'last_po_prices', true) != '' then json_extract_path_text(_airbyte_data, 'last_po_prices', true) end as last_po_prices, 2022-04-21 10:59:32 normalization > case when json_extract_path_text(_airbyte_data, 'inventory_values', true) != '' then json_extract_path_text(_airbyte_data, 'inventory_values', true) end as inventory_values, 2022-04-21 10:59:32 normalization > case when json_extract_path_text(_airbyte_data, 'preferred_prices', true) != '' then json_extract_path_text(_airbyte_data, 'preferred_prices', true) end as preferred_prices, 2022-04-21 10:59:32 normalization > _airbyte_ab_id, 2022-04-21 10:59:32 normalization > _airbyte_emitted_at, 2022-04-21 10:59:32 normalization > getdate() as _airbyte_normalized_at 2022-04-21 10:59:32 normalization > from "dw".entrepot._airbyte_raw_ops_cogs_inventories as table_alias 2022-04-21 10:59:32 normalization > -- ops_cogs_inventories 2022-04-21 10:59:32 normalization > where 1 = 1 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > ), __dbt__cte__ops_cogs_inventories_ab2 as ( 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-04-21 10:59:32 normalization > -- depends_on: __dbt__cte__ops_cogs_inventories_ab1 2022-04-21 10:59:32 normalization > select 2022-04-21 10:59:32 normalization > cast(sku as varchar) as sku, 2022-04-21 10:59:32 normalization > cast(prices as 2022-04-21 10:59:32 normalization > float 2022-04-21 10:59:32 normalization > ) as prices, 2022-04-21 10:59:32 normalization > cast(item_id as 2022-04-21 10:59:32 normalization > float 2022-04-21 10:59:32 normalization > ) as item_id, 2022-04-21 10:59:32 normalization > cast(avg_sofa as 2022-04-21 10:59:32 normalization > float 2022-04-21 10:59:32 normalization > ) as avg_sofa, 2022-04-21 10:59:32 normalization > cast(quantity as 2022-04-21 10:59:32 normalization > float 2022-04-21 10:59:32 normalization > ) as quantity, 2022-04-21 10:59:32 normalization > cast(created_at as varchar) as created_at, 2022-04-21 10:59:32 normalization > cast(cogs_prices as 2022-04-21 10:59:32 normalization > float 2022-04-21 10:59:32 normalization > ) as cogs_prices, 2022-04-21 10:59:32 normalization > cast(last_po_prices as 2022-04-21 10:59:32 normalization > float 2022-04-21 10:59:32 normalization > ) as last_po_prices, 2022-04-21 10:59:32 normalization > cast(inventory_values as 2022-04-21 10:59:32 normalization > float 2022-04-21 10:59:32 normalization > ) as inventory_values, 2022-04-21 10:59:32 normalization > cast(preferred_prices as 2022-04-21 10:59:32 normalization > float 2022-04-21 10:59:32 normalization > ) as preferred_prices, 2022-04-21 10:59:32 normalization > _airbyte_ab_id, 2022-04-21 10:59:32 normalization > _airbyte_emitted_at, 2022-04-21 10:59:32 normalization > getdate() as _airbyte_normalized_at 2022-04-21 10:59:32 normalization > from __dbt__cte__ops_cogs_inventories_ab1 2022-04-21 10:59:32 normalization > -- ops_cogs_inventories 2022-04-21 10:59:32 normalization > where 1 = 1 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > ), __dbt__cte__ops_cogs_inventories_ab3 as ( 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > -- SQL model to build a hash column based on the values of this record 2022-04-21 10:59:32 normalization > -- depends_on: __dbt__cte__ops_cogs_inventories_ab2 2022-04-21 10:59:32 normalization > select 2022-04-21 10:59:32 normalization > md5(cast(coalesce(cast(sku as varchar), '') || '-' || coalesce(cast(prices as varchar), '') || '-' || coalesce(cast(item_id as varchar), '') || '-' || coalesce(cast(avg_sofa as varchar), '') || '-' || coalesce(cast(quantity as varchar), '') || '-' || coalesce(cast(created_at as varchar), '') || '-' || coalesce(cast(cogs_prices as varchar), '') || '-' || coalesce(cast(last_po_prices as varchar), '') || '-' || coalesce(cast(inventory_values as varchar), '') || '-' || coalesce(cast(preferred_prices as varchar), '') as varchar)) as _airbyte_ops_cogs_inventories_hashid, 2022-04-21 10:59:32 normalization > tmp.* 2022-04-21 10:59:32 normalization > from __dbt__cte__ops_cogs_inventories_ab2 tmp 2022-04-21 10:59:32 normalization > -- ops_cogs_inventories 2022-04-21 10:59:32 normalization > where 1 = 1 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > )-- Final base SQL model 2022-04-21 10:59:32 normalization > -- depends_on: __dbt__cte__ops_cogs_inventories_ab3 2022-04-21 10:59:32 normalization > select 2022-04-21 10:59:32 normalization > sku, 2022-04-21 10:59:32 normalization > prices, 2022-04-21 10:59:32 normalization > item_id, 2022-04-21 10:59:32 normalization > avg_sofa, 2022-04-21 10:59:32 normalization > quantity, 2022-04-21 10:59:32 normalization > created_at, 2022-04-21 10:59:32 normalization > cogs_prices, 2022-04-21 10:59:32 normalization > last_po_prices, 2022-04-21 10:59:32 normalization > inventory_values, 2022-04-21 10:59:32 normalization > preferred_prices, 2022-04-21 10:59:32 normalization > _airbyte_ab_id, 2022-04-21 10:59:32 normalization > _airbyte_emitted_at, 2022-04-21 10:59:32 normalization > getdate() as _airbyte_normalized_at, 2022-04-21 10:59:32 normalization > _airbyte_ops_cogs_inventories_hashid 2022-04-21 10:59:32 normalization > from __dbt__cte__ops_cogs_inventories_ab3 2022-04-21 10:59:32 normalization > -- ops_cogs_inventories from "dw".entrepot._airbyte_raw_ops_cogs_inventories 2022-04-21 10:59:32 normalization > where 1 = 1 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > and coalesce( 2022-04-21 10:59:32 normalization > cast(_airbyte_emitted_at as 2022-04-21 10:59:32 normalization > timestamp with time zone 2022-04-21 10:59:32 normalization > ) >= (select max(cast(_airbyte_emitted_at as 2022-04-21 10:59:32 normalization > timestamp with time zone 2022-04-21 10:59:32 normalization > )) from "dw".entrepot."ops_cogs_inventories"), 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > true) 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > ); 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.825335 (Thread-4): Postgres error: function json_extract_path_text(super, "unknown", boolean) does not exist 2022-04-21 10:59:32 normalization > HINT: No function matches the given name and argument types. You may need to add explicit type casts. 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.825556 (Thread-4): On model.airbyte_utils.ops_cogs_inventories: ROLLBACK 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.827629 (Thread-4): finished collecting timing info 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.827856 (Thread-4): On model.airbyte_utils.ops_cogs_inventories: Close 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:29.828496 (Thread-4): Database Error in model ops_cogs_inventories (models/generated/airbyte_incremental/entrepot/ops_cogs_inventories.sql) 2022-04-21 10:59:32 normalization > function json_extract_path_text(super, "unknown", boolean) does not exist 2022-04-21 10:59:32 normalization > HINT: No function matches the given name and argument types. You may need to add explicit type casts. 2022-04-21 10:59:32 normalization > Traceback (most recent call last): 2022-04-21 10:59:32 normalization > File "/usr/local/lib/python3.8/site-packages/dbt/adapters/postgres/connections.py", line 56, in exception_handler 2022-04-21 10:59:32 normalization > yield 2022-04-21 10:59:32 normalization > File "/usr/local/lib/python3.8/site-packages/dbt/adapters/sql/connections.py", line 80, in add_query 2022-04-21 10:59:32 normalization > cursor.execute(sql, bindings) 2022-04-21 10:59:32 normalization > psycopg2.errors.UndefinedFunction: function json_extract_path_text(super, "unknown", boolean) does not exist 2022-04-21 10:59:32 normalization > HINT: No function matches the given name and argument types. You may need to add explicit type casts. 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > The above exception was the direct cause of the following exception: 2022-04-21 10:59:32 normalization > 2022-04-21 10:59:32 normalization > Traceback (most recent call last): 2022-04-21 10:59:32 normalization > File "/usr/local/lib/python3.8/site-packages/dbt/task/base.py", line 348, in safe_run 2022-04-21 10:59:32 normalization > result = self.compile_and_execute(manifest, ctx) 2022-04-21 10:59:32 normalization > File "/usr/local/lib/python3.8/site-packages/dbt/task/base.py", line 291, in compile_and_execute 2022-04-21 10:59:32 normalization > result = self.run(ctx.node, manifest) 2022-04-21 10:59:32 normalization > File "/usr/local/lib/python3.8/site-packages/dbt/task/base.py", line 393, in run 2022-04-21 10:59:32 normalization > return self.execute(compiled_node, manifest) 2022-04-21 10:59:32 normalization > File "/usr/local/lib/python3.8/site-packages/dbt/task/run.py", line 249, in execute 2022-04-21 10:59:32 normalization > result = MacroGenerator(materialization_macro, context)() 2022-04-21 10:59:32 normalization > File "/usr/local/lib/python3.8/site-packages/dbt/clients/jinja.py", line 333, in __call__ 2022-04-21 10:59:32 normalization > return self.call_macro(*args, **kwargs) 2022-04-21 10:59:32 normalization > File "/usr/local/lib/python3.8/site-packages/dbt/clients/jinja.py", line 260, in call_macro 2022-04-21 10:59:32 normalization > return macro(*args, **kwargs) 2022-04-21 10:59:32 normalization > File "/usr/local/lib/python3.8/site-packages/jinja2/runtime.py", line 675, in __call__ 2022-04-21 10:59:32 normalization > return self._invoke(arguments, autoescape) 2022-04-21 10:59:32 normalization > File "/usr/local/lib/python3.8/site-packages/jinja2/runtime.py", line 679, in _invoke 2022-04-21 10:59:32 normalization > rv = self._func(*arguments) 2022-04-21 10:59:32 normalization > File "