2022-04-07 03:37:58 INFO i.a.w.w.WorkerRun(call):49 - Executing worker wrapper. Airbyte version: 0.35.65-alpha 2022-04-07 03:37:59 INFO i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/9/2/logs.log 2022-04-07 03:37:59 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.35.65-alpha 2022-04-07 03:37:59 INFO i.a.w.DefaultReplicationWorker(run):104 - start sync worker. job id: 9 attempt id: 2 2022-04-07 03:37:59 INFO i.a.w.DefaultReplicationWorker(run):116 - configured sync modes: {null.global_exclusions=full_refresh - append, null.metrics=full_refresh - append, null.campaigns=full_refresh - append, null.events=full_refresh - append, null.lists=full_refresh - append} 2022-04-07 03:37:59 INFO i.a.w.p.a.DefaultAirbyteDestination(start):69 - Running destination... 2022-04-07 03:37:59 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:1.0.2 exists... 2022-04-07 03:37:59 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:1.0.2 was found locally. 2022-04-07 03:37:59 INFO i.a.w.p.DockerProcessFactory(create):106 - Creating docker job ID: 9 2022-04-07 03:37:59 INFO i.a.w.p.DockerProcessFactory(create):158 - Preparing command: docker run --rm --init -i -w /data/9/2 --log-driver none --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.0.2 -e WORKER_JOB_ATTEMPT=2 -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.35.65-alpha -e WORKER_JOB_ID=9 airbyte/destination-bigquery:1.0.2 write --config destination_config.json --catalog destination_catalog.json 2022-04-07 03:37:59 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-klaviyo:0.1.3 exists... 2022-04-07 03:37:59 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-klaviyo:0.1.3 was found locally. 2022-04-07 03:37:59 INFO i.a.w.p.DockerProcessFactory(create):106 - Creating docker job ID: 9 2022-04-07 03:37:59 INFO i.a.w.p.DockerProcessFactory(create):158 - Preparing command: docker run --rm --init -i -w /data/9/2 --log-driver none --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e WORKER_CONNECTOR_IMAGE=airbyte/source-klaviyo:0.1.3 -e WORKER_JOB_ATTEMPT=2 -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.35.65-alpha -e WORKER_JOB_ID=9 airbyte/source-klaviyo:0.1.3 read --config source_config.json --catalog source_catalog.json 2022-04-07 03:37:59 INFO i.a.w.DefaultReplicationWorker(run):158 - Waiting for source and destination threads to complete. 2022-04-07 03:37:59 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):279 - Replication thread started. 2022-04-07 03:37:59 INFO i.a.w.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$6):339 - Destination output thread started. 2022-04-07 03:38:01 source > Starting syncing SourceKlaviyo 2022-04-07 03:38:01 source > Syncing stream: campaigns 2022-04-07 03:38:01 destination > SLF4J: Class path contains multiple SLF4J bindings. 2022-04-07 03:38:01 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-04-07 03:38:01 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-04-07 03:38:01 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-04-07 03:38:01 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-04-07 03:38:01 destination > 2022-04-07 03:38:01 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-04-07 03:38:01 destination > 2022-04-07 03:38:01 INFO i.a.i.b.IntegrationRunner(runInternal):121 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-04-07 03:38:01 destination > 2022-04-07 03:38:01 INFO i.a.i.b.IntegrationRunner(runInternal):122 - Command: WRITE 2022-04-07 03:38:01 destination > 2022-04-07 03:38:01 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-04-07 03:38:01 destination > 2022-04-07 03:38:01 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-04-07 03:38:01 destination > 2022-04-07 03:38:01 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-04-07 03:38:02 destination > 2022-04-07 03:38:02 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):281 - Selected loading method is set to: GCS 2022-04-07 03:38:03 source > Read 121 records from campaigns stream 2022-04-07 03:38:03 source > Finished syncing SourceKlaviyo 2022-04-07 03:38:03 source > SourceKlaviyo runtimes: 2022-04-07 03:38:03 source > Syncing stream: events 2022-04-07 03:38:04 destination > 2022-04-07 03:38:04 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):124 - Partitioned Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte_new, tableId=_airbyte_tmp_lve_kl_campaigns}} created successfully 2022-04-07 03:38:04 destination > 2022-04-07 03:38:04 INFO i.a.i.d.s.S3FormatConfigs(getS3FormatConfig):22 - S3 format config: {"format_type":"AVRO","flattening":"No flattening","part_size_mb":"5"} 2022-04-07 03:38:04 destination > 2022-04-07 03:38:04 INFO i.a.i.d.g.u.GcsUtils(getDefaultAvroSchema):23 - Default schema. 2022-04-07 03:38:04 destination > 2022-04-07 03:38:04 INFO i.a.i.d.g.a.GcsAvroWriter():67 - Avro schema for stream kl_campaigns: {"type":"record","name":"kl_campaigns","fields":[{"name":"_airbyte_ab_id","type":{"type":"string","logicalType":"uuid"}},{"name":"_airbyte_emitted_at","type":{"type":"long","logicalType":"timestamp-millis"}},{"name":"_airbyte_data","type":"string"}]} 2022-04-07 03:38:04 destination > 2022-04-07 03:38:04 INFO i.a.i.d.g.a.GcsAvroWriter():73 - Full GCS path for stream 'kl_campaigns': nhg-dw-lnd/data/airbyte/kl_campaigns/2022_04_07_1649302684389_0.avro 2022-04-07 03:38:04 destination > 2022-04-07 03:38:04 INFO i.a.i.d.s.u.StreamTransferManagerHelper(getDefault):55 - PartSize arg is set to 5 MB 2022-04-07 03:38:05 destination > Exception in thread "main" com.amazonaws.services.s3.model.AmazonS3Exception: The provided security credentials are not valid. (Service: Amazon S3; Status Code: 403; Error Code: InvalidSecurity; Request ID: null; S3 Extended Request ID: null; Proxy: null), S3 Extended Request ID: null 2022-04-07 03:38:05 destination > at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1819) 2022-04-07 03:38:05 destination > at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleServiceErrorResponse(AmazonHttpClient.java:1403) 2022-04-07 03:38:05 destination > at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1372) 2022-04-07 03:38:05 destination > at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1145) 2022-04-07 03:38:05 destination > at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:802) 2022-04-07 03:38:05 destination > at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:770) 2022-04-07 03:38:05 destination > at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:744) 2022-04-07 03:38:05 destination > at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:704) 2022-04-07 03:38:05 destination > at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:686) 2022-04-07 03:38:05 destination > at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:550) 2022-04-07 03:38:05 destination > at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:530) 2022-04-07 03:38:05 destination > at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:5437) 2022-04-07 03:38:05 destination > at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:5384) 2022-04-07 03:38:05 destination > at com.amazonaws.services.s3.AmazonS3Client.initiateMultipartUpload(AmazonS3Client.java:3715) 2022-04-07 03:38:05 destination > at alex.mojaki.s3upload.StreamTransferManager.getMultiPartOutputStreams(StreamTransferManager.java:327) 2022-04-07 03:38:05 destination > at io.airbyte.integrations.destination.gcs.avro.GcsAvroWriter.(GcsAvroWriter.java:80) 2022-04-07 03:38:05 destination > at io.airbyte.integrations.destination.bigquery.uploader.BigQueryUploaderFactory.initGcsWriter(BigQueryUploaderFactory.java:124) 2022-04-07 03:38:05 destination > at io.airbyte.integrations.destination.bigquery.uploader.BigQueryUploaderFactory.getGcsBigQueryUploader(BigQueryUploaderFactory.java:102) 2022-04-07 03:38:05 destination > at io.airbyte.integrations.destination.bigquery.uploader.BigQueryUploaderFactory.getUploader(BigQueryUploaderFactory.java:66) 2022-04-07 03:38:05 destination > at io.airbyte.integrations.destination.bigquery.BigQueryDestination.getUploaderMap(BigQueryDestination.java:229) 2022-04-07 03:38:05 destination > at io.airbyte.integrations.destination.bigquery.BigQueryDestination.getConsumer(BigQueryDestination.java:204) 2022-04-07 03:38:05 destination > at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:162) 2022-04-07 03:38:05 destination > at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:105) 2022-04-07 03:38:05 destination > at io.airbyte.integrations.destination.bigquery.BigQueryDestination.main(BigQueryDestination.java:262) 2022-04-07 03:39:05 WARN i.a.c.i.LineGobbler(voidCall):86 - airbyte-source gobbler IOException: Stream closed. Typically happens when cancelling a job. 2022-04-07 03:39:05 ERROR i.a.w.DefaultReplicationWorker(run):169 - Sync worker failed. java.util.concurrent.ExecutionException: io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 1 at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:162) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:57) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Suppressed: io.airbyte.workers.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.protocols.airbyte.DefaultAirbyteSource.close(DefaultAirbyteSource.java:136) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:126) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:57) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Suppressed: java.io.IOException: Stream closed at java.lang.ProcessBuilder$NullOutputStream.write(ProcessBuilder.java:445) ~[?:?] at java.io.OutputStream.write(OutputStream.java:162) ~[?:?] at java.io.BufferedOutputStream.write(BufferedOutputStream.java:123) ~[?:?] at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:234) ~[?:?] at sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:304) ~[?:?] at sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:282) ~[?:?] at sun.nio.cs.StreamEncoder.write(StreamEncoder.java:132) ~[?:?] at java.io.OutputStreamWriter.write(OutputStreamWriter.java:205) ~[?:?] at java.io.BufferedWriter.flushBuffer(BufferedWriter.java:120) ~[?:?] at java.io.BufferedWriter.flush(BufferedWriter.java:256) ~[?:?] at io.airbyte.workers.protocols.airbyte.DefaultAirbyteDestination.notifyEndOfStream(DefaultAirbyteDestination.java:98) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at io.airbyte.workers.protocols.airbyte.DefaultAirbyteDestination.close(DefaultAirbyteDestination.java:111) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:126) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:57) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 1 at io.airbyte.workers.DefaultReplicationWorker.lambda$getDestinationOutputRunnable$6(DefaultReplicationWorker.java:354) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?] ... 1 more 2022-04-07 03:39:05 INFO i.a.w.DefaultReplicationWorker(run):228 - sync summary: io.airbyte.config.ReplicationAttemptSummary@e699295[status=failed,recordsSynced=513,bytesSynced=481567,startTime=1649302679110,endTime=1649302745626,totalStats=io.airbyte.config.SyncStats@1303cdd6[recordsEmitted=513,bytesEmitted=481567,stateMessagesEmitted=0,recordsCommitted=0],streamStats=[io.airbyte.config.StreamSyncStats@14679091[streamName=kl_campaigns,stats=io.airbyte.config.SyncStats@5d50cfbc[recordsEmitted=121,bytesEmitted=90790,stateMessagesEmitted=,recordsCommitted=]], io.airbyte.config.StreamSyncStats@1fef03b9[streamName=kl_events,stats=io.airbyte.config.SyncStats@128f10ef[recordsEmitted=392,bytesEmitted=390777,stateMessagesEmitted=,recordsCommitted=]]]] 2022-04-07 03:39:05 INFO i.a.w.DefaultReplicationWorker(run):250 - Source did not output any state messages 2022-04-07 03:39:05 WARN i.a.w.DefaultReplicationWorker(run):261 - State capture: No state retained. 2022-04-07 03:39:05 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-04-07 03:39:05 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$1):147 - sync summary: io.airbyte.config.StandardSyncOutput@104ea3f8[standardSyncSummary=io.airbyte.config.StandardSyncSummary@16a517a5[status=failed,recordsSynced=513,bytesSynced=481567,startTime=1649302679110,endTime=1649302745626,totalStats=io.airbyte.config.SyncStats@1303cdd6[recordsEmitted=513,bytesEmitted=481567,stateMessagesEmitted=0,recordsCommitted=0],streamStats=[io.airbyte.config.StreamSyncStats@14679091[streamName=kl_campaigns,stats=io.airbyte.config.SyncStats@5d50cfbc[recordsEmitted=121,bytesEmitted=90790,stateMessagesEmitted=,recordsCommitted=]], io.airbyte.config.StreamSyncStats@1fef03b9[streamName=kl_events,stats=io.airbyte.config.SyncStats@128f10ef[recordsEmitted=392,bytesEmitted=390777,stateMessagesEmitted=,recordsCommitted=]]]],state=,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@7fbf5271[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@13b16a70[stream=io.airbyte.protocol.models.AirbyteStream@76855a9d[name=kl_campaigns,jsonSchema={"type":"object","required":["object","id","name","status","status_id","status_label","from_name","from_email","num_recipients","lists","excluded_lists","is_segmented","campaign_type","message_type"],"properties":{"id":{"type":"string"},"name":{"type":"string"},"lists":{"type":"array","items":{"type":"object","required":["object","id","name","created","updated","person_count","list_type"],"properties":{"id":{"type":"string"},"name":{"type":"string"},"folder":{"type":["null","string"]},"object":{"type":"string"},"created":{"type":"string","format":"date-time"},"updated":{"type":"string","format":"date-time"},"list_type":{"type":"string"},"person_count":{"type":"integer"}}}},"object":{"type":"string"},"status":{"type":"string"},"created":{"type":["null","string"],"format":"date-time"},"sent_at":{"type":["null","string"],"format":"date-time"},"subject":{"type":["null","string"]},"updated":{"type":["null","string"],"format":"date-time"},"from_name":{"type":"string"},"send_time":{"type":["null","string"],"format":"date-time"},"status_id":{"type":"integer"},"from_email":{"type":"string"},"template_id":{"type":["null","string"]},"is_segmented":{"type":"boolean"},"message_type":{"type":"string"},"status_label":{"type":"string"},"campaign_type":{"type":"string"},"excluded_lists":{"type":"array","items":{"type":"object","required":["object","id","name","created","updated","person_count","list_type"],"properties":{"id":{"type":"string"},"name":{"type":"string"},"folder":{"type":["null","string"]},"object":{"type":"string"},"created":{"type":"string","format":"date-time"},"updated":{"type":"string","format":"date-time"},"list_type":{"type":"string"},"person_count":{"type":"integer"}}}},"num_recipients":{"type":"integer"}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@482373d7[stream=io.airbyte.protocol.models.AirbyteStream@4d0a9c78[name=kl_events,jsonSchema={"type":"object","required":["object","id","uuid","event_name","timestamp","datetime","statistic_id","event_properties","person"],"properties":{"id":{"type":"string"},"uuid":{"type":"string"},"object":{"type":"string"},"person":{"type":"object"},"datetime":{"type":"string"},"timestamp":{"type":"integer"},"event_name":{"type":"string"},"statistic_id":{"type":"string"},"event_properties":{"type":"object"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[timestamp],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[timestamp],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@55708d43[stream=io.airbyte.protocol.models.AirbyteStream@97d64c2[name=kl_global_exclusions,jsonSchema={"type":"object","required":["object","email","reason","timestamp"],"properties":{"email":{"type":"string"},"object":{"type":"string"},"reason":{"type":"string"},"timestamp":{"type":"string","format":"date-time"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[timestamp],sourceDefinedPrimaryKey=[[email]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[timestamp],destinationSyncMode=append,primaryKey=[[email]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@5a1313f1[stream=io.airbyte.protocol.models.AirbyteStream@4363bd97[name=kl_lists,jsonSchema={"type":"object","required":["object","id","name","created","updated","person_count","list_type"],"properties":{"id":{"type":"string"},"name":{"type":"string"},"folder":{"type":["null","string"]},"object":{"type":"string"},"created":{"type":"string","format":"date-time"},"updated":{"type":"string","format":"date-time"},"list_type":{"type":"string"},"person_count":{"type":"integer"}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@12a83a2d[stream=io.airbyte.protocol.models.AirbyteStream@701107ce[name=kl_metrics,jsonSchema={"type":"object","required":["object","id","name","created","updated","integration"],"properties":{"id":{"type":"string"},"name":{"type":"string"},"object":{"type":"string"},"created":{"type":"string","format":"date-time"},"updated":{"type":"string","format":"date-time"},"integration":{"type":"object","required":["object","id","name","category"],"properties":{"id":{"type":"string"},"name":{"type":"string"},"object":{"type":"string"},"category":{"type":"string"}}}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[io.airbyte.config.FailureReason@32df1ea6[failureOrigin=destination,failureType=,internalMessage=io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process message delivery failed,externalMessage=Something went wrong within the destination connector,metadata=io.airbyte.config.Metadata@6c0e926f[additionalProperties={attemptNumber=2, jobId=9}],stacktrace=java.util.concurrent.CompletionException: io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process message delivery failed at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315) at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:833) Caused by: io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process message delivery failed at io.airbyte.workers.DefaultReplicationWorker.lambda$getReplicationRunnable$5(DefaultReplicationWorker.java:296) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ... 3 more Caused by: java.io.IOException: Stream closed at java.base/java.lang.ProcessBuilder$NullOutputStream.write(ProcessBuilder.java:445) at java.base/java.io.OutputStream.write(OutputStream.java:162) at java.base/java.io.BufferedOutputStream.write(BufferedOutputStream.java:123) at java.base/sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:234) at java.base/sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:304) at java.base/sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:282) at java.base/sun.nio.cs.StreamEncoder.write(StreamEncoder.java:132) at java.base/java.io.OutputStreamWriter.write(OutputStreamWriter.java:205) at java.base/java.io.BufferedWriter.flushBuffer(BufferedWriter.java:120) at java.base/java.io.BufferedWriter.write(BufferedWriter.java:233) at java.base/java.io.Writer.write(Writer.java:249) at io.airbyte.workers.protocols.airbyte.DefaultAirbyteDestination.accept(DefaultAirbyteDestination.java:90) at io.airbyte.workers.DefaultReplicationWorker.lambda$getReplicationRunnable$5(DefaultReplicationWorker.java:294) ... 4 more ,retryable=,timestamp=1649302685618], io.airbyte.config.FailureReason@3fa4b491[failureOrigin=destination,failureType=,internalMessage=io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 1,externalMessage=Something went wrong within the destination connector,metadata=io.airbyte.config.Metadata@4773fbdc[additionalProperties={attemptNumber=2, jobId=9}],stacktrace=java.util.concurrent.CompletionException: io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 1 at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315) at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:833) Caused by: io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 1 at io.airbyte.workers.DefaultReplicationWorker.lambda$getDestinationOutputRunnable$6(DefaultReplicationWorker.java:354) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ... 3 more ,retryable=,timestamp=1649302685617]]] 2022-04-07 03:39:05 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):235 - Stopping temporal heartbeating... 2022-04-07 03:39:05 INFO i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/9/2/logs.log 2022-04-07 03:39:05 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.35.65-alpha 2022-04-07 03:39:05 INFO i.a.w.DefaultNormalizationWorker(run):46 - Running normalization. 2022-04-07 03:39:05 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):122 - Running with normalization version: airbyte/normalization:0.1.74 2022-04-07 03:39:05 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/normalization:0.1.74 exists... 2022-04-07 03:39:05 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/normalization:0.1.74 was found locally. 2022-04-07 03:39:05 INFO i.a.w.p.DockerProcessFactory(create):106 - Creating docker job ID: 9 2022-04-07 03:39:05 INFO i.a.w.p.DockerProcessFactory(create):158 - Preparing command: docker run --rm --init -i -w /data/9/2/normalize --log-driver none --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.35.65-alpha airbyte/normalization:0.1.74 run --integration-type bigquery --config destination_config.json --catalog destination_catalog.json 2022-04-07 03:39:06 normalization > Running: transform-config --config destination_config.json --integration-type bigquery --out /data/9/2/normalize 2022-04-07 03:39:06 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/9/2/normalize') 2022-04-07 03:39:06 normalization > transform_bigquery 2022-04-07 03:39:07 normalization > Running: transform-catalog --integration-type bigquery --profile-config-dir /data/9/2/normalize --catalog destination_catalog.json --out /data/9/2/normalize/models/generated/ --json-column _airbyte_data 2022-04-07 03:39:07 normalization > Processing destination_catalog.json... 2022-04-07 03:39:07 normalization > Generating airbyte_ctes/airbyte_new/kl_campaigns_ab1.sql from kl_campaigns 2022-04-07 03:39:07 normalization > Generating airbyte_ctes/airbyte_new/kl_campaigns_ab2.sql from kl_campaigns 2022-04-07 03:39:07 normalization > Generating airbyte_ctes/airbyte_new/kl_campaigns_ab3.sql from kl_campaigns 2022-04-07 03:39:07 normalization > Generating airbyte_incremental/airbyte_new/kl_campaigns.sql from kl_campaigns 2022-04-07 03:39:07 normalization > Generating airbyte_ctes/airbyte_new/kl_events_ab1.sql from kl_events 2022-04-07 03:39:07 normalization > Generating airbyte_ctes/airbyte_new/kl_events_ab2.sql from kl_events 2022-04-07 03:39:07 normalization > Generating airbyte_ctes/airbyte_new/kl_events_ab3.sql from kl_events 2022-04-07 03:39:07 normalization > Generating airbyte_incremental/airbyte_new/kl_events.sql from kl_events 2022-04-07 03:39:07 normalization > Generating airbyte_ctes/airbyte_new/kl_global_exclusions_ab1.sql from kl_global_exclusions 2022-04-07 03:39:07 normalization > Generating airbyte_ctes/airbyte_new/kl_global_exclusions_ab2.sql from kl_global_exclusions 2022-04-07 03:39:07 normalization > Generating airbyte_ctes/airbyte_new/kl_global_exclusions_ab3.sql from kl_global_exclusions 2022-04-07 03:39:07 normalization > Generating airbyte_incremental/airbyte_new/kl_global_exclusions.sql from kl_global_exclusions 2022-04-07 03:39:07 normalization > Generating airbyte_ctes/airbyte_new/kl_lists_ab1.sql from kl_lists 2022-04-07 03:39:07 normalization > Generating airbyte_ctes/airbyte_new/kl_lists_ab2.sql from kl_lists 2022-04-07 03:39:07 normalization > Generating airbyte_ctes/airbyte_new/kl_lists_ab3.sql from kl_lists 2022-04-07 03:39:07 normalization > Generating airbyte_incremental/airbyte_new/kl_lists.sql from kl_lists 2022-04-07 03:39:07 normalization > Generating airbyte_ctes/airbyte_new/kl_metrics_ab1.sql from kl_metrics 2022-04-07 03:39:07 normalization > Generating airbyte_ctes/airbyte_new/kl_metrics_ab2.sql from kl_metrics 2022-04-07 03:39:07 normalization > Generating airbyte_ctes/airbyte_new/kl_metrics_ab3.sql from kl_metrics 2022-04-07 03:39:07 normalization > Generating airbyte_incremental/airbyte_new/kl_metrics.sql from kl_metrics 2022-04-07 03:39:07 normalization > Generating airbyte_ctes/airbyte_new/kl_campaigns_lists_ab1.sql from kl_campaigns/lists 2022-04-07 03:39:07 normalization > Generating airbyte_ctes/airbyte_new/kl_campaigns_lists_ab2.sql from kl_campaigns/lists 2022-04-07 03:39:07 normalization > Generating airbyte_ctes/airbyte_new/kl_campaigns_lists_ab3.sql from kl_campaigns/lists 2022-04-07 03:39:07 normalization > Generating airbyte_incremental/airbyte_new/kl_campaigns_lists.sql from kl_campaigns/lists 2022-04-07 03:39:07 normalization > Generating airbyte_ctes/airbyte_new/kl_campaigns_excluded_lists_ab1.sql from kl_campaigns/excluded_lists 2022-04-07 03:39:07 normalization > Generating airbyte_ctes/airbyte_new/kl_campaigns_excluded_lists_ab2.sql from kl_campaigns/excluded_lists 2022-04-07 03:39:07 normalization > Generating airbyte_ctes/airbyte_new/kl_campaigns_excluded_lists_ab3.sql from kl_campaigns/excluded_lists 2022-04-07 03:39:07 normalization > Generating airbyte_incremental/airbyte_new/kl_campaigns_excluded_lists.sql from kl_campaigns/excluded_lists 2022-04-07 03:39:07 normalization > Generating airbyte_ctes/airbyte_new/kl_metrics_integration_ab1.sql from kl_metrics/integration 2022-04-07 03:39:07 normalization > Generating airbyte_ctes/airbyte_new/kl_metrics_integration_ab2.sql from kl_metrics/integration 2022-04-07 03:39:07 normalization > Generating airbyte_ctes/airbyte_new/kl_metrics_integration_ab3.sql from kl_metrics/integration 2022-04-07 03:39:07 normalization > Generating airbyte_incremental/airbyte_new/kl_metrics_integration.sql from kl_metrics/integration 2022-04-07 03:39:07 normalization > detected no config file for ssh, assuming ssh is off. 2022-04-07 03:39:10 normalization > [--event-buffer-size EVENT_BUFFER_SIZE] 2022-04-07 03:39:10 normalization > --event-buffer-size EVENT_BUFFER_SIZE 2022-04-07 03:39:10 normalization > 2022-04-07 03:39:10 normalization > DBT >=1.0.0 detected; using 10K event buffer size 2022-04-07 03:39:10 normalization > 2022-04-07 03:39:13 normalization > 03:39:13 Running with dbt=1.0.0 2022-04-07 03:39:13 normalization > 03:39:13 Partial parse save file not found. Starting full parse. 2022-04-07 03:39:15 normalization > 03:39:15 [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. 2022-04-07 03:39:15 normalization > There are 2 unused configuration paths: 2022-04-07 03:39:15 normalization > - models.airbyte_utils.generated.airbyte_tables 2022-04-07 03:39:15 normalization > - models.airbyte_utils.generated.airbyte_views 2022-04-07 03:39:15 normalization > 2022-04-07 03:39:15 normalization > 03:39:15 Found 32 models, 0 tests, 0 snapshots, 0 analyses, 537 macros, 0 operations, 0 seed files, 5 sources, 0 exposures, 0 metrics 2022-04-07 03:39:15 normalization > 03:39:15 2022-04-07 03:39:18 normalization > 03:39:18 Concurrency: 8 threads (target='prod') 2022-04-07 03:39:18 normalization > 03:39:18 2022-04-07 03:39:21 normalization > 03:39:21 1 of 8 START incremental model airbyte_new.kl_metrics................................................................... [RUN] 2022-04-07 03:39:21 normalization > 03:39:21 2 of 8 START incremental model airbyte_new.kl_lists..................................................................... [RUN] 2022-04-07 03:39:21 normalization > 03:39:21 3 of 8 START incremental model airbyte_new.kl_campaigns................................................................. [RUN] 2022-04-07 03:39:21 normalization > 03:39:21 4 of 8 START incremental model airbyte_new.kl_events.................................................................... [RUN] 2022-04-07 03:39:21 normalization > 03:39:21 5 of 8 START incremental model airbyte_new.kl_global_exclusions......................................................... [RUN] 2022-04-07 03:39:21 normalization > 03:39:21 03:39:21 + `nhg-dw`.airbyte_new.`kl_campaigns`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-04-07 03:39:21 normalization > 03:39:21 03:39:21 + `nhg-dw`.airbyte_new.`kl_events`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-04-07 03:39:21 normalization > 03:39:21 03:39:21 + `nhg-dw`.airbyte_new.`kl_metrics`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-04-07 03:39:21 normalization > 03:39:21 03:39:21 + `nhg-dw`.airbyte_new.`kl_global_exclusions`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-04-07 03:39:21 normalization > 03:39:21 03:39:21 + `nhg-dw`.airbyte_new.`kl_lists`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-04-07 03:39:22 normalization > 03:39:22 5 of 8 ERROR creating incremental model airbyte_new.kl_global_exclusions................................................ [ERROR in 1.55s] 2022-04-07 03:39:22 normalization > 03:39:22 1 of 8 ERROR creating incremental model airbyte_new.kl_metrics.......................................................... [ERROR in 1.56s] 2022-04-07 03:39:22 normalization > 03:39:22 2 of 8 ERROR creating incremental model airbyte_new.kl_lists............................................................ [ERROR in 1.56s] 2022-04-07 03:39:22 normalization > 03:39:22 3 of 8 ERROR creating incremental model airbyte_new.kl_campaigns........................................................ [ERROR in 1.56s] 2022-04-07 03:39:22 normalization > 03:39:22 4 of 8 ERROR creating incremental model airbyte_new.kl_events........................................................... [ERROR in 1.56s] 2022-04-07 03:39:22 normalization > 03:39:22 6 of 8 SKIP relation airbyte_new.kl_metrics_integration................................................................. [SKIP] 2022-04-07 03:39:22 normalization > 03:39:22 7 of 8 SKIP relation airbyte_new.kl_campaigns_excluded_lists............................................................ [SKIP] 2022-04-07 03:39:22 normalization > 03:39:22 8 of 8 SKIP relation airbyte_new.kl_campaigns_lists..................................................................... [SKIP] 2022-04-07 03:39:22 normalization > 03:39:22 2022-04-07 03:39:22 normalization > 03:39:22 Finished running 8 incremental models in 7.06s. 2022-04-07 03:39:22 normalization > 03:39:22 2022-04-07 03:39:22 normalization > 03:39:22 Completed with 5 errors and 0 warnings: 2022-04-07 03:39:22 normalization > 03:39:22 2022-04-07 03:39:22 normalization > 03:39:22 Runtime Error in model kl_global_exclusions (models/generated/airbyte_incremental/airbyte_new/kl_global_exclusions.sql) 2022-04-07 03:39:22 normalization > 03:39:22 404 Not found: Table nhg-dw:airbyte_new._airbyte_raw_kl_global_exclusions was not found in location europe-west4 2022-04-07 03:39:22 normalization > 03:39:22 2022-04-07 03:39:22 normalization > 03:39:22 (job ID: 75fcb30d-2c58-4771-8701-3c00fd823bb0) 2022-04-07 03:39:22 normalization > 03:39:22 2022-04-07 03:39:22 normalization > 03:39:22 Runtime Error in model kl_metrics (models/generated/airbyte_incremental/airbyte_new/kl_metrics.sql) 2022-04-07 03:39:22 normalization > 03:39:22 404 Not found: Table nhg-dw:airbyte_new._airbyte_raw_kl_metrics was not found in location europe-west4 2022-04-07 03:39:22 normalization > 03:39:22 2022-04-07 03:39:22 normalization > 03:39:22 (job ID: dc2b6095-6bfd-45de-bda2-7bb244eb8c3c) 2022-04-07 03:39:22 normalization > 03:39:22 2022-04-07 03:39:22 normalization > 03:39:22 Runtime Error in model kl_lists (models/generated/airbyte_incremental/airbyte_new/kl_lists.sql) 2022-04-07 03:39:22 normalization > 03:39:22 404 Not found: Table nhg-dw:airbyte_new._airbyte_raw_kl_lists was not found in location europe-west4 2022-04-07 03:39:22 normalization > 03:39:22 2022-04-07 03:39:22 normalization > 03:39:22 (job ID: effb1025-b146-462e-909b-47da7433f2a3) 2022-04-07 03:39:22 normalization > 03:39:22 2022-04-07 03:39:22 normalization > 03:39:22 Runtime Error in model kl_campaigns (models/generated/airbyte_incremental/airbyte_new/kl_campaigns.sql) 2022-04-07 03:39:22 normalization > 03:39:22 404 Not found: Table nhg-dw:airbyte_new._airbyte_raw_kl_campaigns was not found in location europe-west4 2022-04-07 03:39:22 normalization > 03:39:22 2022-04-07 03:39:22 normalization > 03:39:22 (job ID: 74c78b8d-3a0b-4595-a4ad-5e3de0a2e38d) 2022-04-07 03:39:22 normalization > 03:39:22 2022-04-07 03:39:22 normalization > 03:39:22 Runtime Error in model kl_events (models/generated/airbyte_incremental/airbyte_new/kl_events.sql) 2022-04-07 03:39:22 normalization > 03:39:22 404 Not found: Table nhg-dw:airbyte_new._airbyte_raw_kl_events was not found in location europe-west4 2022-04-07 03:39:22 normalization > 03:39:22 2022-04-07 03:39:22 normalization > 03:39:22 (job ID: edb2f818-832a-4aa4-b518-aa9761560a6d) 2022-04-07 03:39:22 normalization > 03:39:22 2022-04-07 03:39:22 normalization > 03:39:22 Done. PASS=0 WARN=0 ERROR=5 SKIP=3 TOTAL=8 2022-04-07 03:39:22 normalization > 2022-04-07 03:39:22 normalization > Diagnosing dbt debug to check if destination is available for dbt and well configured (1): 2022-04-07 03:39:22 normalization > 2022-04-07 03:39:25 normalization > 03:39:25 Running with dbt=1.0.0 2022-04-07 03:39:25 normalization > dbt version: 1.0.0 2022-04-07 03:39:25 normalization > python version: 3.9.9 2022-04-07 03:39:25 normalization > python path: /usr/local/bin/python 2022-04-07 03:39:25 normalization > os info: Linux-5.10.16.3-microsoft-standard-WSL2-x86_64-with-glibc2.31 2022-04-07 03:39:25 normalization > Using profiles.yml file at /data/9/2/normalize/profiles.yml 2022-04-07 03:39:25 normalization > Using dbt_project.yml file at /data/9/2/normalize/dbt_project.yml 2022-04-07 03:39:25 normalization > 2022-04-07 03:39:25 normalization > Configuration: 2022-04-07 03:39:25 normalization > profiles.yml file [OK found and valid] 2022-04-07 03:39:25 normalization > dbt_project.yml file [OK found and valid] 2022-04-07 03:39:25 normalization > 2022-04-07 03:39:25 normalization > Required dependencies: 2022-04-07 03:39:25 normalization > - git [OK found] 2022-04-07 03:39:25 normalization > 2022-04-07 03:39:25 normalization > Connection: 2022-04-07 03:39:25 normalization > method: service-account-json 2022-04-07 03:39:25 normalization > database: nhg-dw 2022-04-07 03:39:25 normalization > schema: airbyte_new 2022-04-07 03:39:25 normalization > location: europe-west4 2022-04-07 03:39:25 normalization > priority: interactive 2022-04-07 03:39:25 normalization > timeout_seconds: 300 2022-04-07 03:39:25 normalization > maximum_bytes_billed: None 2022-04-07 03:39:25 normalization > execution_project: nhg-dw 2022-04-07 03:39:27 normalization > Connection test: [OK connection ok] 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > All checks passed! 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > Forward dbt output logs to diagnose/debug errors (0): 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > ============================== 2022-04-07 03:39:13.209924 | d1e64596-8620-4f2f-a4ac-03c53f929251 ============================== 2022-04-07 03:39:27 normalization > 03:39:13.209924 [info ] [MainThread]: Running with dbt=1.0.0 2022-04-07 03:39:27 normalization > 03:39:13.210406 [debug] [MainThread]: running dbt with arguments Namespace(record_timing_info=None, debug=None, log_format=None, write_json=None, use_colors=None, printer_width=None, warn_error=None, version_check=None, partial_parse=None, single_threaded=False, use_experimental_parser=None, static_parser=None, profiles_dir='/data/9/2/normalize', send_anonymous_usage_stats=None, fail_fast=None, event_buffer_size='10000', project_dir='/data/9/2/normalize', profile=None, target=None, vars='{}', log_cache_events=False, threads=None, select=None, exclude=None, selector_name=None, state=None, defer=None, full_refresh=False, cls=, which='run', rpc_method='run') 2022-04-07 03:39:27 normalization > 03:39:13.210588 [debug] [MainThread]: Tracking: do not track 2022-04-07 03:39:27 normalization > 03:39:13.238047 [info ] [MainThread]: Partial parse save file not found. Starting full parse. 2022-04-07 03:39:27 normalization > 03:39:13.269437 [debug] [MainThread]: Parsing macros/get_custom_schema.sql 2022-04-07 03:39:27 normalization > 03:39:13.270433 [debug] [MainThread]: Parsing macros/incremental.sql 2022-04-07 03:39:27 normalization > 03:39:13.279872 [debug] [MainThread]: Parsing macros/star_intersect.sql 2022-04-07 03:39:27 normalization > 03:39:13.288877 [debug] [MainThread]: Parsing macros/should_full_refresh.sql 2022-04-07 03:39:27 normalization > 03:39:13.296192 [debug] [MainThread]: Parsing macros/cross_db_utils/quote.sql 2022-04-07 03:39:27 normalization > 03:39:13.298249 [debug] [MainThread]: Parsing macros/cross_db_utils/concat.sql 2022-04-07 03:39:27 normalization > 03:39:13.301381 [debug] [MainThread]: Parsing macros/cross_db_utils/json_operations.sql 2022-04-07 03:39:27 normalization > 03:39:13.354932 [debug] [MainThread]: Parsing macros/cross_db_utils/datatypes.sql 2022-04-07 03:39:27 normalization > 03:39:13.369598 [debug] [MainThread]: Parsing macros/cross_db_utils/surrogate_key.sql 2022-04-07 03:39:27 normalization > 03:39:13.372999 [debug] [MainThread]: Parsing macros/cross_db_utils/current_timestamp.sql 2022-04-07 03:39:27 normalization > 03:39:13.373705 [debug] [MainThread]: Parsing macros/cross_db_utils/array.sql 2022-04-07 03:39:27 normalization > 03:39:13.394740 [debug] [MainThread]: Parsing macros/cross_db_utils/type_conversions.sql 2022-04-07 03:39:27 normalization > 03:39:13.402433 [debug] [MainThread]: Parsing macros/cross_db_utils/except.sql 2022-04-07 03:39:27 normalization > 03:39:13.403505 [debug] [MainThread]: Parsing macros/cross_db_utils/hash.sql 2022-04-07 03:39:27 normalization > 03:39:13.404226 [debug] [MainThread]: Parsing macros/schema_tests/equality.sql 2022-04-07 03:39:27 normalization > 03:39:13.414295 [debug] [MainThread]: Parsing macros/schema_tests/equal_rowcount.sql 2022-04-07 03:39:27 normalization > 03:39:13.415886 [debug] [MainThread]: Parsing macros/etc.sql 2022-04-07 03:39:27 normalization > 03:39:13.418408 [debug] [MainThread]: Parsing macros/adapters.sql 2022-04-07 03:39:27 normalization > 03:39:13.459301 [debug] [MainThread]: Parsing macros/catalog.sql 2022-04-07 03:39:27 normalization > 03:39:13.472186 [debug] [MainThread]: Parsing macros/materializations/copy.sql 2022-04-07 03:39:27 normalization > 03:39:13.476099 [debug] [MainThread]: Parsing macros/materializations/snapshot.sql 2022-04-07 03:39:27 normalization > 03:39:13.478559 [debug] [MainThread]: Parsing macros/materializations/incremental.sql 2022-04-07 03:39:27 normalization > 03:39:13.503435 [debug] [MainThread]: Parsing macros/materializations/table.sql 2022-04-07 03:39:27 normalization > 03:39:13.510651 [debug] [MainThread]: Parsing macros/materializations/view.sql 2022-04-07 03:39:27 normalization > 03:39:13.515379 [debug] [MainThread]: Parsing macros/materializations/seed.sql 2022-04-07 03:39:27 normalization > 03:39:13.521874 [debug] [MainThread]: Parsing macros/adapters/columns.sql 2022-04-07 03:39:27 normalization > 03:39:13.542235 [debug] [MainThread]: Parsing macros/adapters/relation.sql 2022-04-07 03:39:27 normalization > 03:39:13.563165 [debug] [MainThread]: Parsing macros/adapters/persist_docs.sql 2022-04-07 03:39:27 normalization > 03:39:13.570264 [debug] [MainThread]: Parsing macros/adapters/freshness.sql 2022-04-07 03:39:27 normalization > 03:39:13.574632 [debug] [MainThread]: Parsing macros/adapters/indexes.sql 2022-04-07 03:39:27 normalization > 03:39:13.578562 [debug] [MainThread]: Parsing macros/adapters/schema.sql 2022-04-07 03:39:27 normalization > 03:39:13.581616 [debug] [MainThread]: Parsing macros/adapters/metadata.sql 2022-04-07 03:39:27 normalization > 03:39:13.593317 [debug] [MainThread]: Parsing macros/get_custom_name/get_custom_schema.sql 2022-04-07 03:39:27 normalization > 03:39:13.597132 [debug] [MainThread]: Parsing macros/get_custom_name/get_custom_database.sql 2022-04-07 03:39:27 normalization > 03:39:13.599320 [debug] [MainThread]: Parsing macros/get_custom_name/get_custom_alias.sql 2022-04-07 03:39:27 normalization > 03:39:13.601303 [debug] [MainThread]: Parsing macros/etc/datetime.sql 2022-04-07 03:39:27 normalization > 03:39:13.615374 [debug] [MainThread]: Parsing macros/etc/statement.sql 2022-04-07 03:39:27 normalization > 03:39:13.622109 [debug] [MainThread]: Parsing macros/generic_test_sql/unique.sql 2022-04-07 03:39:27 normalization > 03:39:13.623048 [debug] [MainThread]: Parsing macros/generic_test_sql/not_null.sql 2022-04-07 03:39:27 normalization > 03:39:13.623738 [debug] [MainThread]: Parsing macros/generic_test_sql/relationships.sql 2022-04-07 03:39:27 normalization > 03:39:13.624997 [debug] [MainThread]: Parsing macros/generic_test_sql/accepted_values.sql 2022-04-07 03:39:27 normalization > 03:39:13.626994 [debug] [MainThread]: Parsing macros/materializations/configs.sql 2022-04-07 03:39:27 normalization > 03:39:13.630341 [debug] [MainThread]: Parsing macros/materializations/hooks.sql 2022-04-07 03:39:27 normalization > 03:39:13.636119 [debug] [MainThread]: Parsing macros/materializations/tests/where_subquery.sql 2022-04-07 03:39:27 normalization > 03:39:13.638665 [debug] [MainThread]: Parsing macros/materializations/tests/helpers.sql 2022-04-07 03:39:27 normalization > 03:39:13.641294 [debug] [MainThread]: Parsing macros/materializations/tests/test.sql 2022-04-07 03:39:27 normalization > 03:39:13.648448 [debug] [MainThread]: Parsing macros/materializations/seeds/helpers.sql 2022-04-07 03:39:27 normalization > 03:39:13.677211 [debug] [MainThread]: Parsing macros/materializations/seeds/seed.sql 2022-04-07 03:39:27 normalization > 03:39:13.687143 [debug] [MainThread]: Parsing macros/materializations/snapshots/snapshot_merge.sql 2022-04-07 03:39:27 normalization > 03:39:13.689626 [debug] [MainThread]: Parsing macros/materializations/snapshots/snapshot.sql 2022-04-07 03:39:27 normalization > 03:39:13.709259 [debug] [MainThread]: Parsing macros/materializations/snapshots/strategies.sql 2022-04-07 03:39:27 normalization > 03:39:13.739799 [debug] [MainThread]: Parsing macros/materializations/snapshots/helpers.sql 2022-04-07 03:39:27 normalization > 03:39:13.760722 [debug] [MainThread]: Parsing macros/materializations/models/incremental/on_schema_change.sql 2022-04-07 03:39:27 normalization > 03:39:13.790713 [debug] [MainThread]: Parsing macros/materializations/models/incremental/merge.sql 2022-04-07 03:39:27 normalization > 03:39:13.811033 [debug] [MainThread]: Parsing macros/materializations/models/incremental/incremental.sql 2022-04-07 03:39:27 normalization > 03:39:13.830342 [debug] [MainThread]: Parsing macros/materializations/models/incremental/is_incremental.sql 2022-04-07 03:39:27 normalization > 03:39:13.832582 [debug] [MainThread]: Parsing macros/materializations/models/incremental/column_helpers.sql 2022-04-07 03:39:27 normalization > 03:39:13.839333 [debug] [MainThread]: Parsing macros/materializations/models/view/create_or_replace_view.sql 2022-04-07 03:39:27 normalization > 03:39:13.843426 [debug] [MainThread]: Parsing macros/materializations/models/view/helpers.sql 2022-04-07 03:39:27 normalization > 03:39:13.845328 [debug] [MainThread]: Parsing macros/materializations/models/view/view.sql 2022-04-07 03:39:27 normalization > 03:39:13.856797 [debug] [MainThread]: Parsing macros/materializations/models/view/create_view_as.sql 2022-04-07 03:39:27 normalization > 03:39:13.860059 [debug] [MainThread]: Parsing macros/materializations/models/table/create_table_as.sql 2022-04-07 03:39:27 normalization > 03:39:13.864404 [debug] [MainThread]: Parsing macros/materializations/models/table/table.sql 2022-04-07 03:39:27 normalization > 03:39:13.875916 [debug] [MainThread]: Parsing tests/generic/builtin.sql 2022-04-07 03:39:27 normalization > 03:39:13.880266 [debug] [MainThread]: Parsing macros/cross_db_utils/split_part.sql 2022-04-07 03:39:27 normalization > 03:39:13.882839 [debug] [MainThread]: Parsing macros/cross_db_utils/literal.sql 2022-04-07 03:39:27 normalization > 03:39:13.884024 [debug] [MainThread]: Parsing macros/cross_db_utils/datediff.sql 2022-04-07 03:39:27 normalization > 03:39:13.901197 [debug] [MainThread]: Parsing macros/cross_db_utils/_is_ephemeral.sql 2022-04-07 03:39:27 normalization > 03:39:13.904078 [debug] [MainThread]: Parsing macros/cross_db_utils/date_trunc.sql 2022-04-07 03:39:27 normalization > 03:39:13.906058 [debug] [MainThread]: Parsing macros/cross_db_utils/any_value.sql 2022-04-07 03:39:27 normalization > 03:39:13.907725 [debug] [MainThread]: Parsing macros/cross_db_utils/bool_or.sql 2022-04-07 03:39:27 normalization > 03:39:13.909864 [debug] [MainThread]: Parsing macros/cross_db_utils/dateadd.sql 2022-04-07 03:39:27 normalization > 03:39:13.914038 [debug] [MainThread]: Parsing macros/cross_db_utils/safe_cast.sql 2022-04-07 03:39:27 normalization > 03:39:13.916679 [debug] [MainThread]: Parsing macros/cross_db_utils/last_day.sql 2022-04-07 03:39:27 normalization > 03:39:13.921825 [debug] [MainThread]: Parsing macros/cross_db_utils/length.sql 2022-04-07 03:39:27 normalization > 03:39:13.923571 [debug] [MainThread]: Parsing macros/cross_db_utils/identifier.sql 2022-04-07 03:39:27 normalization > 03:39:13.925862 [debug] [MainThread]: Parsing macros/cross_db_utils/concat.sql 2022-04-07 03:39:27 normalization > 03:39:13.927132 [debug] [MainThread]: Parsing macros/cross_db_utils/datatypes.sql 2022-04-07 03:39:27 normalization > 03:39:13.935473 [debug] [MainThread]: Parsing macros/cross_db_utils/current_timestamp.sql 2022-04-07 03:39:27 normalization > 03:39:13.941882 [debug] [MainThread]: Parsing macros/cross_db_utils/right.sql 2022-04-07 03:39:27 normalization > 03:39:13.946445 [debug] [MainThread]: Parsing macros/cross_db_utils/escape_single_quotes.sql 2022-04-07 03:39:27 normalization > 03:39:13.950623 [debug] [MainThread]: Parsing macros/cross_db_utils/_is_relation.sql 2022-04-07 03:39:27 normalization > 03:39:13.952768 [debug] [MainThread]: Parsing macros/cross_db_utils/position.sql 2022-04-07 03:39:27 normalization > 03:39:13.955908 [debug] [MainThread]: Parsing macros/cross_db_utils/replace.sql 2022-04-07 03:39:27 normalization > 03:39:13.958647 [debug] [MainThread]: Parsing macros/cross_db_utils/cast_bool_to_text.sql 2022-04-07 03:39:27 normalization > 03:39:13.961372 [debug] [MainThread]: Parsing macros/cross_db_utils/intersect.sql 2022-04-07 03:39:27 normalization > 03:39:13.964276 [debug] [MainThread]: Parsing macros/cross_db_utils/width_bucket.sql 2022-04-07 03:39:27 normalization > 03:39:13.977374 [debug] [MainThread]: Parsing macros/cross_db_utils/except.sql 2022-04-07 03:39:27 normalization > 03:39:13.979880 [debug] [MainThread]: Parsing macros/cross_db_utils/hash.sql 2022-04-07 03:39:27 normalization > 03:39:13.982044 [debug] [MainThread]: Parsing macros/web/get_url_host.sql 2022-04-07 03:39:27 normalization > 03:39:13.985229 [debug] [MainThread]: Parsing macros/web/get_url_path.sql 2022-04-07 03:39:27 normalization > 03:39:13.990071 [debug] [MainThread]: Parsing macros/web/get_url_parameter.sql 2022-04-07 03:39:27 normalization > 03:39:13.995257 [debug] [MainThread]: Parsing macros/sql/star.sql 2022-04-07 03:39:27 normalization > 03:39:14.007303 [debug] [MainThread]: Parsing macros/sql/safe_add.sql 2022-04-07 03:39:27 normalization > 03:39:14.009873 [debug] [MainThread]: Parsing macros/sql/pivot.sql 2022-04-07 03:39:27 normalization > 03:39:14.017079 [debug] [MainThread]: Parsing macros/sql/nullcheck_table.sql 2022-04-07 03:39:27 normalization > 03:39:14.020207 [debug] [MainThread]: Parsing macros/sql/unpivot.sql 2022-04-07 03:39:27 normalization > 03:39:14.036226 [debug] [MainThread]: Parsing macros/sql/union.sql 2022-04-07 03:39:27 normalization > 03:39:14.060676 [debug] [MainThread]: Parsing macros/sql/nullcheck.sql 2022-04-07 03:39:27 normalization > 03:39:14.064421 [debug] [MainThread]: Parsing macros/sql/haversine_distance.sql 2022-04-07 03:39:27 normalization > 03:39:14.074357 [debug] [MainThread]: Parsing macros/sql/generate_series.sql 2022-04-07 03:39:27 normalization > 03:39:14.081318 [debug] [MainThread]: Parsing macros/sql/get_relations_by_pattern.sql 2022-04-07 03:39:27 normalization > 03:39:14.086641 [debug] [MainThread]: Parsing macros/sql/surrogate_key.sql 2022-04-07 03:39:27 normalization > 03:39:14.091878 [debug] [MainThread]: Parsing macros/sql/date_spine.sql 2022-04-07 03:39:27 normalization > 03:39:14.098611 [debug] [MainThread]: Parsing macros/sql/get_tables_by_pattern_sql.sql 2022-04-07 03:39:27 normalization > 03:39:14.109217 [debug] [MainThread]: Parsing macros/sql/get_column_values.sql 2022-04-07 03:39:27 normalization > 03:39:14.118112 [debug] [MainThread]: Parsing macros/sql/groupby.sql 2022-04-07 03:39:27 normalization > 03:39:14.120163 [debug] [MainThread]: Parsing macros/sql/get_tables_by_prefix_sql.sql 2022-04-07 03:39:27 normalization > 03:39:14.122617 [debug] [MainThread]: Parsing macros/sql/get_query_results_as_dict.sql 2022-04-07 03:39:27 normalization > 03:39:14.126118 [debug] [MainThread]: Parsing macros/sql/get_table_types_sql.sql 2022-04-07 03:39:27 normalization > 03:39:14.128749 [debug] [MainThread]: Parsing macros/sql/get_relations_by_prefix.sql 2022-04-07 03:39:27 normalization > 03:39:14.134685 [debug] [MainThread]: Parsing macros/jinja_helpers/pretty_log_format.sql 2022-04-07 03:39:27 normalization > 03:39:14.136344 [debug] [MainThread]: Parsing macros/jinja_helpers/pretty_time.sql 2022-04-07 03:39:27 normalization > 03:39:14.138109 [debug] [MainThread]: Parsing macros/jinja_helpers/slugify.sql 2022-04-07 03:39:27 normalization > 03:39:14.139722 [debug] [MainThread]: Parsing macros/jinja_helpers/log_info.sql 2022-04-07 03:39:27 normalization > 03:39:14.141217 [debug] [MainThread]: Parsing macros/materializations/insert_by_period_materialization.sql 2022-04-07 03:39:27 normalization > 03:39:14.182132 [debug] [MainThread]: Parsing macros/schema_tests/expression_is_true.sql 2022-04-07 03:39:27 normalization > 03:39:14.184792 [debug] [MainThread]: Parsing macros/schema_tests/not_accepted_values.sql 2022-04-07 03:39:27 normalization > 03:39:14.187864 [debug] [MainThread]: Parsing macros/schema_tests/cardinality_equality.sql 2022-04-07 03:39:27 normalization > 03:39:14.190820 [debug] [MainThread]: Parsing macros/schema_tests/test_not_null_where.sql 2022-04-07 03:39:27 normalization > 03:39:14.192746 [debug] [MainThread]: Parsing macros/schema_tests/sequential_values.sql 2022-04-07 03:39:27 normalization > 03:39:14.197029 [debug] [MainThread]: Parsing macros/schema_tests/not_null_proportion.sql 2022-04-07 03:39:27 normalization > 03:39:14.200188 [debug] [MainThread]: Parsing macros/schema_tests/recency.sql 2022-04-07 03:39:27 normalization > 03:39:14.202646 [debug] [MainThread]: Parsing macros/schema_tests/accepted_range.sql 2022-04-07 03:39:27 normalization > 03:39:14.206336 [debug] [MainThread]: Parsing macros/schema_tests/mutually_exclusive_ranges.sql 2022-04-07 03:39:27 normalization > 03:39:14.222956 [debug] [MainThread]: Parsing macros/schema_tests/equality.sql 2022-04-07 03:39:27 normalization > 03:39:14.228842 [debug] [MainThread]: Parsing macros/schema_tests/relationships_where.sql 2022-04-07 03:39:27 normalization > 03:39:14.232353 [debug] [MainThread]: Parsing macros/schema_tests/not_constant.sql 2022-04-07 03:39:27 normalization > 03:39:14.234073 [debug] [MainThread]: Parsing macros/schema_tests/at_least_one.sql 2022-04-07 03:39:27 normalization > 03:39:14.235808 [debug] [MainThread]: Parsing macros/schema_tests/test_unique_where.sql 2022-04-07 03:39:27 normalization > 03:39:14.237854 [debug] [MainThread]: Parsing macros/schema_tests/unique_combination_of_columns.sql 2022-04-07 03:39:27 normalization > 03:39:14.242165 [debug] [MainThread]: Parsing macros/schema_tests/fewer_rows_than.sql 2022-04-07 03:39:27 normalization > 03:39:14.244757 [debug] [MainThread]: Parsing macros/schema_tests/equal_rowcount.sql 2022-04-07 03:39:27 normalization > 03:39:14.855252 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_new/kl_campaigns_excluded_lists_ab3.sql 2022-04-07 03:39:27 normalization > 03:39:14.907432 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_new/kl_campaigns_excluded_lists_ab3.sql 2022-04-07 03:39:27 normalization > 03:39:14.909174 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_new/kl_metrics_integration_ab3.sql 2022-04-07 03:39:27 normalization > 03:39:14.918954 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_new/kl_metrics_integration_ab3.sql 2022-04-07 03:39:27 normalization > 03:39:14.920514 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_new/kl_campaigns_lists_ab2.sql 2022-04-07 03:39:27 normalization > 03:39:14.941501 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_new/kl_campaigns_lists_ab2.sql 2022-04-07 03:39:27 normalization > 03:39:14.944695 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_new/kl_events_ab1.sql 2022-04-07 03:39:27 normalization > 03:39:14.973088 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_new/kl_events_ab1.sql 2022-04-07 03:39:27 normalization > 03:39:14.974967 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_new/kl_lists_ab3.sql 2022-04-07 03:39:27 normalization > 03:39:14.986701 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_new/kl_lists_ab3.sql 2022-04-07 03:39:27 normalization > 03:39:14.988465 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_new/kl_campaigns_ab2.sql 2022-04-07 03:39:27 normalization > 03:39:15.041346 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_new/kl_campaigns_ab2.sql 2022-04-07 03:39:27 normalization > 03:39:15.044190 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_new/kl_campaigns_ab1.sql 2022-04-07 03:39:27 normalization > 03:39:15.073893 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_new/kl_campaigns_ab1.sql 2022-04-07 03:39:27 normalization > 03:39:15.075494 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_new/kl_lists_ab2.sql 2022-04-07 03:39:27 normalization > 03:39:15.087553 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_new/kl_lists_ab2.sql 2022-04-07 03:39:27 normalization > 03:39:15.089635 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_new/kl_metrics_integration_ab1.sql 2022-04-07 03:39:27 normalization > 03:39:15.101624 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_new/kl_metrics_integration_ab1.sql 2022-04-07 03:39:27 normalization > 03:39:15.103141 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_new/kl_events_ab3.sql 2022-04-07 03:39:27 normalization > 03:39:15.113878 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_new/kl_events_ab3.sql 2022-04-07 03:39:27 normalization > 03:39:15.115356 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_new/kl_metrics_ab3.sql 2022-04-07 03:39:27 normalization > 03:39:15.125488 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_new/kl_metrics_ab3.sql 2022-04-07 03:39:27 normalization > 03:39:15.127017 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_new/kl_campaigns_lists_ab3.sql 2022-04-07 03:39:27 normalization > 03:39:15.137555 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_new/kl_campaigns_lists_ab3.sql 2022-04-07 03:39:27 normalization > 03:39:15.139115 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_new/kl_campaigns_excluded_lists_ab2.sql 2022-04-07 03:39:27 normalization > 03:39:15.151453 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_new/kl_campaigns_excluded_lists_ab2.sql 2022-04-07 03:39:27 normalization > 03:39:15.153033 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_new/kl_global_exclusions_ab2.sql 2022-04-07 03:39:27 normalization > 03:39:15.164164 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_new/kl_global_exclusions_ab2.sql 2022-04-07 03:39:27 normalization > 03:39:15.166275 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_new/kl_lists_ab1.sql 2022-04-07 03:39:27 normalization > 03:39:15.181869 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_new/kl_lists_ab1.sql 2022-04-07 03:39:27 normalization > 03:39:15.184387 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_new/kl_campaigns_lists_ab1.sql 2022-04-07 03:39:27 normalization > 03:39:15.211165 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_new/kl_campaigns_lists_ab1.sql 2022-04-07 03:39:27 normalization > 03:39:15.212759 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_new/kl_metrics_ab2.sql 2022-04-07 03:39:27 normalization > 03:39:15.226383 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_new/kl_metrics_ab2.sql 2022-04-07 03:39:27 normalization > 03:39:15.228411 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_new/kl_global_exclusions_ab1.sql 2022-04-07 03:39:27 normalization > 03:39:15.240338 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_new/kl_global_exclusions_ab1.sql 2022-04-07 03:39:27 normalization > 03:39:15.241868 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_new/kl_global_exclusions_ab3.sql 2022-04-07 03:39:27 normalization > 03:39:15.253435 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_new/kl_global_exclusions_ab3.sql 2022-04-07 03:39:27 normalization > 03:39:15.255743 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_new/kl_campaigns_excluded_lists_ab1.sql 2022-04-07 03:39:27 normalization > 03:39:15.278393 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_new/kl_campaigns_excluded_lists_ab1.sql 2022-04-07 03:39:27 normalization > 03:39:15.280839 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_new/kl_metrics_integration_ab2.sql 2022-04-07 03:39:27 normalization > 03:39:15.295442 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_new/kl_metrics_integration_ab2.sql 2022-04-07 03:39:27 normalization > 03:39:15.298223 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_new/kl_metrics_ab1.sql 2022-04-07 03:39:27 normalization > 03:39:15.315524 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_new/kl_metrics_ab1.sql 2022-04-07 03:39:27 normalization > 03:39:15.317121 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_new/kl_events_ab2.sql 2022-04-07 03:39:27 normalization > 03:39:15.330315 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_new/kl_events_ab2.sql 2022-04-07 03:39:27 normalization > 03:39:15.331868 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/airbyte_new/kl_campaigns_ab3.sql 2022-04-07 03:39:27 normalization > 03:39:15.351079 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/airbyte_new/kl_campaigns_ab3.sql 2022-04-07 03:39:27 normalization > 03:39:15.353030 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_new/kl_lists.sql 2022-04-07 03:39:27 normalization > 03:39:15.361520 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_new/kl_lists.sql 2022-04-07 03:39:27 normalization > 03:39:15.363460 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_new/kl_global_exclusions.sql 2022-04-07 03:39:27 normalization > 03:39:15.372060 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_new/kl_global_exclusions.sql 2022-04-07 03:39:27 normalization > 03:39:15.374155 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_new/kl_campaigns_lists.sql 2022-04-07 03:39:27 normalization > 03:39:15.383560 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_new/kl_campaigns_lists.sql 2022-04-07 03:39:27 normalization > 03:39:15.385744 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_new/kl_campaigns_excluded_lists.sql 2022-04-07 03:39:27 normalization > 03:39:15.395705 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_new/kl_campaigns_excluded_lists.sql 2022-04-07 03:39:27 normalization > 03:39:15.397606 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_new/kl_metrics.sql 2022-04-07 03:39:27 normalization > 03:39:15.406296 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_new/kl_metrics.sql 2022-04-07 03:39:27 normalization > 03:39:15.408448 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_new/kl_campaigns.sql 2022-04-07 03:39:27 normalization > 03:39:15.417126 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_new/kl_campaigns.sql 2022-04-07 03:39:27 normalization > 03:39:15.419053 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_new/kl_metrics_integration.sql 2022-04-07 03:39:27 normalization > 03:39:15.427113 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_new/kl_metrics_integration.sql 2022-04-07 03:39:27 normalization > 03:39:15.429194 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/airbyte_new/kl_events.sql 2022-04-07 03:39:27 normalization > 03:39:15.437619 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/airbyte_new/kl_events.sql 2022-04-07 03:39:27 normalization > 03:39:15.534311 [warn ] [MainThread]: [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. 2022-04-07 03:39:27 normalization > There are 2 unused configuration paths: 2022-04-07 03:39:27 normalization > - models.airbyte_utils.generated.airbyte_tables 2022-04-07 03:39:27 normalization > - models.airbyte_utils.generated.airbyte_views 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > 03:39:15.560268 [info ] [MainThread]: Found 32 models, 0 tests, 0 snapshots, 0 analyses, 537 macros, 0 operations, 0 seed files, 5 sources, 0 exposures, 0 metrics 2022-04-07 03:39:27 normalization > 03:39:15.563710 [info ] [MainThread]: 2022-04-07 03:39:27 normalization > 03:39:15.564280 [debug] [MainThread]: Acquiring new bigquery connection "master" 2022-04-07 03:39:27 normalization > 03:39:15.565961 [debug] [ThreadPool]: Acquiring new bigquery connection "list_nhg-dw" 2022-04-07 03:39:27 normalization > 03:39:15.566354 [debug] [ThreadPool]: Opening a new connection, currently in state init 2022-04-07 03:39:27 normalization > 03:39:17.293477 [debug] [ThreadPool]: Acquiring new bigquery connection "list_nhg-dw_airbyte_new" 2022-04-07 03:39:27 normalization > 03:39:17.293832 [debug] [ThreadPool]: Opening a new connection, currently in state closed 2022-04-07 03:39:27 normalization > 03:39:18.005625 [info ] [MainThread]: Concurrency: 8 threads (target='prod') 2022-04-07 03:39:27 normalization > 03:39:18.006004 [info ] [MainThread]: 2022-04-07 03:39:27 normalization > 03:39:18.030255 [debug] [Thread-1 ]: Began running node model.airbyte_utils.kl_campaigns_ab1 2022-04-07 03:39:27 normalization > 03:39:18.030742 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.kl_campaigns_ab1" 2022-04-07 03:39:27 normalization > 03:39:18.030963 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.kl_campaigns_ab1 2022-04-07 03:39:27 normalization > 03:39:18.031161 [debug] [Thread-1 ]: Compiling model.airbyte_utils.kl_campaigns_ab1 2022-04-07 03:39:27 normalization > 03:39:18.031358 [debug] [Thread-2 ]: Began running node model.airbyte_utils.kl_events_ab1 2022-04-07 03:39:27 normalization > 03:39:18.036857 [debug] [Thread-3 ]: Began running node model.airbyte_utils.kl_global_exclusions_ab1 2022-04-07 03:39:27 normalization > 03:39:18.037482 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.kl_events_ab1" 2022-04-07 03:39:27 normalization > 03:39:18.047792 [debug] [Thread-4 ]: Began running node model.airbyte_utils.kl_lists_ab1 2022-04-07 03:39:27 normalization > 03:39:18.048433 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.kl_global_exclusions_ab1" 2022-04-07 03:39:27 normalization > 03:39:18.048651 [debug] [Thread-5 ]: Began running node model.airbyte_utils.kl_metrics_ab1 2022-04-07 03:39:27 normalization > 03:39:18.049097 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.kl_events_ab1 2022-04-07 03:39:27 normalization > 03:39:18.057761 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.kl_lists_ab1" 2022-04-07 03:39:27 normalization > 03:39:18.058307 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.kl_global_exclusions_ab1 2022-04-07 03:39:27 normalization > 03:39:18.059162 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.kl_metrics_ab1" 2022-04-07 03:39:27 normalization > 03:39:18.059529 [debug] [Thread-2 ]: Compiling model.airbyte_utils.kl_events_ab1 2022-04-07 03:39:27 normalization > 03:39:18.068640 [debug] [Thread-1 ]: On "model.airbyte_utils.kl_campaigns_ab1": cache miss for schema "{self.database}.{self.schema}", this is inefficient 2022-04-07 03:39:27 normalization > 03:39:18.068955 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.kl_lists_ab1 2022-04-07 03:39:27 normalization > 03:39:18.069247 [debug] [Thread-3 ]: Compiling model.airbyte_utils.kl_global_exclusions_ab1 2022-04-07 03:39:27 normalization > 03:39:18.069430 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.kl_metrics_ab1 2022-04-07 03:39:27 normalization > 03:39:18.080461 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-04-07 03:39:27 normalization > 03:39:18.086957 [debug] [Thread-2 ]: On "model.airbyte_utils.kl_events_ab1": cache miss for schema "{self.database}.{self.schema}", this is inefficient 2022-04-07 03:39:27 normalization > 03:39:18.087236 [debug] [Thread-4 ]: Compiling model.airbyte_utils.kl_lists_ab1 2022-04-07 03:39:27 normalization > 03:39:18.092846 [debug] [Thread-5 ]: Compiling model.airbyte_utils.kl_metrics_ab1 2022-04-07 03:39:27 normalization > 03:39:18.101278 [debug] [Thread-3 ]: On "model.airbyte_utils.kl_global_exclusions_ab1": cache miss for schema "{self.database}.{self.schema}", this is inefficient 2022-04-07 03:39:27 normalization > 03:39:18.101769 [debug] [Thread-2 ]: Opening a new connection, currently in state init 2022-04-07 03:39:27 normalization > 03:39:18.121972 [debug] [Thread-4 ]: On "model.airbyte_utils.kl_lists_ab1": cache miss for schema "{self.database}.{self.schema}", this is inefficient 2022-04-07 03:39:27 normalization > 03:39:18.128522 [debug] [Thread-3 ]: Opening a new connection, currently in state init 2022-04-07 03:39:27 normalization > 03:39:18.137886 [debug] [Thread-5 ]: On "model.airbyte_utils.kl_metrics_ab1": cache miss for schema "{self.database}.{self.schema}", this is inefficient 2022-04-07 03:39:27 normalization > 03:39:18.138586 [debug] [Thread-4 ]: Opening a new connection, currently in state init 2022-04-07 03:39:27 normalization > 03:39:18.139133 [debug] [Thread-5 ]: Opening a new connection, currently in state init 2022-04-07 03:39:27 normalization > 03:39:19.023500 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.kl_lists_ab1" 2022-04-07 03:39:27 normalization > 03:39:19.024190 [debug] [Thread-4 ]: finished collecting timing info 2022-04-07 03:39:27 normalization > 03:39:19.024667 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.kl_lists_ab1 2022-04-07 03:39:27 normalization > 03:39:19.025877 [debug] [Thread-7 ]: Began running node model.airbyte_utils.kl_lists_ab2 2022-04-07 03:39:27 normalization > 03:39:19.026257 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.kl_lists_ab2" 2022-04-07 03:39:27 normalization > 03:39:19.026465 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.kl_lists_ab2 2022-04-07 03:39:27 normalization > 03:39:19.026634 [debug] [Thread-7 ]: Compiling model.airbyte_utils.kl_lists_ab2 2022-04-07 03:39:27 normalization > 03:39:19.032377 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.kl_global_exclusions_ab1" 2022-04-07 03:39:27 normalization > 03:39:19.040606 [debug] [Thread-7 ]: On "model.airbyte_utils.kl_lists_ab2": cache miss for schema "{self.database}.{self.schema}", this is inefficient 2022-04-07 03:39:27 normalization > 03:39:19.043820 [debug] [Thread-7 ]: Opening a new connection, currently in state init 2022-04-07 03:39:27 normalization > 03:39:19.044271 [debug] [Thread-3 ]: finished collecting timing info 2022-04-07 03:39:27 normalization > 03:39:19.047359 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.kl_events_ab1" 2022-04-07 03:39:27 normalization > 03:39:19.048379 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.kl_global_exclusions_ab1 2022-04-07 03:39:27 normalization > 03:39:19.049095 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.kl_campaigns_ab1" 2022-04-07 03:39:27 normalization > 03:39:19.050586 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.kl_metrics_ab1" 2022-04-07 03:39:27 normalization > 03:39:19.051334 [debug] [Thread-2 ]: finished collecting timing info 2022-04-07 03:39:27 normalization > 03:39:19.052798 [debug] [Thread-1 ]: finished collecting timing info 2022-04-07 03:39:27 normalization > 03:39:19.053012 [debug] [Thread-6 ]: Began running node model.airbyte_utils.kl_global_exclusions_ab2 2022-04-07 03:39:27 normalization > 03:39:19.053312 [debug] [Thread-5 ]: finished collecting timing info 2022-04-07 03:39:27 normalization > 03:39:19.053845 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.kl_events_ab1 2022-04-07 03:39:27 normalization > 03:39:19.054307 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.kl_campaigns_ab1 2022-04-07 03:39:27 normalization > 03:39:19.054749 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.kl_global_exclusions_ab2" 2022-04-07 03:39:27 normalization > 03:39:19.055253 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.kl_metrics_ab1 2022-04-07 03:39:27 normalization > 03:39:19.057179 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.kl_global_exclusions_ab2 2022-04-07 03:39:27 normalization > 03:39:19.058254 [debug] [Thread-8 ]: Began running node model.airbyte_utils.kl_campaigns_ab2 2022-04-07 03:39:27 normalization > 03:39:19.060709 [debug] [Thread-3 ]: Began running node model.airbyte_utils.kl_events_ab2 2022-04-07 03:39:27 normalization > 03:39:19.061263 [debug] [Thread-6 ]: Compiling model.airbyte_utils.kl_global_exclusions_ab2 2022-04-07 03:39:27 normalization > 03:39:19.062678 [debug] [Thread-2 ]: Began running node model.airbyte_utils.kl_metrics_ab2 2022-04-07 03:39:27 normalization > 03:39:19.063710 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.kl_campaigns_ab2" 2022-04-07 03:39:27 normalization > 03:39:19.064574 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.kl_events_ab2" 2022-04-07 03:39:27 normalization > 03:39:19.076104 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.kl_metrics_ab2" 2022-04-07 03:39:27 normalization > 03:39:19.078098 [debug] [Thread-6 ]: On "model.airbyte_utils.kl_global_exclusions_ab2": cache miss for schema "{self.database}.{self.schema}", this is inefficient 2022-04-07 03:39:27 normalization > 03:39:19.078426 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.kl_campaigns_ab2 2022-04-07 03:39:27 normalization > 03:39:19.078669 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.kl_events_ab2 2022-04-07 03:39:27 normalization > 03:39:19.078927 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.kl_metrics_ab2 2022-04-07 03:39:27 normalization > 03:39:19.079214 [debug] [Thread-6 ]: Opening a new connection, currently in state init 2022-04-07 03:39:27 normalization > 03:39:19.079470 [debug] [Thread-8 ]: Compiling model.airbyte_utils.kl_campaigns_ab2 2022-04-07 03:39:27 normalization > 03:39:19.079725 [debug] [Thread-3 ]: Compiling model.airbyte_utils.kl_events_ab2 2022-04-07 03:39:27 normalization > 03:39:19.079938 [debug] [Thread-2 ]: Compiling model.airbyte_utils.kl_metrics_ab2 2022-04-07 03:39:27 normalization > 03:39:19.101599 [debug] [Thread-8 ]: On "model.airbyte_utils.kl_campaigns_ab2": cache miss for schema "{self.database}.{self.schema}", this is inefficient 2022-04-07 03:39:27 normalization > 03:39:19.115150 [debug] [Thread-3 ]: On "model.airbyte_utils.kl_events_ab2": cache miss for schema "{self.database}.{self.schema}", this is inefficient 2022-04-07 03:39:27 normalization > 03:39:19.131518 [debug] [Thread-2 ]: On "model.airbyte_utils.kl_metrics_ab2": cache miss for schema "{self.database}.{self.schema}", this is inefficient 2022-04-07 03:39:27 normalization > 03:39:19.133241 [debug] [Thread-8 ]: Opening a new connection, currently in state init 2022-04-07 03:39:27 normalization > 03:39:19.133575 [debug] [Thread-3 ]: Opening a new connection, currently in state closed 2022-04-07 03:39:27 normalization > 03:39:19.133858 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-04-07 03:39:27 normalization > 03:39:19.885448 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.kl_lists_ab2" 2022-04-07 03:39:27 normalization > 03:39:19.906737 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.kl_global_exclusions_ab2" 2022-04-07 03:39:27 normalization > 03:39:19.907044 [debug] [Thread-7 ]: finished collecting timing info 2022-04-07 03:39:27 normalization > 03:39:19.939090 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.kl_events_ab2" 2022-04-07 03:39:27 normalization > 03:39:19.943875 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.kl_campaigns_ab2" 2022-04-07 03:39:27 normalization > 03:39:19.944471 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.kl_lists_ab2 2022-04-07 03:39:27 normalization > 03:39:19.945079 [debug] [Thread-6 ]: finished collecting timing info 2022-04-07 03:39:27 normalization > 03:39:19.946415 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.kl_global_exclusions_ab2 2022-04-07 03:39:27 normalization > 03:39:19.947568 [debug] [Thread-8 ]: finished collecting timing info 2022-04-07 03:39:27 normalization > 03:39:19.948164 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.kl_campaigns_ab2 2022-04-07 03:39:27 normalization > 03:39:19.948360 [debug] [Thread-3 ]: finished collecting timing info 2022-04-07 03:39:27 normalization > 03:39:19.954035 [debug] [Thread-5 ]: Began running node model.airbyte_utils.kl_global_exclusions_ab3 2022-04-07 03:39:27 normalization > 03:39:19.954351 [debug] [Thread-8 ]: Began running node model.airbyte_utils.kl_lists_ab3 2022-04-07 03:39:27 normalization > 03:39:19.961193 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.kl_metrics_ab2" 2022-04-07 03:39:27 normalization > 03:39:19.961858 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.kl_events_ab2 2022-04-07 03:39:27 normalization > 03:39:19.962552 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.kl_global_exclusions_ab3" 2022-04-07 03:39:27 normalization > 03:39:19.962847 [debug] [Thread-1 ]: Began running node model.airbyte_utils.kl_campaigns_ab3 2022-04-07 03:39:27 normalization > 03:39:19.963274 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.kl_lists_ab3" 2022-04-07 03:39:27 normalization > 03:39:19.964267 [debug] [Thread-6 ]: Began running node model.airbyte_utils.kl_events_ab3 2022-04-07 03:39:27 normalization > 03:39:19.964480 [debug] [Thread-2 ]: finished collecting timing info 2022-04-07 03:39:27 normalization > 03:39:19.964806 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.kl_global_exclusions_ab3 2022-04-07 03:39:27 normalization > 03:39:19.965237 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.kl_campaigns_ab3" 2022-04-07 03:39:27 normalization > 03:39:19.965469 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.kl_lists_ab3 2022-04-07 03:39:27 normalization > 03:39:19.965862 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.kl_events_ab3" 2022-04-07 03:39:27 normalization > 03:39:19.966311 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.kl_metrics_ab2 2022-04-07 03:39:27 normalization > 03:39:19.966558 [debug] [Thread-5 ]: Compiling model.airbyte_utils.kl_global_exclusions_ab3 2022-04-07 03:39:27 normalization > 03:39:19.966794 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.kl_campaigns_ab3 2022-04-07 03:39:27 normalization > 03:39:19.967036 [debug] [Thread-8 ]: Compiling model.airbyte_utils.kl_lists_ab3 2022-04-07 03:39:27 normalization > 03:39:19.967250 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.kl_events_ab3 2022-04-07 03:39:27 normalization > 03:39:19.973193 [debug] [Thread-1 ]: Compiling model.airbyte_utils.kl_campaigns_ab3 2022-04-07 03:39:27 normalization > 03:39:19.973735 [debug] [Thread-7 ]: Began running node model.airbyte_utils.kl_metrics_ab3 2022-04-07 03:39:27 normalization > 03:39:19.982824 [debug] [Thread-5 ]: On "model.airbyte_utils.kl_global_exclusions_ab3": cache miss for schema "{self.database}.{self.schema}", this is inefficient 2022-04-07 03:39:27 normalization > 03:39:19.983078 [debug] [Thread-6 ]: Compiling model.airbyte_utils.kl_events_ab3 2022-04-07 03:39:27 normalization > 03:39:19.987209 [debug] [Thread-8 ]: On "model.airbyte_utils.kl_lists_ab3": cache miss for schema "{self.database}.{self.schema}", this is inefficient 2022-04-07 03:39:27 normalization > 03:39:19.990820 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.kl_metrics_ab3" 2022-04-07 03:39:27 normalization > 03:39:19.991107 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-04-07 03:39:27 normalization > 03:39:20.006667 [debug] [Thread-1 ]: On "model.airbyte_utils.kl_campaigns_ab3": cache miss for schema "{self.database}.{self.schema}", this is inefficient 2022-04-07 03:39:27 normalization > 03:39:20.017301 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-04-07 03:39:27 normalization > 03:39:20.018012 [debug] [Thread-6 ]: On "model.airbyte_utils.kl_events_ab3": cache miss for schema "{self.database}.{self.schema}", this is inefficient 2022-04-07 03:39:27 normalization > 03:39:20.018291 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.kl_metrics_ab3 2022-04-07 03:39:27 normalization > 03:39:20.018677 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-04-07 03:39:27 normalization > 03:39:20.019341 [debug] [Thread-6 ]: Opening a new connection, currently in state closed 2022-04-07 03:39:27 normalization > 03:39:20.019587 [debug] [Thread-7 ]: Compiling model.airbyte_utils.kl_metrics_ab3 2022-04-07 03:39:27 normalization > 03:39:20.030978 [debug] [Thread-7 ]: On "model.airbyte_utils.kl_metrics_ab3": cache miss for schema "{self.database}.{self.schema}", this is inefficient 2022-04-07 03:39:27 normalization > 03:39:20.033324 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-04-07 03:39:27 normalization > 03:39:20.975173 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.kl_events_ab3" 2022-04-07 03:39:27 normalization > 03:39:20.983440 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.kl_lists_ab3" 2022-04-07 03:39:27 normalization > 03:39:21.019541 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.kl_metrics_ab3" 2022-04-07 03:39:27 normalization > 03:39:21.020737 [debug] [Thread-7 ]: finished collecting timing info 2022-04-07 03:39:27 normalization > 03:39:21.026277 [debug] [Thread-8 ]: finished collecting timing info 2022-04-07 03:39:27 normalization > 03:39:21.026857 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.kl_metrics_ab3 2022-04-07 03:39:27 normalization > 03:39:21.027628 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.kl_global_exclusions_ab3" 2022-04-07 03:39:27 normalization > 03:39:21.029206 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.kl_campaigns_ab3" 2022-04-07 03:39:27 normalization > 03:39:21.029432 [debug] [Thread-6 ]: finished collecting timing info 2022-04-07 03:39:27 normalization > 03:39:21.029912 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.kl_lists_ab3 2022-04-07 03:39:27 normalization > 03:39:21.030729 [debug] [Thread-4 ]: Began running node model.airbyte_utils.kl_metrics 2022-04-07 03:39:27 normalization > 03:39:21.031642 [debug] [Thread-1 ]: finished collecting timing info 2022-04-07 03:39:27 normalization > 03:39:21.031826 [debug] [Thread-5 ]: finished collecting timing info 2022-04-07 03:39:27 normalization > 03:39:21.032227 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.kl_events_ab3 2022-04-07 03:39:27 normalization > 03:39:21.032689 [info ] [Thread-4 ]: 1 of 8 START incremental model airbyte_new.kl_metrics................................................................... [RUN] 2022-04-07 03:39:27 normalization > 03:39:21.033420 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.kl_campaigns_ab3 2022-04-07 03:39:27 normalization > 03:39:21.033618 [debug] [Thread-3 ]: Began running node model.airbyte_utils.kl_lists 2022-04-07 03:39:27 normalization > 03:39:21.034057 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.kl_global_exclusions_ab3 2022-04-07 03:39:27 normalization > 03:39:21.034745 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.kl_metrics" 2022-04-07 03:39:27 normalization > 03:39:21.035291 [info ] [Thread-3 ]: 2 of 8 START incremental model airbyte_new.kl_lists..................................................................... [RUN] 2022-04-07 03:39:27 normalization > 03:39:21.036283 [debug] [Thread-2 ]: Began running node model.airbyte_utils.kl_campaigns 2022-04-07 03:39:27 normalization > 03:39:21.036639 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.kl_metrics 2022-04-07 03:39:27 normalization > 03:39:21.037068 [debug] [Thread-8 ]: Began running node model.airbyte_utils.kl_events 2022-04-07 03:39:27 normalization > 03:39:21.037362 [debug] [Thread-7 ]: Began running node model.airbyte_utils.kl_global_exclusions 2022-04-07 03:39:27 normalization > 03:39:21.038170 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.kl_lists" 2022-04-07 03:39:27 normalization > 03:39:21.038560 [info ] [Thread-2 ]: 3 of 8 START incremental model airbyte_new.kl_campaigns................................................................. [RUN] 2022-04-07 03:39:27 normalization > 03:39:21.038834 [debug] [Thread-4 ]: Compiling model.airbyte_utils.kl_metrics 2022-04-07 03:39:27 normalization > 03:39:21.039191 [info ] [Thread-8 ]: 4 of 8 START incremental model airbyte_new.kl_events.................................................................... [RUN] 2022-04-07 03:39:27 normalization > 03:39:21.039594 [info ] [Thread-7 ]: 5 of 8 START incremental model airbyte_new.kl_global_exclusions......................................................... [RUN] 2022-04-07 03:39:27 normalization > 03:39:21.039844 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.kl_lists 2022-04-07 03:39:27 normalization > 03:39:21.040540 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.kl_campaigns" 2022-04-07 03:39:27 normalization > 03:39:21.046721 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.kl_events" 2022-04-07 03:39:27 normalization > 03:39:21.047365 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.kl_global_exclusions" 2022-04-07 03:39:27 normalization > 03:39:21.052890 [debug] [Thread-3 ]: Compiling model.airbyte_utils.kl_lists 2022-04-07 03:39:27 normalization > 03:39:21.058026 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.kl_metrics" 2022-04-07 03:39:27 normalization > 03:39:21.058317 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.kl_campaigns 2022-04-07 03:39:27 normalization > 03:39:21.058547 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.kl_events 2022-04-07 03:39:27 normalization > 03:39:21.058840 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.kl_global_exclusions 2022-04-07 03:39:27 normalization > 03:39:21.073243 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.kl_lists" 2022-04-07 03:39:27 normalization > 03:39:21.073663 [debug] [Thread-2 ]: Compiling model.airbyte_utils.kl_campaigns 2022-04-07 03:39:27 normalization > 03:39:21.074005 [debug] [Thread-8 ]: Compiling model.airbyte_utils.kl_events 2022-04-07 03:39:27 normalization > 03:39:21.074373 [debug] [Thread-7 ]: Compiling model.airbyte_utils.kl_global_exclusions 2022-04-07 03:39:27 normalization > 03:39:21.074562 [debug] [Thread-4 ]: finished collecting timing info 2022-04-07 03:39:27 normalization > 03:39:21.074918 [debug] [Thread-3 ]: finished collecting timing info 2022-04-07 03:39:27 normalization > 03:39:21.101433 [debug] [Thread-4 ]: Began executing node model.airbyte_utils.kl_metrics 2022-04-07 03:39:27 normalization > 03:39:21.110299 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.kl_events" 2022-04-07 03:39:27 normalization > 03:39:21.113562 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.kl_campaigns" 2022-04-07 03:39:27 normalization > 03:39:21.120358 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.kl_global_exclusions" 2022-04-07 03:39:27 normalization > 03:39:21.120658 [debug] [Thread-3 ]: Began executing node model.airbyte_utils.kl_lists 2022-04-07 03:39:27 normalization > 03:39:21.153321 [debug] [Thread-8 ]: finished collecting timing info 2022-04-07 03:39:27 normalization > 03:39:21.153821 [debug] [Thread-2 ]: finished collecting timing info 2022-04-07 03:39:27 normalization > 03:39:21.157337 [debug] [Thread-4 ]: Opening a new connection, currently in state closed 2022-04-07 03:39:27 normalization > 03:39:21.160515 [debug] [Thread-3 ]: Opening a new connection, currently in state closed 2022-04-07 03:39:27 normalization > 03:39:21.160819 [debug] [Thread-8 ]: Began executing node model.airbyte_utils.kl_events 2022-04-07 03:39:27 normalization > 03:39:21.161145 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.kl_campaigns 2022-04-07 03:39:27 normalization > 03:39:21.161333 [debug] [Thread-7 ]: finished collecting timing info 2022-04-07 03:39:27 normalization > 03:39:21.164688 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-04-07 03:39:27 normalization > 03:39:21.167749 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-04-07 03:39:27 normalization > 03:39:21.168082 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.kl_global_exclusions 2022-04-07 03:39:27 normalization > 03:39:21.176193 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-04-07 03:39:27 normalization > 03:39:21.859243 [debug] [Thread-2 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/nhg-dw/datasets/airbyte_new/tables/kl_campaigns?prettyPrint=false: Not found: Table nhg-dw:airbyte_new.kl_campaigns 2022-04-07 03:39:27 normalization > 03:39:21.865681 [debug] [Thread-4 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/nhg-dw/datasets/airbyte_new/tables/kl_metrics?prettyPrint=false: Not found: Table nhg-dw:airbyte_new.kl_metrics 2022-04-07 03:39:27 normalization > 03:39:21.882241 [debug] [Thread-8 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/nhg-dw/datasets/airbyte_new/tables/kl_events?prettyPrint=false: Not found: Table nhg-dw:airbyte_new.kl_events 2022-04-07 03:39:27 normalization > 03:39:21.888210 [info ] [Thread-2 ]: 03:39:21 + `nhg-dw`.airbyte_new.`kl_campaigns`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-04-07 03:39:27 normalization > 03:39:21.887786 [info ] [Thread-8 ]: 03:39:21 + `nhg-dw`.airbyte_new.`kl_events`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-04-07 03:39:27 normalization > 03:39:21.897092 [info ] [Thread-4 ]: 03:39:21 + `nhg-dw`.airbyte_new.`kl_metrics`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-04-07 03:39:27 normalization > 03:39:21.969804 [debug] [Thread-7 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/nhg-dw/datasets/airbyte_new/tables/kl_global_exclusions?prettyPrint=false: Not found: Table nhg-dw:airbyte_new.kl_global_exclusions 2022-04-07 03:39:27 normalization > 03:39:21.982898 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.kl_campaigns" 2022-04-07 03:39:27 normalization > 03:39:21.984486 [debug] [Thread-8 ]: Writing runtime SQL for node "model.airbyte_utils.kl_events" 2022-04-07 03:39:27 normalization > 03:39:21.985559 [debug] [Thread-4 ]: Writing runtime SQL for node "model.airbyte_utils.kl_metrics" 2022-04-07 03:39:27 normalization > 03:39:21.985964 [debug] [Thread-3 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/nhg-dw/datasets/airbyte_new/tables/kl_lists?prettyPrint=false: Not found: Table nhg-dw:airbyte_new.kl_lists 2022-04-07 03:39:27 normalization > 03:39:21.987053 [info ] [Thread-7 ]: 03:39:21 + `nhg-dw`.airbyte_new.`kl_global_exclusions`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-04-07 03:39:27 normalization > 03:39:21.988948 [info ] [Thread-3 ]: 03:39:21 + `nhg-dw`.airbyte_new.`kl_lists`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-04-07 03:39:27 normalization > 03:39:21.993304 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.kl_global_exclusions" 2022-04-07 03:39:27 normalization > 03:39:21.997714 [debug] [Thread-3 ]: Writing runtime SQL for node "model.airbyte_utils.kl_lists" 2022-04-07 03:39:27 normalization > 03:39:21.998177 [debug] [Thread-8 ]: On model.airbyte_utils.kl_events: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.kl_events"} */ 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > create or replace table `nhg-dw`.airbyte_new.`kl_events` 2022-04-07 03:39:27 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-04-07 03:39:27 normalization > cluster by _airbyte_emitted_at 2022-04-07 03:39:27 normalization > OPTIONS() 2022-04-07 03:39:27 normalization > as ( 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > with __dbt__cte__kl_events_ab1 as ( 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-04-07 03:39:27 normalization > -- depends_on: `nhg-dw`.airbyte_new._airbyte_raw_kl_events 2022-04-07 03:39:27 normalization > select 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['uuid']") as uuid, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['object']") as object, 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > json_extract(table_alias._airbyte_data, "$['person']") 2022-04-07 03:39:27 normalization > as person, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['datetime']") as datetime, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['timestamp']") as timestamp, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['event_name']") as event_name, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['statistic_id']") as statistic_id, 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > json_extract(table_alias._airbyte_data, "$['event_properties']") 2022-04-07 03:39:27 normalization > as event_properties, 2022-04-07 03:39:27 normalization > _airbyte_ab_id, 2022-04-07 03:39:27 normalization > _airbyte_emitted_at, 2022-04-07 03:39:27 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:27 normalization > from `nhg-dw`.airbyte_new._airbyte_raw_kl_events as table_alias 2022-04-07 03:39:27 normalization > -- kl_events 2022-04-07 03:39:27 normalization > where 1 = 1 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > ), __dbt__cte__kl_events_ab2 as ( 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-04-07 03:39:27 normalization > -- depends_on: __dbt__cte__kl_events_ab1 2022-04-07 03:39:27 normalization > select 2022-04-07 03:39:27 normalization > cast(id as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as id, 2022-04-07 03:39:27 normalization > cast(uuid as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as uuid, 2022-04-07 03:39:27 normalization > cast(object as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as object, 2022-04-07 03:39:27 normalization > cast(person as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as person, 2022-04-07 03:39:27 normalization > cast(datetime as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as datetime, 2022-04-07 03:39:27 normalization > cast(timestamp as 2022-04-07 03:39:27 normalization > int64 2022-04-07 03:39:27 normalization > ) as timestamp, 2022-04-07 03:39:27 normalization > cast(event_name as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as event_name, 2022-04-07 03:39:27 normalization > cast(statistic_id as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as statistic_id, 2022-04-07 03:39:27 normalization > cast(event_properties as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as event_properties, 2022-04-07 03:39:27 normalization > _airbyte_ab_id, 2022-04-07 03:39:27 normalization > _airbyte_emitted_at, 2022-04-07 03:39:27 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:27 normalization > from __dbt__cte__kl_events_ab1 2022-04-07 03:39:27 normalization > -- kl_events 2022-04-07 03:39:27 normalization > where 1 = 1 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > ), __dbt__cte__kl_events_ab3 as ( 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > -- SQL model to build a hash column based on the values of this record 2022-04-07 03:39:27 normalization > -- depends_on: __dbt__cte__kl_events_ab2 2022-04-07 03:39:27 normalization > select 2022-04-07 03:39:27 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(uuid as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(object as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(person as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(datetime as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(timestamp as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(event_name as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(statistic_id as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(event_properties as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), '')) as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ))) as _airbyte_kl_events_hashid, 2022-04-07 03:39:27 normalization > tmp.* 2022-04-07 03:39:27 normalization > from __dbt__cte__kl_events_ab2 tmp 2022-04-07 03:39:27 normalization > -- kl_events 2022-04-07 03:39:27 normalization > where 1 = 1 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > )-- Final base SQL model 2022-04-07 03:39:27 normalization > -- depends_on: __dbt__cte__kl_events_ab3 2022-04-07 03:39:27 normalization > select 2022-04-07 03:39:27 normalization > id, 2022-04-07 03:39:27 normalization > uuid, 2022-04-07 03:39:27 normalization > object, 2022-04-07 03:39:27 normalization > person, 2022-04-07 03:39:27 normalization > datetime, 2022-04-07 03:39:27 normalization > timestamp, 2022-04-07 03:39:27 normalization > event_name, 2022-04-07 03:39:27 normalization > statistic_id, 2022-04-07 03:39:27 normalization > event_properties, 2022-04-07 03:39:27 normalization > _airbyte_ab_id, 2022-04-07 03:39:27 normalization > _airbyte_emitted_at, 2022-04-07 03:39:27 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-04-07 03:39:27 normalization > _airbyte_kl_events_hashid 2022-04-07 03:39:27 normalization > from __dbt__cte__kl_events_ab3 2022-04-07 03:39:27 normalization > -- kl_events from `nhg-dw`.airbyte_new._airbyte_raw_kl_events 2022-04-07 03:39:27 normalization > where 1 = 1 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > ); 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > 03:39:21.998950 [debug] [Thread-2 ]: On model.airbyte_utils.kl_campaigns: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.kl_campaigns"} */ 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > create or replace table `nhg-dw`.airbyte_new.`kl_campaigns` 2022-04-07 03:39:27 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-04-07 03:39:27 normalization > cluster by _airbyte_emitted_at 2022-04-07 03:39:27 normalization > OPTIONS() 2022-04-07 03:39:27 normalization > as ( 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > with __dbt__cte__kl_campaigns_ab1 as ( 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-04-07 03:39:27 normalization > -- depends_on: `nhg-dw`.airbyte_new._airbyte_raw_kl_campaigns 2022-04-07 03:39:27 normalization > select 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['name']") as name, 2022-04-07 03:39:27 normalization > json_extract_array(_airbyte_data, "$['lists']") as lists, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['object']") as object, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['status']") as status, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['created']") as created, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['sent_at']") as sent_at, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['subject']") as subject, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['updated']") as updated, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['from_name']") as from_name, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['send_time']") as send_time, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['status_id']") as status_id, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['from_email']") as from_email, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['template_id']") as template_id, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['is_segmented']") as is_segmented, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['message_type']") as message_type, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['status_label']") as status_label, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['campaign_type']") as campaign_type, 2022-04-07 03:39:27 normalization > json_extract_array(_airbyte_data, "$['excluded_lists']") as excluded_lists, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['num_recipients']") as num_recipients, 2022-04-07 03:39:27 normalization > _airbyte_ab_id, 2022-04-07 03:39:27 normalization > _airbyte_emitted_at, 2022-04-07 03:39:27 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:27 normalization > from `nhg-dw`.airbyte_new._airbyte_raw_kl_campaigns as table_alias 2022-04-07 03:39:27 normalization > -- kl_campaigns 2022-04-07 03:39:27 normalization > where 1 = 1 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > ), __dbt__cte__kl_campaigns_ab2 as ( 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-04-07 03:39:27 normalization > -- depends_on: __dbt__cte__kl_campaigns_ab1 2022-04-07 03:39:27 normalization > select 2022-04-07 03:39:27 normalization > cast(id as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as id, 2022-04-07 03:39:27 normalization > cast(name as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as name, 2022-04-07 03:39:27 normalization > lists, 2022-04-07 03:39:27 normalization > cast(object as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as object, 2022-04-07 03:39:27 normalization > cast(status as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as status, 2022-04-07 03:39:27 normalization > cast(nullif(created, '') as 2022-04-07 03:39:27 normalization > timestamp 2022-04-07 03:39:27 normalization > ) as created, 2022-04-07 03:39:27 normalization > cast(nullif(sent_at, '') as 2022-04-07 03:39:27 normalization > timestamp 2022-04-07 03:39:27 normalization > ) as sent_at, 2022-04-07 03:39:27 normalization > cast(subject as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as subject, 2022-04-07 03:39:27 normalization > cast(nullif(updated, '') as 2022-04-07 03:39:27 normalization > timestamp 2022-04-07 03:39:27 normalization > ) as updated, 2022-04-07 03:39:27 normalization > cast(from_name as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as from_name, 2022-04-07 03:39:27 normalization > cast(nullif(send_time, '') as 2022-04-07 03:39:27 normalization > timestamp 2022-04-07 03:39:27 normalization > ) as send_time, 2022-04-07 03:39:27 normalization > cast(status_id as 2022-04-07 03:39:27 normalization > int64 2022-04-07 03:39:27 normalization > ) as status_id, 2022-04-07 03:39:27 normalization > cast(from_email as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as from_email, 2022-04-07 03:39:27 normalization > cast(template_id as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as template_id, 2022-04-07 03:39:27 normalization > cast(is_segmented as boolean) as is_segmented, 2022-04-07 03:39:27 normalization > cast(message_type as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as message_type, 2022-04-07 03:39:27 normalization > cast(status_label as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as status_label, 2022-04-07 03:39:27 normalization > cast(campaign_type as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as campaign_type, 2022-04-07 03:39:27 normalization > excluded_lists, 2022-04-07 03:39:27 normalization > cast(num_recipients as 2022-04-07 03:39:27 normalization > int64 2022-04-07 03:39:27 normalization > ) as num_recipients, 2022-04-07 03:39:27 normalization > _airbyte_ab_id, 2022-04-07 03:39:27 normalization > _airbyte_emitted_at, 2022-04-07 03:39:27 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:27 normalization > from __dbt__cte__kl_campaigns_ab1 2022-04-07 03:39:27 normalization > -- kl_campaigns 2022-04-07 03:39:27 normalization > where 1 = 1 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > ), __dbt__cte__kl_campaigns_ab3 as ( 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > -- SQL model to build a hash column based on the values of this record 2022-04-07 03:39:27 normalization > -- depends_on: __dbt__cte__kl_campaigns_ab2 2022-04-07 03:39:27 normalization > select 2022-04-07 03:39:27 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(name as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(array_to_string(lists, "|", "") as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(object as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(status as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(created as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(sent_at as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(subject as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(updated as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(from_name as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(send_time as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(status_id as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(from_email as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(template_id as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(is_segmented as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(message_type as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(status_label as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(campaign_type as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(array_to_string(excluded_lists, "|", "") as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(num_recipients as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), '')) as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ))) as _airbyte_kl_campaigns_hashid, 2022-04-07 03:39:27 normalization > tmp.* 2022-04-07 03:39:27 normalization > from __dbt__cte__kl_campaigns_ab2 tmp 2022-04-07 03:39:27 normalization > -- kl_campaigns 2022-04-07 03:39:27 normalization > where 1 = 1 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > )-- Final base SQL model 2022-04-07 03:39:27 normalization > -- depends_on: __dbt__cte__kl_campaigns_ab3 2022-04-07 03:39:27 normalization > select 2022-04-07 03:39:27 normalization > id, 2022-04-07 03:39:27 normalization > name, 2022-04-07 03:39:27 normalization > lists, 2022-04-07 03:39:27 normalization > object, 2022-04-07 03:39:27 normalization > status, 2022-04-07 03:39:27 normalization > created, 2022-04-07 03:39:27 normalization > sent_at, 2022-04-07 03:39:27 normalization > subject, 2022-04-07 03:39:27 normalization > updated, 2022-04-07 03:39:27 normalization > from_name, 2022-04-07 03:39:27 normalization > send_time, 2022-04-07 03:39:27 normalization > status_id, 2022-04-07 03:39:27 normalization > from_email, 2022-04-07 03:39:27 normalization > template_id, 2022-04-07 03:39:27 normalization > is_segmented, 2022-04-07 03:39:27 normalization > message_type, 2022-04-07 03:39:27 normalization > status_label, 2022-04-07 03:39:27 normalization > campaign_type, 2022-04-07 03:39:27 normalization > excluded_lists, 2022-04-07 03:39:27 normalization > num_recipients, 2022-04-07 03:39:27 normalization > _airbyte_ab_id, 2022-04-07 03:39:27 normalization > _airbyte_emitted_at, 2022-04-07 03:39:27 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-04-07 03:39:27 normalization > _airbyte_kl_campaigns_hashid 2022-04-07 03:39:27 normalization > from __dbt__cte__kl_campaigns_ab3 2022-04-07 03:39:27 normalization > -- kl_campaigns from `nhg-dw`.airbyte_new._airbyte_raw_kl_campaigns 2022-04-07 03:39:27 normalization > where 1 = 1 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > ); 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > 03:39:21.999166 [debug] [Thread-4 ]: On model.airbyte_utils.kl_metrics: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.kl_metrics"} */ 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > create or replace table `nhg-dw`.airbyte_new.`kl_metrics` 2022-04-07 03:39:27 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-04-07 03:39:27 normalization > cluster by _airbyte_emitted_at 2022-04-07 03:39:27 normalization > OPTIONS() 2022-04-07 03:39:27 normalization > as ( 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > with __dbt__cte__kl_metrics_ab1 as ( 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-04-07 03:39:27 normalization > -- depends_on: `nhg-dw`.airbyte_new._airbyte_raw_kl_metrics 2022-04-07 03:39:27 normalization > select 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['name']") as name, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['object']") as object, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['created']") as created, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['updated']") as updated, 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > json_extract(table_alias._airbyte_data, "$['integration']") 2022-04-07 03:39:27 normalization > as integration, 2022-04-07 03:39:27 normalization > _airbyte_ab_id, 2022-04-07 03:39:27 normalization > _airbyte_emitted_at, 2022-04-07 03:39:27 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:27 normalization > from `nhg-dw`.airbyte_new._airbyte_raw_kl_metrics as table_alias 2022-04-07 03:39:27 normalization > -- kl_metrics 2022-04-07 03:39:27 normalization > where 1 = 1 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > ), __dbt__cte__kl_metrics_ab2 as ( 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-04-07 03:39:27 normalization > -- depends_on: __dbt__cte__kl_metrics_ab1 2022-04-07 03:39:27 normalization > select 2022-04-07 03:39:27 normalization > cast(id as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as id, 2022-04-07 03:39:27 normalization > cast(name as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as name, 2022-04-07 03:39:27 normalization > cast(object as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as object, 2022-04-07 03:39:27 normalization > cast(nullif(created, '') as 2022-04-07 03:39:27 normalization > timestamp 2022-04-07 03:39:27 normalization > ) as created, 2022-04-07 03:39:27 normalization > cast(nullif(updated, '') as 2022-04-07 03:39:27 normalization > timestamp 2022-04-07 03:39:27 normalization > ) as updated, 2022-04-07 03:39:27 normalization > cast(integration as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as integration, 2022-04-07 03:39:27 normalization > _airbyte_ab_id, 2022-04-07 03:39:27 normalization > _airbyte_emitted_at, 2022-04-07 03:39:27 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:27 normalization > from __dbt__cte__kl_metrics_ab1 2022-04-07 03:39:27 normalization > -- kl_metrics 2022-04-07 03:39:27 normalization > where 1 = 1 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > ), __dbt__cte__kl_metrics_ab3 as ( 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > -- SQL model to build a hash column based on the values of this record 2022-04-07 03:39:27 normalization > -- depends_on: __dbt__cte__kl_metrics_ab2 2022-04-07 03:39:27 normalization > select 2022-04-07 03:39:27 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(name as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(object as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(created as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(updated as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(integration as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), '')) as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ))) as _airbyte_kl_metrics_hashid, 2022-04-07 03:39:27 normalization > tmp.* 2022-04-07 03:39:27 normalization > from __dbt__cte__kl_metrics_ab2 tmp 2022-04-07 03:39:27 normalization > -- kl_metrics 2022-04-07 03:39:27 normalization > where 1 = 1 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > )-- Final base SQL model 2022-04-07 03:39:27 normalization > -- depends_on: __dbt__cte__kl_metrics_ab3 2022-04-07 03:39:27 normalization > select 2022-04-07 03:39:27 normalization > id, 2022-04-07 03:39:27 normalization > name, 2022-04-07 03:39:27 normalization > object, 2022-04-07 03:39:27 normalization > created, 2022-04-07 03:39:27 normalization > updated, 2022-04-07 03:39:27 normalization > integration, 2022-04-07 03:39:27 normalization > _airbyte_ab_id, 2022-04-07 03:39:27 normalization > _airbyte_emitted_at, 2022-04-07 03:39:27 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-04-07 03:39:27 normalization > _airbyte_kl_metrics_hashid 2022-04-07 03:39:27 normalization > from __dbt__cte__kl_metrics_ab3 2022-04-07 03:39:27 normalization > -- kl_metrics from `nhg-dw`.airbyte_new._airbyte_raw_kl_metrics 2022-04-07 03:39:27 normalization > where 1 = 1 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > ); 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > 03:39:21.999741 [debug] [Thread-3 ]: On model.airbyte_utils.kl_lists: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.kl_lists"} */ 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > create or replace table `nhg-dw`.airbyte_new.`kl_lists` 2022-04-07 03:39:27 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-04-07 03:39:27 normalization > cluster by _airbyte_emitted_at 2022-04-07 03:39:27 normalization > OPTIONS() 2022-04-07 03:39:27 normalization > as ( 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > with __dbt__cte__kl_lists_ab1 as ( 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-04-07 03:39:27 normalization > -- depends_on: `nhg-dw`.airbyte_new._airbyte_raw_kl_lists 2022-04-07 03:39:27 normalization > select 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['name']") as name, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['folder']") as folder, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['object']") as object, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['created']") as created, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['updated']") as updated, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['list_type']") as list_type, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['person_count']") as person_count, 2022-04-07 03:39:27 normalization > _airbyte_ab_id, 2022-04-07 03:39:27 normalization > _airbyte_emitted_at, 2022-04-07 03:39:27 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:27 normalization > from `nhg-dw`.airbyte_new._airbyte_raw_kl_lists as table_alias 2022-04-07 03:39:27 normalization > -- kl_lists 2022-04-07 03:39:27 normalization > where 1 = 1 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > ), __dbt__cte__kl_lists_ab2 as ( 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-04-07 03:39:27 normalization > -- depends_on: __dbt__cte__kl_lists_ab1 2022-04-07 03:39:27 normalization > select 2022-04-07 03:39:27 normalization > cast(id as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as id, 2022-04-07 03:39:27 normalization > cast(name as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as name, 2022-04-07 03:39:27 normalization > cast(folder as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as folder, 2022-04-07 03:39:27 normalization > cast(object as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as object, 2022-04-07 03:39:27 normalization > cast(nullif(created, '') as 2022-04-07 03:39:27 normalization > timestamp 2022-04-07 03:39:27 normalization > ) as created, 2022-04-07 03:39:27 normalization > cast(nullif(updated, '') as 2022-04-07 03:39:27 normalization > timestamp 2022-04-07 03:39:27 normalization > ) as updated, 2022-04-07 03:39:27 normalization > cast(list_type as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as list_type, 2022-04-07 03:39:27 normalization > cast(person_count as 2022-04-07 03:39:27 normalization > int64 2022-04-07 03:39:27 normalization > ) as person_count, 2022-04-07 03:39:27 normalization > _airbyte_ab_id, 2022-04-07 03:39:27 normalization > _airbyte_emitted_at, 2022-04-07 03:39:27 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:27 normalization > from __dbt__cte__kl_lists_ab1 2022-04-07 03:39:27 normalization > -- kl_lists 2022-04-07 03:39:27 normalization > where 1 = 1 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > ), __dbt__cte__kl_lists_ab3 as ( 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > -- SQL model to build a hash column based on the values of this record 2022-04-07 03:39:27 normalization > -- depends_on: __dbt__cte__kl_lists_ab2 2022-04-07 03:39:27 normalization > select 2022-04-07 03:39:27 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(name as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(folder as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(object as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(created as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(updated as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(list_type as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(person_count as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), '')) as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ))) as _airbyte_kl_lists_hashid, 2022-04-07 03:39:27 normalization > tmp.* 2022-04-07 03:39:27 normalization > from __dbt__cte__kl_lists_ab2 tmp 2022-04-07 03:39:27 normalization > -- kl_lists 2022-04-07 03:39:27 normalization > where 1 = 1 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > )-- Final base SQL model 2022-04-07 03:39:27 normalization > -- depends_on: __dbt__cte__kl_lists_ab3 2022-04-07 03:39:27 normalization > select 2022-04-07 03:39:27 normalization > id, 2022-04-07 03:39:27 normalization > name, 2022-04-07 03:39:27 normalization > folder, 2022-04-07 03:39:27 normalization > object, 2022-04-07 03:39:27 normalization > created, 2022-04-07 03:39:27 normalization > updated, 2022-04-07 03:39:27 normalization > list_type, 2022-04-07 03:39:27 normalization > person_count, 2022-04-07 03:39:27 normalization > _airbyte_ab_id, 2022-04-07 03:39:27 normalization > _airbyte_emitted_at, 2022-04-07 03:39:27 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-04-07 03:39:27 normalization > _airbyte_kl_lists_hashid 2022-04-07 03:39:27 normalization > from __dbt__cte__kl_lists_ab3 2022-04-07 03:39:27 normalization > -- kl_lists from `nhg-dw`.airbyte_new._airbyte_raw_kl_lists 2022-04-07 03:39:27 normalization > where 1 = 1 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > ); 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > 03:39:22.002701 [debug] [Thread-7 ]: On model.airbyte_utils.kl_global_exclusions: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.kl_global_exclusions"} */ 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > create or replace table `nhg-dw`.airbyte_new.`kl_global_exclusions` 2022-04-07 03:39:27 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-04-07 03:39:27 normalization > cluster by _airbyte_emitted_at 2022-04-07 03:39:27 normalization > OPTIONS() 2022-04-07 03:39:27 normalization > as ( 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > with __dbt__cte__kl_global_exclusions_ab1 as ( 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-04-07 03:39:27 normalization > -- depends_on: `nhg-dw`.airbyte_new._airbyte_raw_kl_global_exclusions 2022-04-07 03:39:27 normalization > select 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['email']") as email, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['object']") as object, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['reason']") as reason, 2022-04-07 03:39:27 normalization > json_extract_scalar(_airbyte_data, "$['timestamp']") as timestamp, 2022-04-07 03:39:27 normalization > _airbyte_ab_id, 2022-04-07 03:39:27 normalization > _airbyte_emitted_at, 2022-04-07 03:39:27 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:27 normalization > from `nhg-dw`.airbyte_new._airbyte_raw_kl_global_exclusions as table_alias 2022-04-07 03:39:27 normalization > -- kl_global_exclusions 2022-04-07 03:39:27 normalization > where 1 = 1 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > ), __dbt__cte__kl_global_exclusions_ab2 as ( 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-04-07 03:39:27 normalization > -- depends_on: __dbt__cte__kl_global_exclusions_ab1 2022-04-07 03:39:27 normalization > select 2022-04-07 03:39:27 normalization > cast(email as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as email, 2022-04-07 03:39:27 normalization > cast(object as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as object, 2022-04-07 03:39:27 normalization > cast(reason as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ) as reason, 2022-04-07 03:39:27 normalization > cast(nullif(timestamp, '') as 2022-04-07 03:39:27 normalization > timestamp 2022-04-07 03:39:27 normalization > ) as timestamp, 2022-04-07 03:39:27 normalization > _airbyte_ab_id, 2022-04-07 03:39:27 normalization > _airbyte_emitted_at, 2022-04-07 03:39:27 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:27 normalization > from __dbt__cte__kl_global_exclusions_ab1 2022-04-07 03:39:27 normalization > -- kl_global_exclusions 2022-04-07 03:39:27 normalization > where 1 = 1 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > ), __dbt__cte__kl_global_exclusions_ab3 as ( 2022-04-07 03:39:27 normalization > 2022-04-07 03:39:27 normalization > -- SQL model to build a hash column based on the values of this record 2022-04-07 03:39:27 normalization > -- depends_on: __dbt__cte__kl_global_exclusions_ab2 2022-04-07 03:39:27 normalization > select 2022-04-07 03:39:27 normalization > to_hex(md5(cast(concat(coalesce(cast(email as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(object as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(reason as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), ''), '-', coalesce(cast(timestamp as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ), '')) as 2022-04-07 03:39:27 normalization > string 2022-04-07 03:39:27 normalization > ))) as _airbyte_kl_global_exclusions_hashid, 2022-04-07 03:39:27 normalization > tmp.* 2022-04-07 03:39:27 normalization > from __dbt__cte__kl_global_exclusions_ab2 tmp 2022-04-07 03:39:27 normalization > -- kl_global_exclusions 2022-04-07 03:39:27 normalization > where 1 = 1 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > )-- Final base SQL model 2022-04-07 03:39:28 normalization > -- depends_on: __dbt__cte__kl_global_exclusions_ab3 2022-04-07 03:39:28 normalization > select 2022-04-07 03:39:28 normalization > email, 2022-04-07 03:39:28 normalization > object, 2022-04-07 03:39:28 normalization > reason, 2022-04-07 03:39:28 normalization > timestamp, 2022-04-07 03:39:28 normalization > _airbyte_ab_id, 2022-04-07 03:39:28 normalization > _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-04-07 03:39:28 normalization > _airbyte_kl_global_exclusions_hashid 2022-04-07 03:39:28 normalization > from __dbt__cte__kl_global_exclusions_ab3 2022-04-07 03:39:28 normalization > -- kl_global_exclusions from `nhg-dw`.airbyte_new._airbyte_raw_kl_global_exclusions 2022-04-07 03:39:28 normalization > where 1 = 1 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > ); 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > 03:39:22.584224 [debug] [Thread-7 ]: BigQuery adapter: Unhandled error while running: 2022-04-07 03:39:28 normalization > /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.kl_global_exclusions"} */ 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > create or replace table `nhg-dw`.airbyte_new.`kl_global_exclusions` 2022-04-07 03:39:28 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-04-07 03:39:28 normalization > cluster by _airbyte_emitted_at 2022-04-07 03:39:28 normalization > OPTIONS() 2022-04-07 03:39:28 normalization > as ( 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > with __dbt__cte__kl_global_exclusions_ab1 as ( 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-04-07 03:39:28 normalization > -- depends_on: `nhg-dw`.airbyte_new._airbyte_raw_kl_global_exclusions 2022-04-07 03:39:28 normalization > select 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['email']") as email, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['object']") as object, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['reason']") as reason, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['timestamp']") as timestamp, 2022-04-07 03:39:28 normalization > _airbyte_ab_id, 2022-04-07 03:39:28 normalization > _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:28 normalization > from `nhg-dw`.airbyte_new._airbyte_raw_kl_global_exclusions as table_alias 2022-04-07 03:39:28 normalization > -- kl_global_exclusions 2022-04-07 03:39:28 normalization > where 1 = 1 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > ), __dbt__cte__kl_global_exclusions_ab2 as ( 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-04-07 03:39:28 normalization > -- depends_on: __dbt__cte__kl_global_exclusions_ab1 2022-04-07 03:39:28 normalization > select 2022-04-07 03:39:28 normalization > cast(email as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as email, 2022-04-07 03:39:28 normalization > cast(object as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as object, 2022-04-07 03:39:28 normalization > cast(reason as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as reason, 2022-04-07 03:39:28 normalization > cast(nullif(timestamp, '') as 2022-04-07 03:39:28 normalization > timestamp 2022-04-07 03:39:28 normalization > ) as timestamp, 2022-04-07 03:39:28 normalization > _airbyte_ab_id, 2022-04-07 03:39:28 normalization > _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:28 normalization > from __dbt__cte__kl_global_exclusions_ab1 2022-04-07 03:39:28 normalization > -- kl_global_exclusions 2022-04-07 03:39:28 normalization > where 1 = 1 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > ), __dbt__cte__kl_global_exclusions_ab3 as ( 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > -- SQL model to build a hash column based on the values of this record 2022-04-07 03:39:28 normalization > -- depends_on: __dbt__cte__kl_global_exclusions_ab2 2022-04-07 03:39:28 normalization > select 2022-04-07 03:39:28 normalization > to_hex(md5(cast(concat(coalesce(cast(email as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(object as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(reason as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(timestamp as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), '')) as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ))) as _airbyte_kl_global_exclusions_hashid, 2022-04-07 03:39:28 normalization > tmp.* 2022-04-07 03:39:28 normalization > from __dbt__cte__kl_global_exclusions_ab2 tmp 2022-04-07 03:39:28 normalization > -- kl_global_exclusions 2022-04-07 03:39:28 normalization > where 1 = 1 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > )-- Final base SQL model 2022-04-07 03:39:28 normalization > -- depends_on: __dbt__cte__kl_global_exclusions_ab3 2022-04-07 03:39:28 normalization > select 2022-04-07 03:39:28 normalization > email, 2022-04-07 03:39:28 normalization > object, 2022-04-07 03:39:28 normalization > reason, 2022-04-07 03:39:28 normalization > timestamp, 2022-04-07 03:39:28 normalization > _airbyte_ab_id, 2022-04-07 03:39:28 normalization > _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-04-07 03:39:28 normalization > _airbyte_kl_global_exclusions_hashid 2022-04-07 03:39:28 normalization > from __dbt__cte__kl_global_exclusions_ab3 2022-04-07 03:39:28 normalization > -- kl_global_exclusions from `nhg-dw`.airbyte_new._airbyte_raw_kl_global_exclusions 2022-04-07 03:39:28 normalization > where 1 = 1 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > ); 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > 03:39:22.584859 [debug] [Thread-4 ]: BigQuery adapter: Unhandled error while running: 2022-04-07 03:39:28 normalization > /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.kl_metrics"} */ 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > create or replace table `nhg-dw`.airbyte_new.`kl_metrics` 2022-04-07 03:39:28 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-04-07 03:39:28 normalization > cluster by _airbyte_emitted_at 2022-04-07 03:39:28 normalization > OPTIONS() 2022-04-07 03:39:28 normalization > as ( 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > with __dbt__cte__kl_metrics_ab1 as ( 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-04-07 03:39:28 normalization > -- depends_on: `nhg-dw`.airbyte_new._airbyte_raw_kl_metrics 2022-04-07 03:39:28 normalization > select 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['name']") as name, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['object']") as object, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['created']") as created, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['updated']") as updated, 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > json_extract(table_alias._airbyte_data, "$['integration']") 2022-04-07 03:39:28 normalization > as integration, 2022-04-07 03:39:28 normalization > _airbyte_ab_id, 2022-04-07 03:39:28 normalization > _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:28 normalization > from `nhg-dw`.airbyte_new._airbyte_raw_kl_metrics as table_alias 2022-04-07 03:39:28 normalization > -- kl_metrics 2022-04-07 03:39:28 normalization > where 1 = 1 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > ), __dbt__cte__kl_metrics_ab2 as ( 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-04-07 03:39:28 normalization > -- depends_on: __dbt__cte__kl_metrics_ab1 2022-04-07 03:39:28 normalization > select 2022-04-07 03:39:28 normalization > cast(id as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as id, 2022-04-07 03:39:28 normalization > cast(name as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as name, 2022-04-07 03:39:28 normalization > cast(object as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as object, 2022-04-07 03:39:28 normalization > cast(nullif(created, '') as 2022-04-07 03:39:28 normalization > timestamp 2022-04-07 03:39:28 normalization > ) as created, 2022-04-07 03:39:28 normalization > cast(nullif(updated, '') as 2022-04-07 03:39:28 normalization > timestamp 2022-04-07 03:39:28 normalization > ) as updated, 2022-04-07 03:39:28 normalization > cast(integration as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as integration, 2022-04-07 03:39:28 normalization > _airbyte_ab_id, 2022-04-07 03:39:28 normalization > _airbyte_emitted_at, 2022-04-07 03:39:28 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):158 - Completing future exceptionally... io.airbyte.workers.WorkerException: Normalization Failed. at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:60) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:18) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.airbyte.workers.WorkerException: Normalization Failed. at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:57) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] ... 3 more Suppressed: io.airbyte.workers.WorkerException: Normalization process wasn't successful at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:160) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:45) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:18) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] 2022-04-07 03:39:28 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:28 normalization > from __dbt__cte__kl_metrics_ab1 2022-04-07 03:39:28 normalization > -- kl_metrics 2022-04-07 03:39:28 normalization > where 1 = 1 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > ), __dbt__cte__kl_metrics_ab3 as ( 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > -- SQL model to build a hash column based on the values of this record 2022-04-07 03:39:28 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-04-07 03:39:28 normalization > -- depends_on: __dbt__cte__kl_metrics_ab2 2022-04-07 03:39:28 normalization > select 2022-04-07 03:39:28 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(name as 2022-04-07 03:39:28 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):235 - Stopping temporal heartbeating... 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(object as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(created as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(updated as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(integration as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), '')) as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ))) as _airbyte_kl_metrics_hashid, 2022-04-07 03:39:28 normalization > tmp.* 2022-04-07 03:39:28 normalization > from __dbt__cte__kl_metrics_ab2 tmp 2022-04-07 03:39:28 normalization > -- kl_metrics 2022-04-07 03:39:28 normalization > where 1 = 1 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > )-- Final base SQL model 2022-04-07 03:39:28 normalization > -- depends_on: __dbt__cte__kl_metrics_ab3 2022-04-07 03:39:28 normalization > select 2022-04-07 03:39:28 normalization > id, 2022-04-07 03:39:28 normalization > name, 2022-04-07 03:39:28 normalization > object, 2022-04-07 03:39:28 normalization > created, 2022-04-07 03:39:28 normalization > updated, 2022-04-07 03:39:28 normalization > integration, 2022-04-07 03:39:28 normalization > _airbyte_ab_id, 2022-04-07 03:39:28 normalization > _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-04-07 03:39:28 normalization > _airbyte_kl_metrics_hashid 2022-04-07 03:39:28 normalization > from __dbt__cte__kl_metrics_ab3 2022-04-07 03:39:28 normalization > -- kl_metrics from `nhg-dw`.airbyte_new._airbyte_raw_kl_metrics 2022-04-07 03:39:28 normalization > where 1 = 1 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > ); 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > 03:39:22.585211 [debug] [Thread-7 ]: BigQuery adapter: 404 Not found: Table nhg-dw:airbyte_new._airbyte_raw_kl_global_exclusions was not found in location europe-west4 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > (job ID: 75fcb30d-2c58-4771-8701-3c00fd823bb0) 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > -----Query Job SQL Follows----- 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > | . | . | . | . | . | . | . | . | . | . | . | . | . | . | . | 2022-04-07 03:39:28 normalization > 1:/* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.kl_global_exclusions"} */ 2022-04-07 03:39:28 normalization > 2: 2022-04-07 03:39:28 normalization > 3: 2022-04-07 03:39:28 normalization > 4: create or replace table `nhg-dw`.airbyte_new.`kl_global_exclusions` 2022-04-07 03:39:28 normalization > 5: partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-04-07 03:39:28 normalization > 6: cluster by _airbyte_emitted_at 2022-04-07 03:39:28 normalization > 7: OPTIONS() 2022-04-07 03:39:28 normalization > 8: as ( 2022-04-07 03:39:28 normalization > 9: 2022-04-07 03:39:28 normalization > 10:with __dbt__cte__kl_global_exclusions_ab1 as ( 2022-04-07 03:39:28 normalization > 11: 2022-04-07 03:39:28 normalization > 12:-- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-04-07 03:39:28 normalization > 13:-- depends_on: `nhg-dw`.airbyte_new._airbyte_raw_kl_global_exclusions 2022-04-07 03:39:28 normalization > 14:select 2022-04-07 03:39:28 normalization > 15: json_extract_scalar(_airbyte_data, "$['email']") as email, 2022-04-07 03:39:28 normalization > 16: json_extract_scalar(_airbyte_data, "$['object']") as object, 2022-04-07 03:39:28 normalization > 17: json_extract_scalar(_airbyte_data, "$['reason']") as reason, 2022-04-07 03:39:28 WARN i.t.i.a.POJOActivityTaskHandler(activityFailureToResult):307 - Activity failure. ActivityId=0f7587bc-8ecb-34b3-a6a4-28a982308a8b, activityType=Normalize, attempt=1 java.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.WorkerException: Normalization Failed. at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:233) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.normalize(NormalizationActivityImpl.java:71) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:214) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:180) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:120) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:204) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:164) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.8.1.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.WorkerException: Normalization Failed. at io.temporal.serviceclient.CheckedExceptionWrapper.wrap(CheckedExceptionWrapper.java:56) ~[temporal-serviceclient-1.8.1.jar:?] at io.temporal.internal.sync.WorkflowInternal.wrap(WorkflowInternal.java:448) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.activity.Activity.wrap(Activity.java:51) ~[temporal-sdk-1.8.1.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:135) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$1(NormalizationActivityImpl.java:97) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:228) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] ... 14 more Caused by: java.util.concurrent.ExecutionException: io.airbyte.workers.WorkerException: Normalization Failed. at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:129) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$1(NormalizationActivityImpl.java:97) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:228) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] ... 14 more Caused by: io.airbyte.workers.WorkerException: Normalization Failed. at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:60) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:18) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] ... 1 more Caused by: io.airbyte.workers.WorkerException: Normalization Failed. at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:57) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:18) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] ... 1 more Suppressed: io.airbyte.workers.WorkerException: Normalization process wasn't successful at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:160) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:45) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:18) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.35.65-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] 2022-04-07 03:39:28 normalization > 18: json_extract_scalar(_airbyte_data, "$['timestamp']") as timestamp, 2022-04-07 03:39:28 normalization > 19: _airbyte_ab_id, 2022-04-07 03:39:28 normalization > 20: _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > 21: CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:28 normalization > 22:from `nhg-dw`.airbyte_new._airbyte_raw_kl_global_exclusions as table_alias 2022-04-07 03:39:28 normalization > 23:-- kl_global_exclusions 2022-04-07 03:39:28 normalization > 24:where 1 = 1 2022-04-07 03:39:28 normalization > 25: 2022-04-07 03:39:28 normalization > 26:), __dbt__cte__kl_global_exclusions_ab2 as ( 2022-04-07 03:39:28 normalization > 27: 2022-04-07 03:39:28 normalization > 28:-- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-04-07 03:39:28 normalization > 29:-- depends_on: __dbt__cte__kl_global_exclusions_ab1 2022-04-07 03:39:28 normalization > 30:select 2022-04-07 03:39:28 normalization > 31: cast(email as 2022-04-07 03:39:28 normalization > 32: string 2022-04-07 03:39:28 normalization > 33:) as email, 2022-04-07 03:39:28 normalization > 34: cast(object as 2022-04-07 03:39:28 normalization > 35: string 2022-04-07 03:39:28 normalization > 36:) as object, 2022-04-07 03:39:28 normalization > 37: cast(reason as 2022-04-07 03:39:28 normalization > 38: string 2022-04-07 03:39:28 normalization > 39:) as reason, 2022-04-07 03:39:28 normalization > 40: cast(nullif(timestamp, '') as 2022-04-07 03:39:28 normalization > 41: timestamp 2022-04-07 03:39:28 normalization > 42:) as timestamp, 2022-04-07 03:39:28 normalization > 43: _airbyte_ab_id, 2022-04-07 03:39:28 normalization > 44: _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > 45: CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:28 normalization > 46:from __dbt__cte__kl_global_exclusions_ab1 2022-04-07 03:39:28 normalization > 47:-- kl_global_exclusions 2022-04-07 03:39:28 normalization > 48:where 1 = 1 2022-04-07 03:39:28 normalization > 49: 2022-04-07 03:39:28 normalization > 50:), __dbt__cte__kl_global_exclusions_ab3 as ( 2022-04-07 03:39:28 normalization > 51: 2022-04-07 03:39:28 normalization > 52:-- SQL model to build a hash column based on the values of this record 2022-04-07 03:39:28 normalization > 53:-- depends_on: __dbt__cte__kl_global_exclusions_ab2 2022-04-07 03:39:28 normalization > 54:select 2022-04-07 03:39:28 normalization > 55: to_hex(md5(cast(concat(coalesce(cast(email as 2022-04-07 03:39:28 normalization > 56: string 2022-04-07 03:39:28 normalization > 57:), ''), '-', coalesce(cast(object as 2022-04-07 03:39:28 normalization > 58: string 2022-04-07 03:39:28 normalization > 59:), ''), '-', coalesce(cast(reason as 2022-04-07 03:39:28 normalization > 60: string 2022-04-07 03:39:28 normalization > 61:), ''), '-', coalesce(cast(timestamp as 2022-04-07 03:39:28 normalization > 62: string 2022-04-07 03:39:28 normalization > 63:), '')) as 2022-04-07 03:39:28 normalization > 64: string 2022-04-07 03:39:28 normalization > 65:))) as _airbyte_kl_global_exclusions_hashid, 2022-04-07 03:39:28 normalization > 66: tmp.* 2022-04-07 03:39:28 normalization > 67:from __dbt__cte__kl_global_exclusions_ab2 tmp 2022-04-07 03:39:28 normalization > 68:-- kl_global_exclusions 2022-04-07 03:39:28 normalization > 69:where 1 = 1 2022-04-07 03:39:28 normalization > 70: 2022-04-07 03:39:28 normalization > 71:)-- Final base SQL model 2022-04-07 03:39:28 normalization > 72:-- depends_on: __dbt__cte__kl_global_exclusions_ab3 2022-04-07 03:39:28 normalization > 73:select 2022-04-07 03:39:28 normalization > 74: email, 2022-04-07 03:39:28 normalization > 75: object, 2022-04-07 03:39:28 normalization > 76: reason, 2022-04-07 03:39:28 normalization > 77: timestamp, 2022-04-07 03:39:28 normalization > 78: _airbyte_ab_id, 2022-04-07 03:39:28 normalization > 79: _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > 80: CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-04-07 03:39:28 normalization > 81: _airbyte_kl_global_exclusions_hashid 2022-04-07 03:39:28 normalization > 82:from __dbt__cte__kl_global_exclusions_ab3 2022-04-07 03:39:28 normalization > 83:-- kl_global_exclusions from `nhg-dw`.airbyte_new._airbyte_raw_kl_global_exclusions 2022-04-07 03:39:28 normalization > 84:where 1 = 1 2022-04-07 03:39:28 normalization > 85: 2022-04-07 03:39:28 normalization > 86: ); 2022-04-07 03:39:28 normalization > 87: 2022-04-07 03:39:28 normalization > | . | . | . | . | . | . | . | . | . | . | . | . | . | . | . | 2022-04-07 03:39:28 normalization > 03:39:22.585838 [debug] [Thread-3 ]: BigQuery adapter: Unhandled error while running: 2022-04-07 03:39:28 normalization > /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.kl_lists"} */ 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > create or replace table `nhg-dw`.airbyte_new.`kl_lists` 2022-04-07 03:39:28 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-04-07 03:39:28 normalization > cluster by _airbyte_emitted_at 2022-04-07 03:39:28 normalization > OPTIONS() 2022-04-07 03:39:28 normalization > as ( 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > with __dbt__cte__kl_lists_ab1 as ( 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-04-07 03:39:28 normalization > -- depends_on: `nhg-dw`.airbyte_new._airbyte_raw_kl_lists 2022-04-07 03:39:28 normalization > select 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['name']") as name, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['folder']") as folder, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['object']") as object, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['created']") as created, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['updated']") as updated, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['list_type']") as list_type, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['person_count']") as person_count, 2022-04-07 03:39:28 normalization > _airbyte_ab_id, 2022-04-07 03:39:28 normalization > _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:28 normalization > from `nhg-dw`.airbyte_new._airbyte_raw_kl_lists as table_alias 2022-04-07 03:39:28 normalization > -- kl_lists 2022-04-07 03:39:28 normalization > where 1 = 1 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > ), __dbt__cte__kl_lists_ab2 as ( 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-04-07 03:39:28 normalization > -- depends_on: __dbt__cte__kl_lists_ab1 2022-04-07 03:39:28 normalization > select 2022-04-07 03:39:28 normalization > cast(id as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as id, 2022-04-07 03:39:28 normalization > cast(name as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as name, 2022-04-07 03:39:28 normalization > cast(folder as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as folder, 2022-04-07 03:39:28 normalization > cast(object as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as object, 2022-04-07 03:39:28 normalization > cast(nullif(created, '') as 2022-04-07 03:39:28 normalization > timestamp 2022-04-07 03:39:28 normalization > ) as created, 2022-04-07 03:39:28 normalization > cast(nullif(updated, '') as 2022-04-07 03:39:28 normalization > timestamp 2022-04-07 03:39:28 normalization > ) as updated, 2022-04-07 03:39:28 normalization > cast(list_type as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as list_type, 2022-04-07 03:39:28 normalization > cast(person_count as 2022-04-07 03:39:28 normalization > int64 2022-04-07 03:39:28 normalization > ) as person_count, 2022-04-07 03:39:28 normalization > _airbyte_ab_id, 2022-04-07 03:39:28 normalization > _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:28 normalization > from __dbt__cte__kl_lists_ab1 2022-04-07 03:39:28 normalization > -- kl_lists 2022-04-07 03:39:28 normalization > where 1 = 1 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > ), __dbt__cte__kl_lists_ab3 as ( 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > -- SQL model to build a hash column based on the values of this record 2022-04-07 03:39:28 normalization > -- depends_on: __dbt__cte__kl_lists_ab2 2022-04-07 03:39:28 normalization > select 2022-04-07 03:39:28 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(name as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(folder as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(object as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(created as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(updated as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(list_type as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(person_count as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), '')) as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ))) as _airbyte_kl_lists_hashid, 2022-04-07 03:39:28 normalization > tmp.* 2022-04-07 03:39:28 normalization > from __dbt__cte__kl_lists_ab2 tmp 2022-04-07 03:39:28 normalization > -- kl_lists 2022-04-07 03:39:28 normalization > where 1 = 1 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > )-- Final base SQL model 2022-04-07 03:39:28 normalization > -- depends_on: __dbt__cte__kl_lists_ab3 2022-04-07 03:39:28 normalization > select 2022-04-07 03:39:28 normalization > id, 2022-04-07 03:39:28 normalization > name, 2022-04-07 03:39:28 normalization > folder, 2022-04-07 03:39:28 normalization > object, 2022-04-07 03:39:28 normalization > created, 2022-04-07 03:39:28 normalization > updated, 2022-04-07 03:39:28 normalization > list_type, 2022-04-07 03:39:28 normalization > person_count, 2022-04-07 03:39:28 normalization > _airbyte_ab_id, 2022-04-07 03:39:28 normalization > _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-04-07 03:39:28 normalization > _airbyte_kl_lists_hashid 2022-04-07 03:39:28 normalization > from __dbt__cte__kl_lists_ab3 2022-04-07 03:39:28 normalization > -- kl_lists from `nhg-dw`.airbyte_new._airbyte_raw_kl_lists 2022-04-07 03:39:28 normalization > where 1 = 1 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > ); 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > 03:39:22.586327 [debug] [Thread-4 ]: BigQuery adapter: 404 Not found: Table nhg-dw:airbyte_new._airbyte_raw_kl_metrics was not found in location europe-west4 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > (job ID: dc2b6095-6bfd-45de-bda2-7bb244eb8c3c) 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > -----Query Job SQL Follows----- 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > | . | . | . | . | . | . | . | . | . | . | . | . | . | . | 2022-04-07 03:39:28 normalization > 1:/* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.kl_metrics"} */ 2022-04-07 03:39:28 normalization > 2: 2022-04-07 03:39:28 normalization > 3: 2022-04-07 03:39:28 normalization > 4: create or replace table `nhg-dw`.airbyte_new.`kl_metrics` 2022-04-07 03:39:28 normalization > 5: partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-04-07 03:39:28 normalization > 6: cluster by _airbyte_emitted_at 2022-04-07 03:39:28 normalization > 7: OPTIONS() 2022-04-07 03:39:28 normalization > 8: as ( 2022-04-07 03:39:28 normalization > 9: 2022-04-07 03:39:28 normalization > 10:with __dbt__cte__kl_metrics_ab1 as ( 2022-04-07 03:39:28 normalization > 11: 2022-04-07 03:39:28 normalization > 12:-- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-04-07 03:39:28 normalization > 13:-- depends_on: `nhg-dw`.airbyte_new._airbyte_raw_kl_metrics 2022-04-07 03:39:28 normalization > 14:select 2022-04-07 03:39:28 normalization > 15: json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-04-07 03:39:28 normalization > 16: json_extract_scalar(_airbyte_data, "$['name']") as name, 2022-04-07 03:39:28 normalization > 17: json_extract_scalar(_airbyte_data, "$['object']") as object, 2022-04-07 03:39:28 normalization > 18: json_extract_scalar(_airbyte_data, "$['created']") as created, 2022-04-07 03:39:28 normalization > 19: json_extract_scalar(_airbyte_data, "$['updated']") as updated, 2022-04-07 03:39:28 normalization > 20: 2022-04-07 03:39:28 normalization > 21: json_extract(table_alias._airbyte_data, "$['integration']") 2022-04-07 03:39:28 normalization > 22: as integration, 2022-04-07 03:39:28 normalization > 23: _airbyte_ab_id, 2022-04-07 03:39:28 normalization > 24: _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > 25: CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:28 normalization > 26:from `nhg-dw`.airbyte_new._airbyte_raw_kl_metrics as table_alias 2022-04-07 03:39:28 normalization > 27:-- kl_metrics 2022-04-07 03:39:28 normalization > 28:where 1 = 1 2022-04-07 03:39:28 normalization > 29: 2022-04-07 03:39:28 normalization > 30:), __dbt__cte__kl_metrics_ab2 as ( 2022-04-07 03:39:28 normalization > 31: 2022-04-07 03:39:28 normalization > 32:-- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-04-07 03:39:28 normalization > 33:-- depends_on: __dbt__cte__kl_metrics_ab1 2022-04-07 03:39:28 normalization > 34:select 2022-04-07 03:39:28 normalization > 35: cast(id as 2022-04-07 03:39:28 normalization > 36: string 2022-04-07 03:39:28 normalization > 37:) as id, 2022-04-07 03:39:28 normalization > 38: cast(name as 2022-04-07 03:39:28 normalization > 39: string 2022-04-07 03:39:28 normalization > 40:) as name, 2022-04-07 03:39:28 normalization > 41: cast(object as 2022-04-07 03:39:28 normalization > 42: string 2022-04-07 03:39:28 normalization > 43:) as object, 2022-04-07 03:39:28 normalization > 44: cast(nullif(created, '') as 2022-04-07 03:39:28 normalization > 45: timestamp 2022-04-07 03:39:28 normalization > 46:) as created, 2022-04-07 03:39:28 normalization > 47: cast(nullif(updated, '') as 2022-04-07 03:39:28 normalization > 48: timestamp 2022-04-07 03:39:28 normalization > 49:) as updated, 2022-04-07 03:39:28 normalization > 50: cast(integration as 2022-04-07 03:39:28 normalization > 51: string 2022-04-07 03:39:28 normalization > 52:) as integration, 2022-04-07 03:39:28 normalization > 53: _airbyte_ab_id, 2022-04-07 03:39:28 normalization > 54: _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > 55: CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:28 normalization > 56:from __dbt__cte__kl_metrics_ab1 2022-04-07 03:39:28 normalization > 57:-- kl_metrics 2022-04-07 03:39:28 normalization > 58:where 1 = 1 2022-04-07 03:39:28 normalization > 59: 2022-04-07 03:39:28 normalization > 60:), __dbt__cte__kl_metrics_ab3 as ( 2022-04-07 03:39:28 normalization > 61: 2022-04-07 03:39:28 normalization > 62:-- SQL model to build a hash column based on the values of this record 2022-04-07 03:39:28 normalization > 63:-- depends_on: __dbt__cte__kl_metrics_ab2 2022-04-07 03:39:28 normalization > 64:select 2022-04-07 03:39:28 normalization > 65: to_hex(md5(cast(concat(coalesce(cast(id as 2022-04-07 03:39:28 normalization > 66: string 2022-04-07 03:39:28 normalization > 67:), ''), '-', coalesce(cast(name as 2022-04-07 03:39:28 normalization > 68: string 2022-04-07 03:39:28 normalization > 69:), ''), '-', coalesce(cast(object as 2022-04-07 03:39:28 normalization > 70: string 2022-04-07 03:39:28 normalization > 71:), ''), '-', coalesce(cast(created as 2022-04-07 03:39:28 normalization > 72: string 2022-04-07 03:39:28 normalization > 73:), ''), '-', coalesce(cast(updated as 2022-04-07 03:39:28 normalization > 74: string 2022-04-07 03:39:28 normalization > 75:), ''), '-', coalesce(cast(integration as 2022-04-07 03:39:28 normalization > 76: string 2022-04-07 03:39:28 normalization > 77:), '')) as 2022-04-07 03:39:28 normalization > 78: string 2022-04-07 03:39:28 normalization > 79:))) as _airbyte_kl_metrics_hashid, 2022-04-07 03:39:28 normalization > 80: tmp.* 2022-04-07 03:39:28 normalization > 81:from __dbt__cte__kl_metrics_ab2 tmp 2022-04-07 03:39:28 normalization > 82:-- kl_metrics 2022-04-07 03:39:28 normalization > 83:where 1 = 1 2022-04-07 03:39:28 normalization > 84: 2022-04-07 03:39:28 normalization > 85:)-- Final base SQL model 2022-04-07 03:39:28 normalization > 86:-- depends_on: __dbt__cte__kl_metrics_ab3 2022-04-07 03:39:28 normalization > 87:select 2022-04-07 03:39:28 normalization > 88: id, 2022-04-07 03:39:28 normalization > 89: name, 2022-04-07 03:39:28 normalization > 90: object, 2022-04-07 03:39:28 normalization > 91: created, 2022-04-07 03:39:28 normalization > 92: updated, 2022-04-07 03:39:28 normalization > 93: integration, 2022-04-07 03:39:28 normalization > 94: _airbyte_ab_id, 2022-04-07 03:39:28 normalization > 95: _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > 96: CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-04-07 03:39:28 normalization > 97: _airbyte_kl_metrics_hashid 2022-04-07 03:39:28 normalization > 98:from __dbt__cte__kl_metrics_ab3 2022-04-07 03:39:28 normalization > 99:-- kl_metrics from `nhg-dw`.airbyte_new._airbyte_raw_kl_metrics 2022-04-07 03:39:28 normalization > 100:where 1 = 1 2022-04-07 03:39:28 normalization > 101: 2022-04-07 03:39:28 normalization > 102: ); 2022-04-07 03:39:28 normalization > 103: 2022-04-07 03:39:28 normalization > | . | . | . | . | . | . | . | . | . | . | . | . | . | . | 2022-04-07 03:39:28 normalization > 03:39:22.586778 [debug] [Thread-7 ]: finished collecting timing info 2022-04-07 03:39:28 normalization > 03:39:22.588082 [debug] [Thread-3 ]: BigQuery adapter: 404 Not found: Table nhg-dw:airbyte_new._airbyte_raw_kl_lists was not found in location europe-west4 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > (job ID: effb1025-b146-462e-909b-47da7433f2a3) 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > -----Query Job SQL Follows----- 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > | . | . | . | . | . | . | . | . | . | . | . | . | . | 2022-04-07 03:39:28 normalization > 1:/* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.kl_lists"} */ 2022-04-07 03:39:28 normalization > 2: 2022-04-07 03:39:28 normalization > 3: 2022-04-07 03:39:28 normalization > 4: create or replace table `nhg-dw`.airbyte_new.`kl_lists` 2022-04-07 03:39:28 normalization > 5: partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-04-07 03:39:28 normalization > 6: cluster by _airbyte_emitted_at 2022-04-07 03:39:28 normalization > 7: OPTIONS() 2022-04-07 03:39:28 normalization > 8: as ( 2022-04-07 03:39:28 normalization > 9: 2022-04-07 03:39:28 normalization > 10:with __dbt__cte__kl_lists_ab1 as ( 2022-04-07 03:39:28 normalization > 11: 2022-04-07 03:39:28 normalization > 12:-- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-04-07 03:39:28 normalization > 13:-- depends_on: `nhg-dw`.airbyte_new._airbyte_raw_kl_lists 2022-04-07 03:39:28 normalization > 14:select 2022-04-07 03:39:28 normalization > 15: json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-04-07 03:39:28 normalization > 16: json_extract_scalar(_airbyte_data, "$['name']") as name, 2022-04-07 03:39:28 normalization > 17: json_extract_scalar(_airbyte_data, "$['folder']") as folder, 2022-04-07 03:39:28 normalization > 18: json_extract_scalar(_airbyte_data, "$['object']") as object, 2022-04-07 03:39:28 normalization > 19: json_extract_scalar(_airbyte_data, "$['created']") as created, 2022-04-07 03:39:28 normalization > 20: json_extract_scalar(_airbyte_data, "$['updated']") as updated, 2022-04-07 03:39:28 normalization > 21: json_extract_scalar(_airbyte_data, "$['list_type']") as list_type, 2022-04-07 03:39:28 normalization > 22: json_extract_scalar(_airbyte_data, "$['person_count']") as person_count, 2022-04-07 03:39:28 normalization > 23: _airbyte_ab_id, 2022-04-07 03:39:28 normalization > 24: _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > 25: CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:28 normalization > 26:from `nhg-dw`.airbyte_new._airbyte_raw_kl_lists as table_alias 2022-04-07 03:39:28 normalization > 27:-- kl_lists 2022-04-07 03:39:28 normalization > 28:where 1 = 1 2022-04-07 03:39:28 normalization > 29: 2022-04-07 03:39:28 normalization > 30:), __dbt__cte__kl_lists_ab2 as ( 2022-04-07 03:39:28 normalization > 31: 2022-04-07 03:39:28 normalization > 32:-- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-04-07 03:39:28 normalization > 33:-- depends_on: __dbt__cte__kl_lists_ab1 2022-04-07 03:39:28 normalization > 34:select 2022-04-07 03:39:28 normalization > 35: cast(id as 2022-04-07 03:39:28 normalization > 36: string 2022-04-07 03:39:28 normalization > 37:) as id, 2022-04-07 03:39:28 normalization > 38: cast(name as 2022-04-07 03:39:28 normalization > 39: string 2022-04-07 03:39:28 normalization > 40:) as name, 2022-04-07 03:39:28 normalization > 41: cast(folder as 2022-04-07 03:39:28 normalization > 42: string 2022-04-07 03:39:28 normalization > 43:) as folder, 2022-04-07 03:39:28 normalization > 44: cast(object as 2022-04-07 03:39:28 normalization > 45: string 2022-04-07 03:39:28 normalization > 46:) as object, 2022-04-07 03:39:28 normalization > 47: cast(nullif(created, '') as 2022-04-07 03:39:28 normalization > 48: timestamp 2022-04-07 03:39:28 normalization > 49:) as created, 2022-04-07 03:39:28 normalization > 50: cast(nullif(updated, '') as 2022-04-07 03:39:28 normalization > 51: timestamp 2022-04-07 03:39:28 normalization > 52:) as updated, 2022-04-07 03:39:28 normalization > 53: cast(list_type as 2022-04-07 03:39:28 normalization > 54: string 2022-04-07 03:39:28 normalization > 55:) as list_type, 2022-04-07 03:39:28 normalization > 56: cast(person_count as 2022-04-07 03:39:28 normalization > 57: int64 2022-04-07 03:39:28 normalization > 58:) as person_count, 2022-04-07 03:39:28 normalization > 59: _airbyte_ab_id, 2022-04-07 03:39:28 normalization > 60: _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > 61: CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:28 normalization > 62:from __dbt__cte__kl_lists_ab1 2022-04-07 03:39:28 normalization > 63:-- kl_lists 2022-04-07 03:39:28 normalization > 64:where 1 = 1 2022-04-07 03:39:28 normalization > 65: 2022-04-07 03:39:28 normalization > 66:), __dbt__cte__kl_lists_ab3 as ( 2022-04-07 03:39:28 normalization > 67: 2022-04-07 03:39:28 normalization > 68:-- SQL model to build a hash column based on the values of this record 2022-04-07 03:39:28 normalization > 69:-- depends_on: __dbt__cte__kl_lists_ab2 2022-04-07 03:39:28 normalization > 70:select 2022-04-07 03:39:28 normalization > 71: to_hex(md5(cast(concat(coalesce(cast(id as 2022-04-07 03:39:28 normalization > 72: string 2022-04-07 03:39:28 normalization > 73:), ''), '-', coalesce(cast(name as 2022-04-07 03:39:28 normalization > 74: string 2022-04-07 03:39:28 normalization > 75:), ''), '-', coalesce(cast(folder as 2022-04-07 03:39:28 normalization > 76: string 2022-04-07 03:39:28 normalization > 77:), ''), '-', coalesce(cast(object as 2022-04-07 03:39:28 normalization > 78: string 2022-04-07 03:39:28 normalization > 79:), ''), '-', coalesce(cast(created as 2022-04-07 03:39:28 normalization > 80: string 2022-04-07 03:39:28 normalization > 81:), ''), '-', coalesce(cast(updated as 2022-04-07 03:39:28 normalization > 82: string 2022-04-07 03:39:28 normalization > 83:), ''), '-', coalesce(cast(list_type as 2022-04-07 03:39:28 normalization > 84: string 2022-04-07 03:39:28 normalization > 85:), ''), '-', coalesce(cast(person_count as 2022-04-07 03:39:28 normalization > 86: string 2022-04-07 03:39:28 normalization > 87:), '')) as 2022-04-07 03:39:28 normalization > 88: string 2022-04-07 03:39:28 normalization > 89:))) as _airbyte_kl_lists_hashid, 2022-04-07 03:39:28 normalization > 90: tmp.* 2022-04-07 03:39:28 normalization > 91:from __dbt__cte__kl_lists_ab2 tmp 2022-04-07 03:39:28 normalization > 92:-- kl_lists 2022-04-07 03:39:28 normalization > 93:where 1 = 1 2022-04-07 03:39:28 normalization > 94: 2022-04-07 03:39:28 normalization > 95:)-- Final base SQL model 2022-04-07 03:39:28 normalization > 96:-- depends_on: __dbt__cte__kl_lists_ab3 2022-04-07 03:39:28 normalization > 97:select 2022-04-07 03:39:28 normalization > 98: id, 2022-04-07 03:39:28 normalization > 99: name, 2022-04-07 03:39:28 normalization > 100: folder, 2022-04-07 03:39:28 normalization > 101: object, 2022-04-07 03:39:28 normalization > 102: created, 2022-04-07 03:39:28 normalization > 103: updated, 2022-04-07 03:39:28 normalization > 104: list_type, 2022-04-07 03:39:28 normalization > 105: person_count, 2022-04-07 03:39:28 normalization > 106: _airbyte_ab_id, 2022-04-07 03:39:28 normalization > 107: _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > 108: CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-04-07 03:39:28 normalization > 109: _airbyte_kl_lists_hashid 2022-04-07 03:39:28 normalization > 110:from __dbt__cte__kl_lists_ab3 2022-04-07 03:39:28 normalization > 111:-- kl_lists from `nhg-dw`.airbyte_new._airbyte_raw_kl_lists 2022-04-07 03:39:28 normalization > 112:where 1 = 1 2022-04-07 03:39:28 normalization > 113: 2022-04-07 03:39:28 normalization > 114: ); 2022-04-07 03:39:28 normalization > 115: 2022-04-07 03:39:28 normalization > | . | . | . | . | . | . | . | . | . | . | . | . | . | 2022-04-07 03:39:28 normalization > 03:39:22.589987 [debug] [Thread-4 ]: finished collecting timing info 2022-04-07 03:39:28 normalization > 03:39:22.590665 [debug] [Thread-7 ]: Runtime Error in model kl_global_exclusions (models/generated/airbyte_incremental/airbyte_new/kl_global_exclusions.sql) 2022-04-07 03:39:28 normalization > 404 Not found: Table nhg-dw:airbyte_new._airbyte_raw_kl_global_exclusions was not found in location europe-west4 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > (job ID: 75fcb30d-2c58-4771-8701-3c00fd823bb0) 2022-04-07 03:39:28 normalization > 03:39:22.591128 [debug] [Thread-3 ]: finished collecting timing info 2022-04-07 03:39:28 normalization > 03:39:22.591802 [debug] [Thread-4 ]: Runtime Error in model kl_metrics (models/generated/airbyte_incremental/airbyte_new/kl_metrics.sql) 2022-04-07 03:39:28 normalization > 404 Not found: Table nhg-dw:airbyte_new._airbyte_raw_kl_metrics was not found in location europe-west4 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > (job ID: dc2b6095-6bfd-45de-bda2-7bb244eb8c3c) 2022-04-07 03:39:28 normalization > 03:39:22.592572 [error] [Thread-7 ]: 5 of 8 ERROR creating incremental model airbyte_new.kl_global_exclusions................................................ [ERROR in 1.55s] 2022-04-07 03:39:28 normalization > 03:39:22.593346 [debug] [Thread-3 ]: Runtime Error in model kl_lists (models/generated/airbyte_incremental/airbyte_new/kl_lists.sql) 2022-04-07 03:39:28 normalization > 404 Not found: Table nhg-dw:airbyte_new._airbyte_raw_kl_lists was not found in location europe-west4 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > (job ID: effb1025-b146-462e-909b-47da7433f2a3) 2022-04-07 03:39:28 normalization > 03:39:22.594023 [debug] [Thread-2 ]: BigQuery adapter: Unhandled error while running: 2022-04-07 03:39:28 normalization > /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.kl_campaigns"} */ 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > create or replace table `nhg-dw`.airbyte_new.`kl_campaigns` 2022-04-07 03:39:28 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-04-07 03:39:28 normalization > cluster by _airbyte_emitted_at 2022-04-07 03:39:28 normalization > OPTIONS() 2022-04-07 03:39:28 normalization > as ( 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > with __dbt__cte__kl_campaigns_ab1 as ( 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-04-07 03:39:28 normalization > -- depends_on: `nhg-dw`.airbyte_new._airbyte_raw_kl_campaigns 2022-04-07 03:39:28 normalization > select 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['name']") as name, 2022-04-07 03:39:28 normalization > json_extract_array(_airbyte_data, "$['lists']") as lists, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['object']") as object, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['status']") as status, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['created']") as created, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['sent_at']") as sent_at, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['subject']") as subject, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['updated']") as updated, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['from_name']") as from_name, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['send_time']") as send_time, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['status_id']") as status_id, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['from_email']") as from_email, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['template_id']") as template_id, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['is_segmented']") as is_segmented, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['message_type']") as message_type, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['status_label']") as status_label, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['campaign_type']") as campaign_type, 2022-04-07 03:39:28 normalization > json_extract_array(_airbyte_data, "$['excluded_lists']") as excluded_lists, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['num_recipients']") as num_recipients, 2022-04-07 03:39:28 normalization > _airbyte_ab_id, 2022-04-07 03:39:28 normalization > _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:28 normalization > from `nhg-dw`.airbyte_new._airbyte_raw_kl_campaigns as table_alias 2022-04-07 03:39:28 normalization > -- kl_campaigns 2022-04-07 03:39:28 normalization > where 1 = 1 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > ), __dbt__cte__kl_campaigns_ab2 as ( 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-04-07 03:39:28 normalization > -- depends_on: __dbt__cte__kl_campaigns_ab1 2022-04-07 03:39:28 normalization > select 2022-04-07 03:39:28 normalization > cast(id as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as id, 2022-04-07 03:39:28 normalization > cast(name as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as name, 2022-04-07 03:39:28 normalization > lists, 2022-04-07 03:39:28 normalization > cast(object as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as object, 2022-04-07 03:39:28 normalization > cast(status as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as status, 2022-04-07 03:39:28 normalization > cast(nullif(created, '') as 2022-04-07 03:39:28 normalization > timestamp 2022-04-07 03:39:28 normalization > ) as created, 2022-04-07 03:39:28 normalization > cast(nullif(sent_at, '') as 2022-04-07 03:39:28 normalization > timestamp 2022-04-07 03:39:28 normalization > ) as sent_at, 2022-04-07 03:39:28 normalization > cast(subject as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as subject, 2022-04-07 03:39:28 normalization > cast(nullif(updated, '') as 2022-04-07 03:39:28 normalization > timestamp 2022-04-07 03:39:28 normalization > ) as updated, 2022-04-07 03:39:28 normalization > cast(from_name as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as from_name, 2022-04-07 03:39:28 normalization > cast(nullif(send_time, '') as 2022-04-07 03:39:28 normalization > timestamp 2022-04-07 03:39:28 normalization > ) as send_time, 2022-04-07 03:39:28 normalization > cast(status_id as 2022-04-07 03:39:28 normalization > int64 2022-04-07 03:39:28 normalization > ) as status_id, 2022-04-07 03:39:28 normalization > cast(from_email as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as from_email, 2022-04-07 03:39:28 normalization > cast(template_id as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as template_id, 2022-04-07 03:39:28 normalization > cast(is_segmented as boolean) as is_segmented, 2022-04-07 03:39:28 normalization > cast(message_type as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as message_type, 2022-04-07 03:39:28 normalization > cast(status_label as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as status_label, 2022-04-07 03:39:28 normalization > cast(campaign_type as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as campaign_type, 2022-04-07 03:39:28 normalization > excluded_lists, 2022-04-07 03:39:28 normalization > cast(num_recipients as 2022-04-07 03:39:28 normalization > int64 2022-04-07 03:39:28 normalization > ) as num_recipients, 2022-04-07 03:39:28 normalization > _airbyte_ab_id, 2022-04-07 03:39:28 normalization > _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:28 normalization > from __dbt__cte__kl_campaigns_ab1 2022-04-07 03:39:28 normalization > -- kl_campaigns 2022-04-07 03:39:28 normalization > where 1 = 1 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > ), __dbt__cte__kl_campaigns_ab3 as ( 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > -- SQL model to build a hash column based on the values of this record 2022-04-07 03:39:28 normalization > -- depends_on: __dbt__cte__kl_campaigns_ab2 2022-04-07 03:39:28 normalization > select 2022-04-07 03:39:28 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(name as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(array_to_string(lists, "|", "") as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(object as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(status as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(created as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(sent_at as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(subject as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(updated as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(from_name as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(send_time as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(status_id as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(from_email as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(template_id as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(is_segmented as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(message_type as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(status_label as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(campaign_type as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(array_to_string(excluded_lists, "|", "") as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(num_recipients as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), '')) as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ))) as _airbyte_kl_campaigns_hashid, 2022-04-07 03:39:28 normalization > tmp.* 2022-04-07 03:39:28 normalization > from __dbt__cte__kl_campaigns_ab2 tmp 2022-04-07 03:39:28 normalization > -- kl_campaigns 2022-04-07 03:39:28 normalization > where 1 = 1 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > )-- Final base SQL model 2022-04-07 03:39:28 normalization > -- depends_on: __dbt__cte__kl_campaigns_ab3 2022-04-07 03:39:28 normalization > select 2022-04-07 03:39:28 normalization > id, 2022-04-07 03:39:28 normalization > name, 2022-04-07 03:39:28 normalization > lists, 2022-04-07 03:39:28 normalization > object, 2022-04-07 03:39:28 normalization > status, 2022-04-07 03:39:28 normalization > created, 2022-04-07 03:39:28 normalization > sent_at, 2022-04-07 03:39:28 normalization > subject, 2022-04-07 03:39:28 normalization > updated, 2022-04-07 03:39:28 normalization > from_name, 2022-04-07 03:39:28 normalization > send_time, 2022-04-07 03:39:28 normalization > status_id, 2022-04-07 03:39:28 normalization > from_email, 2022-04-07 03:39:28 normalization > template_id, 2022-04-07 03:39:28 normalization > is_segmented, 2022-04-07 03:39:28 normalization > message_type, 2022-04-07 03:39:28 normalization > status_label, 2022-04-07 03:39:28 normalization > campaign_type, 2022-04-07 03:39:28 normalization > excluded_lists, 2022-04-07 03:39:28 normalization > num_recipients, 2022-04-07 03:39:28 normalization > _airbyte_ab_id, 2022-04-07 03:39:28 normalization > _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-04-07 03:39:28 normalization > _airbyte_kl_campaigns_hashid 2022-04-07 03:39:28 normalization > from __dbt__cte__kl_campaigns_ab3 2022-04-07 03:39:28 normalization > -- kl_campaigns from `nhg-dw`.airbyte_new._airbyte_raw_kl_campaigns 2022-04-07 03:39:28 normalization > where 1 = 1 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > ); 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > 03:39:22.594623 [error] [Thread-4 ]: 1 of 8 ERROR creating incremental model airbyte_new.kl_metrics.......................................................... [ERROR in 1.56s] 2022-04-07 03:39:28 normalization > 03:39:22.595706 [error] [Thread-3 ]: 2 of 8 ERROR creating incremental model airbyte_new.kl_lists............................................................ [ERROR in 1.56s] 2022-04-07 03:39:28 normalization > 03:39:22.596655 [debug] [Thread-8 ]: BigQuery adapter: Unhandled error while running: 2022-04-07 03:39:28 normalization > /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.kl_events"} */ 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > create or replace table `nhg-dw`.airbyte_new.`kl_events` 2022-04-07 03:39:28 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-04-07 03:39:28 normalization > cluster by _airbyte_emitted_at 2022-04-07 03:39:28 normalization > OPTIONS() 2022-04-07 03:39:28 normalization > as ( 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > with __dbt__cte__kl_events_ab1 as ( 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-04-07 03:39:28 normalization > -- depends_on: `nhg-dw`.airbyte_new._airbyte_raw_kl_events 2022-04-07 03:39:28 normalization > select 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['uuid']") as uuid, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['object']") as object, 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > json_extract(table_alias._airbyte_data, "$['person']") 2022-04-07 03:39:28 normalization > as person, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['datetime']") as datetime, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['timestamp']") as timestamp, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['event_name']") as event_name, 2022-04-07 03:39:28 normalization > json_extract_scalar(_airbyte_data, "$['statistic_id']") as statistic_id, 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > json_extract(table_alias._airbyte_data, "$['event_properties']") 2022-04-07 03:39:28 normalization > as event_properties, 2022-04-07 03:39:28 normalization > _airbyte_ab_id, 2022-04-07 03:39:28 normalization > _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:28 normalization > from `nhg-dw`.airbyte_new._airbyte_raw_kl_events as table_alias 2022-04-07 03:39:28 normalization > -- kl_events 2022-04-07 03:39:28 normalization > where 1 = 1 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > ), __dbt__cte__kl_events_ab2 as ( 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-04-07 03:39:28 normalization > -- depends_on: __dbt__cte__kl_events_ab1 2022-04-07 03:39:28 normalization > select 2022-04-07 03:39:28 normalization > cast(id as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as id, 2022-04-07 03:39:28 normalization > cast(uuid as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as uuid, 2022-04-07 03:39:28 normalization > cast(object as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as object, 2022-04-07 03:39:28 normalization > cast(person as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as person, 2022-04-07 03:39:28 normalization > cast(datetime as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as datetime, 2022-04-07 03:39:28 normalization > cast(timestamp as 2022-04-07 03:39:28 normalization > int64 2022-04-07 03:39:28 normalization > ) as timestamp, 2022-04-07 03:39:28 normalization > cast(event_name as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as event_name, 2022-04-07 03:39:28 normalization > cast(statistic_id as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as statistic_id, 2022-04-07 03:39:28 normalization > cast(event_properties as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ) as event_properties, 2022-04-07 03:39:28 normalization > _airbyte_ab_id, 2022-04-07 03:39:28 normalization > _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:28 normalization > from __dbt__cte__kl_events_ab1 2022-04-07 03:39:28 normalization > -- kl_events 2022-04-07 03:39:28 normalization > where 1 = 1 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > ), __dbt__cte__kl_events_ab3 as ( 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > -- SQL model to build a hash column based on the values of this record 2022-04-07 03:39:28 normalization > -- depends_on: __dbt__cte__kl_events_ab2 2022-04-07 03:39:28 normalization > select 2022-04-07 03:39:28 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(uuid as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(object as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(person as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(datetime as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(timestamp as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(event_name as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(statistic_id as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), ''), '-', coalesce(cast(event_properties as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ), '')) as 2022-04-07 03:39:28 normalization > string 2022-04-07 03:39:28 normalization > ))) as _airbyte_kl_events_hashid, 2022-04-07 03:39:28 normalization > tmp.* 2022-04-07 03:39:28 normalization > from __dbt__cte__kl_events_ab2 tmp 2022-04-07 03:39:28 normalization > -- kl_events 2022-04-07 03:39:28 normalization > where 1 = 1 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > )-- Final base SQL model 2022-04-07 03:39:28 normalization > -- depends_on: __dbt__cte__kl_events_ab3 2022-04-07 03:39:28 normalization > select 2022-04-07 03:39:28 normalization > id, 2022-04-07 03:39:28 normalization > uuid, 2022-04-07 03:39:28 normalization > object, 2022-04-07 03:39:28 normalization > person, 2022-04-07 03:39:28 normalization > datetime, 2022-04-07 03:39:28 normalization > timestamp, 2022-04-07 03:39:28 normalization > event_name, 2022-04-07 03:39:28 normalization > statistic_id, 2022-04-07 03:39:28 normalization > event_properties, 2022-04-07 03:39:28 normalization > _airbyte_ab_id, 2022-04-07 03:39:28 normalization > _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-04-07 03:39:28 normalization > _airbyte_kl_events_hashid 2022-04-07 03:39:28 normalization > from __dbt__cte__kl_events_ab3 2022-04-07 03:39:28 normalization > -- kl_events from `nhg-dw`.airbyte_new._airbyte_raw_kl_events 2022-04-07 03:39:28 normalization > where 1 = 1 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > ); 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > 03:39:22.597147 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.kl_global_exclusions 2022-04-07 03:39:28 normalization > 03:39:22.597503 [debug] [Thread-2 ]: BigQuery adapter: 404 Not found: Table nhg-dw:airbyte_new._airbyte_raw_kl_campaigns was not found in location europe-west4 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > (job ID: 74c78b8d-3a0b-4595-a4ad-5e3de0a2e38d) 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > -----Query Job SQL Follows----- 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > | . | . | . | . | . | . | . | . | . | . | . | . | . | . | 2022-04-07 03:39:28 normalization > 1:/* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.kl_campaigns"} */ 2022-04-07 03:39:28 normalization > 2: 2022-04-07 03:39:28 normalization > 3: 2022-04-07 03:39:28 normalization > 4: create or replace table `nhg-dw`.airbyte_new.`kl_campaigns` 2022-04-07 03:39:28 normalization > 5: partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-04-07 03:39:28 normalization > 6: cluster by _airbyte_emitted_at 2022-04-07 03:39:28 normalization > 7: OPTIONS() 2022-04-07 03:39:28 normalization > 8: as ( 2022-04-07 03:39:28 normalization > 9: 2022-04-07 03:39:28 normalization > 10:with __dbt__cte__kl_campaigns_ab1 as ( 2022-04-07 03:39:28 normalization > 11: 2022-04-07 03:39:28 normalization > 12:-- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-04-07 03:39:28 normalization > 13:-- depends_on: `nhg-dw`.airbyte_new._airbyte_raw_kl_campaigns 2022-04-07 03:39:28 normalization > 14:select 2022-04-07 03:39:28 normalization > 15: json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-04-07 03:39:28 normalization > 16: json_extract_scalar(_airbyte_data, "$['name']") as name, 2022-04-07 03:39:28 normalization > 17: json_extract_array(_airbyte_data, "$['lists']") as lists, 2022-04-07 03:39:28 normalization > 18: json_extract_scalar(_airbyte_data, "$['object']") as object, 2022-04-07 03:39:28 normalization > 19: json_extract_scalar(_airbyte_data, "$['status']") as status, 2022-04-07 03:39:28 normalization > 20: json_extract_scalar(_airbyte_data, "$['created']") as created, 2022-04-07 03:39:28 normalization > 21: json_extract_scalar(_airbyte_data, "$['sent_at']") as sent_at, 2022-04-07 03:39:28 normalization > 22: json_extract_scalar(_airbyte_data, "$['subject']") as subject, 2022-04-07 03:39:28 normalization > 23: json_extract_scalar(_airbyte_data, "$['updated']") as updated, 2022-04-07 03:39:28 normalization > 24: json_extract_scalar(_airbyte_data, "$['from_name']") as from_name, 2022-04-07 03:39:28 normalization > 25: json_extract_scalar(_airbyte_data, "$['send_time']") as send_time, 2022-04-07 03:39:28 normalization > 26: json_extract_scalar(_airbyte_data, "$['status_id']") as status_id, 2022-04-07 03:39:28 normalization > 27: json_extract_scalar(_airbyte_data, "$['from_email']") as from_email, 2022-04-07 03:39:28 normalization > 28: json_extract_scalar(_airbyte_data, "$['template_id']") as template_id, 2022-04-07 03:39:28 normalization > 29: json_extract_scalar(_airbyte_data, "$['is_segmented']") as is_segmented, 2022-04-07 03:39:28 normalization > 30: json_extract_scalar(_airbyte_data, "$['message_type']") as message_type, 2022-04-07 03:39:28 normalization > 31: json_extract_scalar(_airbyte_data, "$['status_label']") as status_label, 2022-04-07 03:39:28 normalization > 32: json_extract_scalar(_airbyte_data, "$['campaign_type']") as campaign_type, 2022-04-07 03:39:28 normalization > 33: json_extract_array(_airbyte_data, "$['excluded_lists']") as excluded_lists, 2022-04-07 03:39:28 normalization > 34: json_extract_scalar(_airbyte_data, "$['num_recipients']") as num_recipients, 2022-04-07 03:39:28 normalization > 35: _airbyte_ab_id, 2022-04-07 03:39:28 normalization > 36: _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > 37: CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:28 normalization > 38:from `nhg-dw`.airbyte_new._airbyte_raw_kl_campaigns as table_alias 2022-04-07 03:39:28 normalization > 39:-- kl_campaigns 2022-04-07 03:39:28 normalization > 40:where 1 = 1 2022-04-07 03:39:28 normalization > 41: 2022-04-07 03:39:28 normalization > 42:), __dbt__cte__kl_campaigns_ab2 as ( 2022-04-07 03:39:28 normalization > 43: 2022-04-07 03:39:28 normalization > 44:-- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-04-07 03:39:28 normalization > 45:-- depends_on: __dbt__cte__kl_campaigns_ab1 2022-04-07 03:39:28 normalization > 46:select 2022-04-07 03:39:28 normalization > 47: cast(id as 2022-04-07 03:39:28 normalization > 48: string 2022-04-07 03:39:28 normalization > 49:) as id, 2022-04-07 03:39:28 normalization > 50: cast(name as 2022-04-07 03:39:28 normalization > 51: string 2022-04-07 03:39:28 normalization > 52:) as name, 2022-04-07 03:39:28 normalization > 53: lists, 2022-04-07 03:39:28 normalization > 54: cast(object as 2022-04-07 03:39:28 normalization > 55: string 2022-04-07 03:39:28 normalization > 56:) as object, 2022-04-07 03:39:28 normalization > 57: cast(status as 2022-04-07 03:39:28 normalization > 58: string 2022-04-07 03:39:28 normalization > 59:) as status, 2022-04-07 03:39:28 normalization > 60: cast(nullif(created, '') as 2022-04-07 03:39:28 normalization > 61: timestamp 2022-04-07 03:39:28 normalization > 62:) as created, 2022-04-07 03:39:28 normalization > 63: cast(nullif(sent_at, '') as 2022-04-07 03:39:28 normalization > 64: timestamp 2022-04-07 03:39:28 normalization > 65:) as sent_at, 2022-04-07 03:39:28 normalization > 66: cast(subject as 2022-04-07 03:39:28 normalization > 67: string 2022-04-07 03:39:28 normalization > 68:) as subject, 2022-04-07 03:39:28 normalization > 69: cast(nullif(updated, '') as 2022-04-07 03:39:28 normalization > 70: timestamp 2022-04-07 03:39:28 normalization > 71:) as updated, 2022-04-07 03:39:28 normalization > 72: cast(from_name as 2022-04-07 03:39:28 normalization > 73: string 2022-04-07 03:39:28 normalization > 74:) as from_name, 2022-04-07 03:39:28 normalization > 75: cast(nullif(send_time, '') as 2022-04-07 03:39:28 normalization > 76: timestamp 2022-04-07 03:39:28 normalization > 77:) as send_time, 2022-04-07 03:39:28 normalization > 78: cast(status_id as 2022-04-07 03:39:28 normalization > 79: int64 2022-04-07 03:39:28 normalization > 80:) as status_id, 2022-04-07 03:39:28 normalization > 81: cast(from_email as 2022-04-07 03:39:28 normalization > 82: string 2022-04-07 03:39:28 normalization > 83:) as from_email, 2022-04-07 03:39:28 normalization > 84: cast(template_id as 2022-04-07 03:39:28 normalization > 85: string 2022-04-07 03:39:28 normalization > 86:) as template_id, 2022-04-07 03:39:28 normalization > 87: cast(is_segmented as boolean) as is_segmented, 2022-04-07 03:39:28 normalization > 88: cast(message_type as 2022-04-07 03:39:28 normalization > 89: string 2022-04-07 03:39:28 normalization > 90:) as message_type, 2022-04-07 03:39:28 normalization > 91: cast(status_label as 2022-04-07 03:39:28 normalization > 92: string 2022-04-07 03:39:28 normalization > 93:) as status_label, 2022-04-07 03:39:28 normalization > 94: cast(campaign_type as 2022-04-07 03:39:28 normalization > 95: string 2022-04-07 03:39:28 normalization > 96:) as campaign_type, 2022-04-07 03:39:28 normalization > 97: excluded_lists, 2022-04-07 03:39:28 normalization > 98: cast(num_recipients as 2022-04-07 03:39:28 normalization > 99: int64 2022-04-07 03:39:28 normalization > 100:) as num_recipients, 2022-04-07 03:39:28 normalization > 101: _airbyte_ab_id, 2022-04-07 03:39:28 normalization > 102: _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > 103: CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:28 normalization > 104:from __dbt__cte__kl_campaigns_ab1 2022-04-07 03:39:28 normalization > 105:-- kl_campaigns 2022-04-07 03:39:28 normalization > 106:where 1 = 1 2022-04-07 03:39:28 normalization > 107: 2022-04-07 03:39:28 normalization > 108:), __dbt__cte__kl_campaigns_ab3 as ( 2022-04-07 03:39:28 normalization > 109: 2022-04-07 03:39:28 normalization > 110:-- SQL model to build a hash column based on the values of this record 2022-04-07 03:39:28 normalization > 111:-- depends_on: __dbt__cte__kl_campaigns_ab2 2022-04-07 03:39:28 normalization > 112:select 2022-04-07 03:39:28 normalization > 113: to_hex(md5(cast(concat(coalesce(cast(id as 2022-04-07 03:39:28 normalization > 114: string 2022-04-07 03:39:28 normalization > 115:), ''), '-', coalesce(cast(name as 2022-04-07 03:39:28 normalization > 116: string 2022-04-07 03:39:28 normalization > 117:), ''), '-', coalesce(cast(array_to_string(lists, "|", "") as 2022-04-07 03:39:28 normalization > 118: string 2022-04-07 03:39:28 normalization > 119:), ''), '-', coalesce(cast(object as 2022-04-07 03:39:28 normalization > 120: string 2022-04-07 03:39:28 normalization > 121:), ''), '-', coalesce(cast(status as 2022-04-07 03:39:28 normalization > 122: string 2022-04-07 03:39:28 normalization > 123:), ''), '-', coalesce(cast(created as 2022-04-07 03:39:28 normalization > 124: string 2022-04-07 03:39:28 normalization > 125:), ''), '-', coalesce(cast(sent_at as 2022-04-07 03:39:28 normalization > 126: string 2022-04-07 03:39:28 normalization > 127:), ''), '-', coalesce(cast(subject as 2022-04-07 03:39:28 normalization > 128: string 2022-04-07 03:39:28 normalization > 129:), ''), '-', coalesce(cast(updated as 2022-04-07 03:39:28 normalization > 130: string 2022-04-07 03:39:28 normalization > 131:), ''), '-', coalesce(cast(from_name as 2022-04-07 03:39:28 normalization > 132: string 2022-04-07 03:39:28 normalization > 133:), ''), '-', coalesce(cast(send_time as 2022-04-07 03:39:28 normalization > 134: string 2022-04-07 03:39:28 normalization > 135:), ''), '-', coalesce(cast(status_id as 2022-04-07 03:39:28 normalization > 136: string 2022-04-07 03:39:28 normalization > 137:), ''), '-', coalesce(cast(from_email as 2022-04-07 03:39:28 normalization > 138: string 2022-04-07 03:39:28 normalization > 139:), ''), '-', coalesce(cast(template_id as 2022-04-07 03:39:28 normalization > 140: string 2022-04-07 03:39:28 normalization > 141:), ''), '-', coalesce(cast(is_segmented as 2022-04-07 03:39:28 normalization > 142: string 2022-04-07 03:39:28 normalization > 143:), ''), '-', coalesce(cast(message_type as 2022-04-07 03:39:28 normalization > 144: string 2022-04-07 03:39:28 normalization > 145:), ''), '-', coalesce(cast(status_label as 2022-04-07 03:39:28 normalization > 146: string 2022-04-07 03:39:28 normalization > 147:), ''), '-', coalesce(cast(campaign_type as 2022-04-07 03:39:28 normalization > 148: string 2022-04-07 03:39:28 normalization > 149:), ''), '-', coalesce(cast(array_to_string(excluded_lists, "|", "") as 2022-04-07 03:39:28 normalization > 150: string 2022-04-07 03:39:28 normalization > 151:), ''), '-', coalesce(cast(num_recipients as 2022-04-07 03:39:28 normalization > 152: string 2022-04-07 03:39:28 normalization > 153:), '')) as 2022-04-07 03:39:28 normalization > 154: string 2022-04-07 03:39:28 normalization > 155:))) as _airbyte_kl_campaigns_hashid, 2022-04-07 03:39:28 normalization > 156: tmp.* 2022-04-07 03:39:28 normalization > 157:from __dbt__cte__kl_campaigns_ab2 tmp 2022-04-07 03:39:28 normalization > 158:-- kl_campaigns 2022-04-07 03:39:28 normalization > 159:where 1 = 1 2022-04-07 03:39:28 normalization > 160: 2022-04-07 03:39:28 normalization > 161:)-- Final base SQL model 2022-04-07 03:39:28 normalization > 162:-- depends_on: __dbt__cte__kl_campaigns_ab3 2022-04-07 03:39:28 normalization > 163:select 2022-04-07 03:39:28 normalization > 164: id, 2022-04-07 03:39:28 normalization > 165: name, 2022-04-07 03:39:28 normalization > 166: lists, 2022-04-07 03:39:28 normalization > 167: object, 2022-04-07 03:39:28 normalization > 168: status, 2022-04-07 03:39:28 normalization > 169: created, 2022-04-07 03:39:28 normalization > 170: sent_at, 2022-04-07 03:39:28 normalization > 171: subject, 2022-04-07 03:39:28 normalization > 172: updated, 2022-04-07 03:39:28 normalization > 173: from_name, 2022-04-07 03:39:28 normalization > 174: send_time, 2022-04-07 03:39:28 normalization > 175: status_id, 2022-04-07 03:39:28 normalization > 176: from_email, 2022-04-07 03:39:28 normalization > 177: template_id, 2022-04-07 03:39:28 normalization > 178: is_segmented, 2022-04-07 03:39:28 normalization > 179: message_type, 2022-04-07 03:39:28 normalization > 180: status_label, 2022-04-07 03:39:28 normalization > 181: campaign_type, 2022-04-07 03:39:28 normalization > 182: excluded_lists, 2022-04-07 03:39:28 normalization > 183: num_recipients, 2022-04-07 03:39:28 normalization > 184: _airbyte_ab_id, 2022-04-07 03:39:28 normalization > 185: _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > 186: CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-04-07 03:39:28 normalization > 187: _airbyte_kl_campaigns_hashid 2022-04-07 03:39:28 normalization > 188:from __dbt__cte__kl_campaigns_ab3 2022-04-07 03:39:28 normalization > 189:-- kl_campaigns from `nhg-dw`.airbyte_new._airbyte_raw_kl_campaigns 2022-04-07 03:39:28 normalization > 190:where 1 = 1 2022-04-07 03:39:28 normalization > 191: 2022-04-07 03:39:28 normalization > 192: ); 2022-04-07 03:39:28 normalization > 193: 2022-04-07 03:39:28 normalization > | . | . | . | . | . | . | . | . | . | . | . | . | . | . | 2022-04-07 03:39:28 normalization > 03:39:22.598240 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.kl_metrics 2022-04-07 03:39:28 normalization > 03:39:22.599275 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.kl_lists 2022-04-07 03:39:28 normalization > 03:39:22.599706 [debug] [Thread-8 ]: BigQuery adapter: 404 Not found: Table nhg-dw:airbyte_new._airbyte_raw_kl_events was not found in location europe-west4 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > (job ID: edb2f818-832a-4aa4-b518-aa9761560a6d) 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > -----Query Job SQL Follows----- 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > | . | . | . | . | . | . | . | . | . | . | . | . | . | . | 2022-04-07 03:39:28 normalization > 1:/* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.kl_events"} */ 2022-04-07 03:39:28 normalization > 2: 2022-04-07 03:39:28 normalization > 3: 2022-04-07 03:39:28 normalization > 4: create or replace table `nhg-dw`.airbyte_new.`kl_events` 2022-04-07 03:39:28 normalization > 5: partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-04-07 03:39:28 normalization > 6: cluster by _airbyte_emitted_at 2022-04-07 03:39:28 normalization > 7: OPTIONS() 2022-04-07 03:39:28 normalization > 8: as ( 2022-04-07 03:39:28 normalization > 9: 2022-04-07 03:39:28 normalization > 10:with __dbt__cte__kl_events_ab1 as ( 2022-04-07 03:39:28 normalization > 11: 2022-04-07 03:39:28 normalization > 12:-- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-04-07 03:39:28 normalization > 13:-- depends_on: `nhg-dw`.airbyte_new._airbyte_raw_kl_events 2022-04-07 03:39:28 normalization > 14:select 2022-04-07 03:39:28 normalization > 15: json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-04-07 03:39:28 normalization > 16: json_extract_scalar(_airbyte_data, "$['uuid']") as uuid, 2022-04-07 03:39:28 normalization > 17: json_extract_scalar(_airbyte_data, "$['object']") as object, 2022-04-07 03:39:28 normalization > 18: 2022-04-07 03:39:28 normalization > 19: json_extract(table_alias._airbyte_data, "$['person']") 2022-04-07 03:39:28 normalization > 20: as person, 2022-04-07 03:39:28 normalization > 21: json_extract_scalar(_airbyte_data, "$['datetime']") as datetime, 2022-04-07 03:39:28 normalization > 22: json_extract_scalar(_airbyte_data, "$['timestamp']") as timestamp, 2022-04-07 03:39:28 normalization > 23: json_extract_scalar(_airbyte_data, "$['event_name']") as event_name, 2022-04-07 03:39:28 normalization > 24: json_extract_scalar(_airbyte_data, "$['statistic_id']") as statistic_id, 2022-04-07 03:39:28 normalization > 25: 2022-04-07 03:39:28 normalization > 26: json_extract(table_alias._airbyte_data, "$['event_properties']") 2022-04-07 03:39:28 normalization > 27: as event_properties, 2022-04-07 03:39:28 normalization > 28: _airbyte_ab_id, 2022-04-07 03:39:28 normalization > 29: _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > 30: CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:28 normalization > 31:from `nhg-dw`.airbyte_new._airbyte_raw_kl_events as table_alias 2022-04-07 03:39:28 normalization > 32:-- kl_events 2022-04-07 03:39:28 normalization > 33:where 1 = 1 2022-04-07 03:39:28 normalization > 34: 2022-04-07 03:39:28 normalization > 35:), __dbt__cte__kl_events_ab2 as ( 2022-04-07 03:39:28 normalization > 36: 2022-04-07 03:39:28 normalization > 37:-- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-04-07 03:39:28 normalization > 38:-- depends_on: __dbt__cte__kl_events_ab1 2022-04-07 03:39:28 normalization > 39:select 2022-04-07 03:39:28 normalization > 40: cast(id as 2022-04-07 03:39:28 normalization > 41: string 2022-04-07 03:39:28 normalization > 42:) as id, 2022-04-07 03:39:28 normalization > 43: cast(uuid as 2022-04-07 03:39:28 normalization > 44: string 2022-04-07 03:39:28 normalization > 45:) as uuid, 2022-04-07 03:39:28 normalization > 46: cast(object as 2022-04-07 03:39:28 normalization > 47: string 2022-04-07 03:39:28 normalization > 48:) as object, 2022-04-07 03:39:28 normalization > 49: cast(person as 2022-04-07 03:39:28 normalization > 50: string 2022-04-07 03:39:28 normalization > 51:) as person, 2022-04-07 03:39:28 normalization > 52: cast(datetime as 2022-04-07 03:39:28 normalization > 53: string 2022-04-07 03:39:28 normalization > 54:) as datetime, 2022-04-07 03:39:28 normalization > 55: cast(timestamp as 2022-04-07 03:39:28 normalization > 56: int64 2022-04-07 03:39:28 normalization > 57:) as timestamp, 2022-04-07 03:39:28 normalization > 58: cast(event_name as 2022-04-07 03:39:28 normalization > 59: string 2022-04-07 03:39:28 normalization > 60:) as event_name, 2022-04-07 03:39:28 normalization > 61: cast(statistic_id as 2022-04-07 03:39:28 normalization > 62: string 2022-04-07 03:39:28 normalization > 63:) as statistic_id, 2022-04-07 03:39:28 normalization > 64: cast(event_properties as 2022-04-07 03:39:28 normalization > 65: string 2022-04-07 03:39:28 normalization > 66:) as event_properties, 2022-04-07 03:39:28 normalization > 67: _airbyte_ab_id, 2022-04-07 03:39:28 normalization > 68: _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > 69: CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-04-07 03:39:28 normalization > 70:from __dbt__cte__kl_events_ab1 2022-04-07 03:39:28 normalization > 71:-- kl_events 2022-04-07 03:39:28 normalization > 72:where 1 = 1 2022-04-07 03:39:28 normalization > 73: 2022-04-07 03:39:28 normalization > 74:), __dbt__cte__kl_events_ab3 as ( 2022-04-07 03:39:28 normalization > 75: 2022-04-07 03:39:28 normalization > 76:-- SQL model to build a hash column based on the values of this record 2022-04-07 03:39:28 normalization > 77:-- depends_on: __dbt__cte__kl_events_ab2 2022-04-07 03:39:28 normalization > 78:select 2022-04-07 03:39:28 normalization > 79: to_hex(md5(cast(concat(coalesce(cast(id as 2022-04-07 03:39:28 normalization > 80: string 2022-04-07 03:39:28 normalization > 81:), ''), '-', coalesce(cast(uuid as 2022-04-07 03:39:28 normalization > 82: string 2022-04-07 03:39:28 normalization > 83:), ''), '-', coalesce(cast(object as 2022-04-07 03:39:28 normalization > 84: string 2022-04-07 03:39:28 normalization > 85:), ''), '-', coalesce(cast(person as 2022-04-07 03:39:28 normalization > 86: string 2022-04-07 03:39:28 normalization > 87:), ''), '-', coalesce(cast(datetime as 2022-04-07 03:39:28 normalization > 88: string 2022-04-07 03:39:28 normalization > 89:), ''), '-', coalesce(cast(timestamp as 2022-04-07 03:39:28 normalization > 90: string 2022-04-07 03:39:28 normalization > 91:), ''), '-', coalesce(cast(event_name as 2022-04-07 03:39:28 normalization > 92: string 2022-04-07 03:39:28 normalization > 93:), ''), '-', coalesce(cast(statistic_id as 2022-04-07 03:39:28 normalization > 94: string 2022-04-07 03:39:28 normalization > 95:), ''), '-', coalesce(cast(event_properties as 2022-04-07 03:39:28 normalization > 96: string 2022-04-07 03:39:28 normalization > 97:), '')) as 2022-04-07 03:39:28 normalization > 98: string 2022-04-07 03:39:28 normalization > 99:))) as _airbyte_kl_events_hashid, 2022-04-07 03:39:28 normalization > 100: tmp.* 2022-04-07 03:39:28 normalization > 101:from __dbt__cte__kl_events_ab2 tmp 2022-04-07 03:39:28 normalization > 102:-- kl_events 2022-04-07 03:39:28 normalization > 103:where 1 = 1 2022-04-07 03:39:28 normalization > 104: 2022-04-07 03:39:28 normalization > 105:)-- Final base SQL model 2022-04-07 03:39:28 normalization > 106:-- depends_on: __dbt__cte__kl_events_ab3 2022-04-07 03:39:28 normalization > 107:select 2022-04-07 03:39:28 normalization > 108: id, 2022-04-07 03:39:28 normalization > 109: uuid, 2022-04-07 03:39:28 normalization > 110: object, 2022-04-07 03:39:28 normalization > 111: person, 2022-04-07 03:39:28 normalization > 112: datetime, 2022-04-07 03:39:28 normalization > 113: timestamp, 2022-04-07 03:39:28 normalization > 114: event_name, 2022-04-07 03:39:28 normalization > 115: statistic_id, 2022-04-07 03:39:28 normalization > 116: event_properties, 2022-04-07 03:39:28 normalization > 117: _airbyte_ab_id, 2022-04-07 03:39:28 normalization > 118: _airbyte_emitted_at, 2022-04-07 03:39:28 normalization > 119: CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-04-07 03:39:28 normalization > 120: _airbyte_kl_events_hashid 2022-04-07 03:39:28 normalization > 121:from __dbt__cte__kl_events_ab3 2022-04-07 03:39:28 normalization > 122:-- kl_events from `nhg-dw`.airbyte_new._airbyte_raw_kl_events 2022-04-07 03:39:28 normalization > 123:where 1 = 1 2022-04-07 03:39:28 normalization > 124: 2022-04-07 03:39:28 normalization > 125: ); 2022-04-07 03:39:28 normalization > 126: 2022-04-07 03:39:28 normalization > | . | . | . | . | . | . | . | . | . | . | . | . | . | . | 2022-04-07 03:39:28 normalization > 03:39:22.600923 [debug] [Thread-2 ]: finished collecting timing info 2022-04-07 03:39:28 normalization > 03:39:22.601691 [debug] [Thread-1 ]: Began running node model.airbyte_utils.kl_metrics_integration_ab1 2022-04-07 03:39:28 normalization > 03:39:22.602442 [debug] [Thread-8 ]: finished collecting timing info 2022-04-07 03:39:28 normalization > 03:39:22.603116 [debug] [Thread-2 ]: Runtime Error in model kl_campaigns (models/generated/airbyte_incremental/airbyte_new/kl_campaigns.sql) 2022-04-07 03:39:28 normalization > 404 Not found: Table nhg-dw:airbyte_new._airbyte_raw_kl_campaigns was not found in location europe-west4 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > (job ID: 74c78b8d-3a0b-4595-a4ad-5e3de0a2e38d) 2022-04-07 03:39:28 normalization > 03:39:22.603546 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.kl_metrics_integration_ab1 2022-04-07 03:39:28 normalization > 03:39:22.604047 [debug] [Thread-8 ]: Runtime Error in model kl_events (models/generated/airbyte_incremental/airbyte_new/kl_events.sql) 2022-04-07 03:39:28 normalization > 404 Not found: Table nhg-dw:airbyte_new._airbyte_raw_kl_events was not found in location europe-west4 2022-04-07 03:39:28 normalization > 2022-04-07 03:39:28 normalization > (job ID: edb2f818-832a-4aa4-b518-aa9761560a6d) 2022-04-07 03:39:28 normalization > 03:39:22.604467 [error] [Thread-2 ]: 3 of 8 ERROR creating incremental model airbyte_new.kl_campaigns........................................................ [ERROR in 1.56s] 2022-04-07 03:39:28 normalization > 03:39:22.605279 [error] [Thread-8 ]: 4 of 8 ERROR creating incremental model airbyte_new.kl_events........................................................... [ERROR in 1.56s] 2022-04-07 03:39:28 normalization > 03:39:22.606314 [debug] [Thread-6 ]: Began running node model.airbyte_utils.kl_metrics_integration_ab2 2022-04-07 03:39:28 normalization > 03:39:22.607420 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.kl_metrics_integration_ab2 2022-04-07 03:39:28 normalization > 03:39:22.608174 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.kl_campaigns 2022-04-07 03:39:28 normalization > 03:39:22.609493 [debug] [Thread-2 ]: Began running node model.airbyte_utils.kl_metrics_integration_ab3 2022-04-07 03:39:28 normalization > 03:39:22.609914 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.kl_events 2022-04-07 03:39:28 normalization > 03:39:22.610237 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.kl_metrics_integration_ab3 2022-04-07 03:39:28 normalization > 03:39:22.610917 [debug] [Thread-3 ]: Began running node model.airbyte_utils.kl_campaigns_excluded_lists_ab1 2022-04-07 03:39:28 normalization > 03:39:22.611190 [debug] [Thread-5 ]: Began running node model.airbyte_utils.kl_campaigns_lists_ab1 2022-04-07 03:39:28 normalization > 03:39:22.612226 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.kl_campaigns_excluded_lists_ab1 2022-04-07 03:39:28 normalization > 03:39:22.612543 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.kl_campaigns_lists_ab1 2022-04-07 03:39:28 normalization > 03:39:22.613452 [debug] [Thread-7 ]: Began running node model.airbyte_utils.kl_metrics_integration 2022-04-07 03:39:28 normalization > 03:39:22.613662 [debug] [Thread-6 ]: Began running node model.airbyte_utils.kl_campaigns_excluded_lists_ab2 2022-04-07 03:39:28 normalization > 03:39:22.614382 [info ] [Thread-7 ]: 6 of 8 SKIP relation airbyte_new.kl_metrics_integration................................................................. [SKIP] 2022-04-07 03:39:28 normalization > 03:39:22.614811 [debug] [Thread-1 ]: Began running node model.airbyte_utils.kl_campaigns_lists_ab2 2022-04-07 03:39:28 normalization > 03:39:22.615027 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.kl_campaigns_excluded_lists_ab2 2022-04-07 03:39:28 normalization > 03:39:22.615543 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.kl_metrics_integration 2022-04-07 03:39:28 normalization > 03:39:22.615831 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.kl_campaigns_lists_ab2 2022-04-07 03:39:28 normalization > 03:39:22.616920 [debug] [Thread-1 ]: Began running node model.airbyte_utils.kl_campaigns_excluded_lists_ab3 2022-04-07 03:39:28 normalization > 03:39:22.617444 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.kl_campaigns_excluded_lists_ab3 2022-04-07 03:39:28 normalization > 03:39:22.618379 [debug] [Thread-3 ]: Began running node model.airbyte_utils.kl_campaigns_lists_ab3 2022-04-07 03:39:28 normalization > 03:39:22.618565 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.kl_campaigns_lists_ab3 2022-04-07 03:39:28 normalization > 03:39:22.618753 [debug] [Thread-3 ]: Began running node model.airbyte_utils.kl_campaigns_excluded_lists 2022-04-07 03:39:28 normalization > 03:39:22.619320 [info ] [Thread-3 ]: 7 of 8 SKIP relation airbyte_new.kl_campaigns_excluded_lists............................................................ [SKIP] 2022-04-07 03:39:28 normalization > 03:39:22.619687 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.kl_campaigns_excluded_lists 2022-04-07 03:39:28 normalization > 03:39:22.619951 [debug] [Thread-4 ]: Began running node model.airbyte_utils.kl_campaigns_lists 2022-04-07 03:39:28 normalization > 03:39:22.620528 [info ] [Thread-4 ]: 8 of 8 SKIP relation airbyte_new.kl_campaigns_lists..................................................................... [SKIP] 2022-04-07 03:39:28 normalization > 03:39:22.620979 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.kl_campaigns_lists 2022-04-07 03:39:28 normalization > 03:39:22.623213 [debug] [MainThread]: Acquiring new bigquery connection "master" 2022-04-07 03:39:28 normalization > 03:39:22.623768 [info ] [MainThread]: 2022-04-07 03:39:28 normalization > 03:39:22.624133 [info ] [MainThread]: Finished running 8 incremental models in 7.06s. 2022-04-07 03:39:28 normalization > 03:39:22.624456 [debug] [MainThread]: Connection 'master' was properly closed. 2022-04-07 03:39:28 normalization > 03:39:22.624679 [debug] [MainThread]: Connection 'model.airbyte_utils.kl_campaigns_ab3' was properly closed. 2022-04-07 03:39:28 normalization > 03:39:22.624875 [debug] [MainThread]: Connection 'model.airbyte_utils.kl_campaigns' was properly closed. 2022-04-07 03:39:28 normalization > 03:39:22.624987 [debug] [MainThread]: Connection 'model.airbyte_utils.kl_lists' was properly closed. 2022-04-07 03:39:28 normalization > 03:39:22.625096 [debug] [MainThread]: Connection 'model.airbyte_utils.kl_metrics' was properly closed. 2022-04-07 03:39:28 normalization > 03:39:22.625246 [debug] [MainThread]: Connection 'model.airbyte_utils.kl_global_exclusions_ab3' was properly closed. 2022-04-07 03:39:28 normalization > 03:39:22.625442 [debug] [MainThread]: Connection 'model.airbyte_utils.kl_global_exclusions' was properly closed. 2022-04-07 03:39:28 normalization > 03:39:22.625633 [debug] [MainThread]: Connection 'model.airbyte_utils.kl_events_ab3' was properly closed. 2022-04-07 03:39:28 normalization > 03:39:22.625779 [debug] [MainThread]: Connection 'model.airbyte_utils.kl_events' was properly closed. 2022-04-07 03:39:28 normalization > 03:39:22.641630 [info ] [MainThread]: 2022-04-07 03:39:28 normalization > 03:39:22.641940 [info ] [MainThread]: Completed with 5 errors and 0 warnings: 2022-04-07 03:39:28 normalization > 03:39:22.642338 [info ] [MainThread]: 2022-04-07 03:39:28 normalization > 03:39:22.642665 [error] [MainThread]: Runtime Error in model kl_global_exclusions (models/generated/airbyte_incremental/airbyte_new/kl_global_exclusions.sql) 2022-04-07 03:39:28 normalization > 03:39:22.643008 [error] [MainThread]: 404 Not found: Table nhg-dw:airbyte_new._airbyte_raw_kl_global_exclusions was not found in location europe-west4 2022-04-07 03:39:28 normalization > 03:39:22.643366 [error] [MainThread]: 2022-04-07 03:39:28 normalization > 03:39:22.643733 [error] [MainThread]: (job ID: 75fcb30d-2c58-4771-8701-3c00fd823bb0) 2022-04-07 03:39:28 normalization > 03:39:22.644149 [info ] [MainThread]: 2022-04-07 03:39:28 normalization > 03:39:22.644583 [error] [MainThread]: Runtime Error in model kl_metrics (models/generated/airbyte_incremental/airbyte_new/kl_metrics.sql) 2022-04-07 03:39:28 normalization > 03:39:22.645014 [error] [MainThread]: 404 Not found: Table nhg-dw:airbyte_new._airbyte_raw_kl_metrics was not found in location europe-west4 2022-04-07 03:39:28 normalization > 03:39:22.645347 [error] [MainThread]: 2022-04-07 03:39:28 normalization > 03:39:22.645636 [error] [MainThread]: (job ID: dc2b6095-6bfd-45de-bda2-7bb244eb8c3c) 2022-04-07 03:39:28 normalization > 03:39:22.645974 [info ] [MainThread]: 2022-04-07 03:39:28 normalization > 03:39:22.646361 [error] [MainThread]: Runtime Error in model kl_lists (models/generated/airbyte_incremental/airbyte_new/kl_lists.sql) 2022-04-07 03:39:28 normalization > 03:39:22.646825 [error] [MainThread]: 404 Not found: Table nhg-dw:airbyte_new._airbyte_raw_kl_lists was not found in location europe-west4 2022-04-07 03:39:28 normalization > 03:39:22.647303 [error] [MainThread]: 2022-04-07 03:39:28 normalization > 03:39:22.647726 [error] [MainThread]: (job ID: effb1025-b146-462e-909b-47da7433f2a3) 2022-04-07 03:39:28 normalization > 03:39:22.648076 [info ] [MainThread]: 2022-04-07 03:39:28 normalization > 03:39:22.648418 [error] [MainThread]: Runtime Error in model kl_campaigns (models/generated/airbyte_incremental/airbyte_new/kl_campaigns.sql) 2022-04-07 03:39:28 normalization > 03:39:22.648866 [error] [MainThread]: 404 Not found: Table nhg-dw:airbyte_new._airbyte_raw_kl_campaigns was not found in location europe-west4 2022-04-07 03:39:28 normalization > 03:39:22.649269 [error] [MainThread]: 2022-04-07 03:39:28 normalization > 03:39:22.649664 [error] [MainThread]: (job ID: 74c78b8d-3a0b-4595-a4ad-5e3de0a2e38d) 2022-04-07 03:39:28 normalization > 03:39:22.650036 [info ] [MainThread]: 2022-04-07 03:39:28 normalization > 03:39:22.650415 [error] [MainThread]: Runtime Error in model kl_events (models/generated/airbyte_incremental/airbyte_new/kl_events.sql) 2022-04-07 03:39:28 normalization > 03:39:22.650776 [error] [MainThread]: 404 Not found: Table nhg-dw:airbyte_new._airbyte_raw_kl_events was not found in location europe-west4 2022-04-07 03:39:28 normalization > 03:39:22.651114 [error] [MainThread]: 2022-04-07 03:39:28 normalization > 03:39:22.651525 [error] [MainThread]: (job ID: edb2f818-832a-4aa4-b518-aa9761560a6d) 2022-04-07 03:39:28 normalization > 03:39:22.651982 [info ] [MainThread]: 2022-04-07 03:39:28 normalization > 03:39:22.652390 [info ] [MainThread]: Done. PASS=0 WARN=0 ERROR=5 SKIP=3 TOTAL=8 2022-04-07 03:39:28 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed. errors: $.credential: is not defined in the schema and the schema does not allow additional properties, $.part_size_mb: is not defined in the schema and the schema does not allow additional properties, $.gcs_bucket_name: is not defined in the schema and the schema does not allow additional properties, $.gcs_bucket_path: is not defined in the schema and the schema does not allow additional properties, $.keep_files_in_gcs-bucket: is not defined in the schema and the schema does not allow additional properties, $.method: must be a constant value Standard