2022-06-21 08:53:17 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.client_id: is missing but it is required, $.client_secret: is missing but it is required, $.refresh_token: is missing but it is required, $.credentials_title: must be a constant value OAuth Credentials 2022-06-21 08:53:17 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.api_key: object found, string expected 2022-06-21 08:53:17 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/34/0/logs.log 2022-06-21 08:53:17 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.20-alpha 2022-06-21 08:53:17 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-hubspot:0.1.70 exists... 2022-06-21 08:53:17 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-hubspot:0.1.70 was found locally. 2022-06-21 08:53:17 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 34 2022-06-21 08:53:17 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/34/0 --log-driver none --name source-hubspot-check-34-0-hzrdv --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/source-hubspot:0.1.70 -e AIRBYTE_VERSION=0.39.20-alpha -e WORKER_JOB_ID=34 airbyte/source-hubspot:0.1.70 check --config source_config.json 2022-06-21 08:53:20 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):97 - Check succeeded 2022-06-21 08:53:20 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-06-21 08:53:20 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/34/0/logs.log 2022-06-21 08:53:20 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.20-alpha 2022-06-21 08:53:21 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:1.1.8 exists... 2022-06-21 08:53:21 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:1.1.8 was found locally. 2022-06-21 08:53:21 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 34 2022-06-21 08:53:21 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/34/0 --log-driver none --name destination-bigquery-check-34-0-pvyoa --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.1.8 -e AIRBYTE_VERSION=0.39.20-alpha -e WORKER_JOB_ID=34 airbyte/destination-bigquery:1.1.8 check --config source_config.json 2022-06-21 08:53:21 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Class path contains multiple SLF4J bindings. 2022-06-21 08:53:21 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-06-21 08:53:21 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-06-21 08:53:21 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-06-21 08:53:21 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-06-21 08:53:22 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-06-21 08:53:24 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-21 08:53:24 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2022-06-21 08:53:24 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-21 08:53:24 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-06-21 08:53:24 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-21 08:53:24 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK 2022-06-21 08:53:24 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-21 08:53:24 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-06-21 08:53:25 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-21 08:53:25 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-06-21 08:53:25 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-21 08:53:25 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-06-21 08:53:25 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-21 08:53:25 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-06-21 08:53:25 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-21 08:53:25 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):306 - Selected loading method is set to: STANDARD 2022-06-21 08:53:29 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-06-21 08:53:29 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/34/0/logs.log 2022-06-21 08:53:29 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.20-alpha 2022-06-21 08:53:29 INFO i.a.w.g.DefaultReplicationWorker(run):115 - start sync worker. job id: 34 attempt id: 0 2022-06-21 08:53:29 INFO i.a.w.g.DefaultReplicationWorker(run):127 - configured sync modes: {null.email_events=incremental - append_dedup} 2022-06-21 08:53:29 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination... 2022-06-21 08:53:29 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:1.1.8 exists... 2022-06-21 08:53:29 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:1.1.8 was found locally. 2022-06-21 08:53:29 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 34 2022-06-21 08:53:29 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/34/0 --log-driver none --name destination-bigquery-write-34-0-gyvgj --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.1.8 -e AIRBYTE_VERSION=0.39.20-alpha -e WORKER_JOB_ID=34 airbyte/destination-bigquery:1.1.8 write --config destination_config.json --catalog destination_catalog.json 2022-06-21 08:53:29 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-hubspot:0.1.70 exists... 2022-06-21 08:53:30 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-hubspot:0.1.70 was found locally. 2022-06-21 08:53:30 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 34 2022-06-21 08:53:30 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/34/0 --log-driver none --name source-hubspot-read-34-0-zrshx --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/source-hubspot:0.1.70 -e AIRBYTE_VERSION=0.39.20-alpha -e WORKER_JOB_ID=34 airbyte/source-hubspot:0.1.70 read --config source_config.json --catalog source_catalog.json 2022-06-21 08:53:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):395 - Destination output thread started. 2022-06-21 08:53:30 INFO i.a.w.g.DefaultReplicationWorker(run):169 - Waiting for source and destination threads to complete. 2022-06-21 08:53:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):298 - Replication thread started. 2022-06-21 08:53:32 destination > SLF4J: Class path contains multiple SLF4J bindings. 2022-06-21 08:53:32 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-06-21 08:53:32 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-06-21 08:53:32 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-06-21 08:53:32 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-06-21 08:53:32 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-06-21 08:53:37 destination > 2022-06-21 08:53:37 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-06-21 08:53:37 destination > 2022-06-21 08:53:37 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-06-21 08:53:37 destination > 2022-06-21 08:53:37 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: WRITE 2022-06-21 08:53:37 destination > 2022-06-21 08:53:37 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-06-21 08:53:37 source > Starting syncing SourceHubspot 2022-06-21 08:53:37 source > No scopes to grant when authenticating with API key. 2022-06-21 08:53:37 source > Syncing stream: email_events 2022-06-21 08:53:38 destination > 2022-06-21 08:53:38 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-06-21 08:53:38 destination > 2022-06-21 08:53:38 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-06-21 08:53:38 destination > 2022-06-21 08:53:38 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-06-21 08:53:38 destination > 2022-06-21 08:53:38 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):306 - Selected loading method is set to: STANDARD 2022-06-21 08:53:38 destination > 2022-06-21 08:53:38 WARN i.a.i.d.b.BigQueryDestination(getConsumer):197 - The "standard" upload mode is not performant, and is not recommended for production. Please use the GCS upload mode if you are syncing a large amount of data. 2022-06-21 08:53:39 destination > 2022-06-21 08:53:39 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):306 - Selected loading method is set to: STANDARD 2022-06-21 08:53:42 destination > 2022-06-21 08:53:42 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=hubspot_test_email, tableId=_airbyte_tmp_ech_email_events}} 2022-06-21 08:53:47 source > Advancing bookmark for email_events stream from 2017-01-25T00:00:00+00:00 to 2019-07-22T23:00:17.728000+00:00 2022-06-21 08:53:48 source > Advancing bookmark for email_events stream from 2019-07-22T23:00:17.728000+00:00 to 2019-09-11T23:39:14.504000+00:00 2022-06-21 08:53:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 1000 (467 KB) 2022-06-21 08:53:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 2000 (968 KB) 2022-06-21 08:53:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 3000 (1 MB) 2022-06-21 08:53:54 source > Advancing bookmark for email_events stream from 2019-09-11T23:39:14.504000+00:00 to 2019-10-11T09:15:51.192000+00:00 2022-06-21 08:53:56 source > Advancing bookmark for email_events stream from 2019-10-11T09:15:51.192000+00:00 to 2019-11-08T02:14:41.600000+00:00 2022-06-21 08:53:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 4000 (1 MB) 2022-06-21 08:53:57 source > Advancing bookmark for email_events stream from 2019-11-08T02:14:41.600000+00:00 to 2019-12-10T04:04:46.135000+00:00 2022-06-21 08:53:57 source > Advancing bookmark for email_events stream from 2019-12-10T04:04:46.135000+00:00 to 2019-12-27T06:35:55.220000+00:00 2022-06-21 08:53:58 source > Advancing bookmark for email_events stream from 2019-12-27T06:35:55.220000+00:00 to 2020-02-08T11:42:51.286000+00:00 2022-06-21 08:53:59 source > Advancing bookmark for email_events stream from 2020-02-08T11:42:51.286000+00:00 to 2020-02-27T00:10:16.164000+00:00 2022-06-21 08:53:59 source > Advancing bookmark for email_events stream from 2020-02-27T00:10:16.164000+00:00 to 2020-03-31T07:43:59.762000+00:00 2022-06-21 08:53:59 source > Advancing bookmark for email_events stream from 2020-03-31T07:43:59.762000+00:00 to 2020-05-02T02:40:35.965000+00:00 2022-06-21 08:54:00 source > Advancing bookmark for email_events stream from 2020-05-02T02:40:35.965000+00:00 to 2020-06-06T23:53:26.866000+00:00 2022-06-21 08:54:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 5000 (2 MB) 2022-06-21 08:54:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 6000 (2 MB) 2022-06-21 08:54:02 source > Advancing bookmark for email_events stream from 2020-06-06T23:53:26.866000+00:00 to 2020-07-07T07:25:05.289000+00:00 2022-06-21 08:54:02 source > Advancing bookmark for email_events stream from 2020-07-07T07:25:05.289000+00:00 to 2020-08-06T12:52:08.518000+00:00 2022-06-21 08:54:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 7000 (3 MB) 2022-06-21 08:54:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 8000 (4 MB) 2022-06-21 08:54:05 source > Advancing bookmark for email_events stream from 2020-08-06T12:52:08.518000+00:00 to 2020-09-05T22:51:07.628000+00:00 2022-06-21 08:54:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 9000 (4 MB) 2022-06-21 08:54:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 10000 (5 MB) 2022-06-21 08:54:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 11000 (5 MB) 2022-06-21 08:54:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 12000 (6 MB) 2022-06-21 08:54:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 13000 (6 MB) 2022-06-21 08:54:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 14000 (7 MB) 2022-06-21 08:54:14 source > Advancing bookmark for email_events stream from 2020-09-05T22:51:07.628000+00:00 to 2020-10-05T14:23:34.722000+00:00 2022-06-21 08:54:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 15000 (8 MB) 2022-06-21 08:54:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 16000 (8 MB) 2022-06-21 08:54:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 17000 (9 MB) 2022-06-21 08:54:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 18000 (9 MB) 2022-06-21 08:54:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 19000 (10 MB) 2022-06-21 08:54:23 source > Advancing bookmark for email_events stream from 2020-10-05T14:23:34.722000+00:00 to 2020-11-04T23:44:38.787000+00:00 2022-06-21 08:54:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 20000 (10 MB) 2022-06-21 08:54:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 21000 (11 MB) 2022-06-21 08:54:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 22000 (11 MB) 2022-06-21 08:54:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 23000 (12 MB) 2022-06-21 08:54:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 24000 (13 MB) 2022-06-21 08:54:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 25000 (13 MB) 2022-06-21 08:54:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 26000 (14 MB) 2022-06-21 08:54:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 27000 (14 MB) 2022-06-21 08:54:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 28000 (15 MB) 2022-06-21 08:54:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 29000 (15 MB) 2022-06-21 08:54:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 30000 (16 MB) 2022-06-21 08:54:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 31000 (16 MB) 2022-06-21 08:54:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 32000 (17 MB) 2022-06-21 08:54:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 33000 (17 MB) 2022-06-21 08:54:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 34000 (18 MB) 2022-06-21 08:54:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 35000 (18 MB) 2022-06-21 08:54:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 36000 (19 MB) 2022-06-21 08:54:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 37000 (19 MB) 2022-06-21 08:54:50 source > Advancing bookmark for email_events stream from 2020-11-04T23:44:38.787000+00:00 to 2020-12-04T23:47:46.329000+00:00 2022-06-21 08:54:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 38000 (20 MB) 2022-06-21 08:54:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 39000 (21 MB) 2022-06-21 08:54:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 40000 (21 MB) 2022-06-21 08:54:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 41000 (22 MB) 2022-06-21 08:55:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 42000 (22 MB) 2022-06-21 08:55:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 43000 (23 MB) 2022-06-21 08:55:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 44000 (23 MB) 2022-06-21 08:55:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 45000 (23 MB) 2022-06-21 08:55:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 46000 (24 MB) 2022-06-21 08:55:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 47000 (25 MB) 2022-06-21 08:55:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 48000 (25 MB) 2022-06-21 08:55:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 49000 (26 MB) 2022-06-21 08:55:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 50000 (26 MB) 2022-06-21 08:55:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 51000 (27 MB) 2022-06-21 08:55:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 52000 (27 MB) 2022-06-21 08:55:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 53000 (28 MB) 2022-06-21 08:55:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 54000 (28 MB) 2022-06-21 08:55:35 source > Advancing bookmark for email_events stream from 2020-12-04T23:47:46.329000+00:00 to 2021-01-03T23:58:42.382000+00:00 2022-06-21 08:55:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 55000 (29 MB) 2022-06-21 08:55:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 56000 (30 MB) 2022-06-21 08:55:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 57000 (30 MB) 2022-06-21 08:55:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 58000 (30 MB) 2022-06-21 08:55:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 59000 (31 MB) 2022-06-21 08:55:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 60000 (31 MB) 2022-06-21 08:55:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 61000 (32 MB) 2022-06-21 08:56:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 62000 (32 MB) 2022-06-21 08:56:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 63000 (33 MB) 2022-06-21 08:56:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 64000 (34 MB) 2022-06-21 08:56:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 65000 (34 MB) 2022-06-21 08:56:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 66000 (34 MB) 2022-06-21 08:56:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 67000 (35 MB) 2022-06-21 08:56:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 68000 (36 MB) 2022-06-21 08:56:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 69000 (36 MB) 2022-06-21 08:56:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 70000 (37 MB) 2022-06-21 08:56:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 71000 (37 MB) 2022-06-21 08:56:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 72000 (38 MB) 2022-06-21 08:56:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 73000 (39 MB) 2022-06-21 08:56:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 74000 (39 MB) 2022-06-21 08:56:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 75000 (39 MB) 2022-06-21 08:56:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 76000 (40 MB) 2022-06-21 08:56:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 77000 (40 MB) 2022-06-21 08:56:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 78000 (41 MB) 2022-06-21 08:56:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 79000 (41 MB) 2022-06-21 08:56:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 80000 (42 MB) 2022-06-21 08:56:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 81000 (42 MB) 2022-06-21 08:56:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 82000 (43 MB) 2022-06-21 08:56:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 83000 (43 MB) 2022-06-21 08:56:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 84000 (43 MB) 2022-06-21 08:56:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 85000 (44 MB) 2022-06-21 08:56:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 86000 (45 MB) 2022-06-21 08:56:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 87000 (45 MB) 2022-06-21 08:56:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 88000 (46 MB) 2022-06-21 08:56:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 89000 (46 MB) 2022-06-21 08:56:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 90000 (46 MB) 2022-06-21 08:57:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 91000 (47 MB) 2022-06-21 08:57:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 92000 (47 MB) 2022-06-21 08:57:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 93000 (48 MB) 2022-06-21 08:57:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 94000 (48 MB) 2022-06-21 08:57:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 95000 (49 MB) 2022-06-21 08:57:09 source > Advancing bookmark for email_events stream from 2021-01-03T23:58:42.382000+00:00 to 2021-02-02T23:57:18.515000+00:00 2022-06-21 08:57:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 96000 (50 MB) 2022-06-21 08:57:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 97000 (50 MB) 2022-06-21 08:57:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 98000 (51 MB) 2022-06-21 08:57:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 99000 (51 MB) 2022-06-21 08:57:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 100000 (51 MB) 2022-06-21 08:57:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 101000 (52 MB) 2022-06-21 08:57:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 102000 (52 MB) 2022-06-21 08:57:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 103000 (53 MB) 2022-06-21 08:57:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 104000 (54 MB) 2022-06-21 08:57:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 105000 (54 MB) 2022-06-21 08:57:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 106000 (54 MB) 2022-06-21 08:57:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 107000 (55 MB) 2022-06-21 08:57:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 108000 (55 MB) 2022-06-21 08:57:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 109000 (56 MB) 2022-06-21 08:57:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 110000 (56 MB) 2022-06-21 08:57:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 111000 (57 MB) 2022-06-21 08:57:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 112000 (57 MB) 2022-06-21 08:57:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 113000 (58 MB) 2022-06-21 08:57:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 114000 (58 MB) 2022-06-21 08:57:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 115000 (59 MB) 2022-06-21 08:57:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 116000 (59 MB) 2022-06-21 08:57:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 117000 (60 MB) 2022-06-21 08:57:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 118000 (60 MB) 2022-06-21 08:57:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 119000 (61 MB) 2022-06-21 08:57:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 120000 (61 MB) 2022-06-21 08:57:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 121000 (62 MB) 2022-06-21 08:58:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 122000 (62 MB) 2022-06-21 08:58:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 123000 (63 MB) 2022-06-21 08:58:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 124000 (63 MB) 2022-06-21 08:58:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 125000 (64 MB) 2022-06-21 08:58:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 126000 (64 MB) 2022-06-21 08:58:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 127000 (65 MB) 2022-06-21 08:58:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 128000 (65 MB) 2022-06-21 08:58:14 source > Advancing bookmark for email_events stream from 2021-02-02T23:57:18.515000+00:00 to 2021-03-04T23:34:52.868000+00:00 2022-06-21 08:58:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 129000 (66 MB) 2022-06-21 08:58:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 130000 (66 MB) 2022-06-21 08:58:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 131000 (67 MB) 2022-06-21 08:58:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 132000 (67 MB) 2022-06-21 08:58:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 133000 (68 MB) 2022-06-21 08:58:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 134000 (68 MB) 2022-06-21 08:58:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 135000 (69 MB) 2022-06-21 08:58:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 136000 (69 MB) 2022-06-21 08:58:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 137000 (70 MB) 2022-06-21 08:58:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 138000 (70 MB) 2022-06-21 08:58:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 139000 (70 MB) 2022-06-21 08:58:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 140000 (71 MB) 2022-06-21 08:58:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 141000 (72 MB) 2022-06-21 08:58:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 142000 (72 MB) 2022-06-21 08:58:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 143000 (72 MB) 2022-06-21 08:58:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 144000 (73 MB) 2022-06-21 08:58:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 145000 (73 MB) 2022-06-21 08:59:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 146000 (74 MB) 2022-06-21 08:59:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 147000 (74 MB) 2022-06-21 08:59:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 148000 (75 MB) 2022-06-21 08:59:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 149000 (75 MB) 2022-06-21 08:59:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 150000 (76 MB) 2022-06-21 08:59:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 151000 (76 MB) 2022-06-21 08:59:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 152000 (77 MB) 2022-06-21 08:59:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 153000 (77 MB) 2022-06-21 08:59:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 154000 (78 MB) 2022-06-21 08:59:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 155000 (79 MB) 2022-06-21 08:59:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 156000 (79 MB) 2022-06-21 08:59:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 157000 (79 MB) 2022-06-21 08:59:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 158000 (80 MB) 2022-06-21 08:59:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 159000 (80 MB) 2022-06-21 08:59:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 160000 (81 MB) 2022-06-21 08:59:33 source > Advancing bookmark for email_events stream from 2021-03-04T23:34:52.868000+00:00 to 2021-04-03T23:53:58.571000+00:00 2022-06-21 08:59:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 161000 (81 MB) 2022-06-21 08:59:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 162000 (82 MB) 2022-06-21 08:59:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 163000 (83 MB) 2022-06-21 08:59:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 164000 (83 MB) 2022-06-21 08:59:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 165000 (83 MB) 2022-06-21 08:59:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 166000 (84 MB) 2022-06-21 08:59:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 167000 (84 MB) 2022-06-21 08:59:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 168000 (85 MB) 2022-06-21 08:59:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 169000 (85 MB) 2022-06-21 08:59:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 170000 (86 MB) 2022-06-21 08:59:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 171000 (86 MB) 2022-06-21 08:59:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 172000 (87 MB) 2022-06-21 08:59:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 173000 (87 MB) 2022-06-21 08:59:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 174000 (87 MB) 2022-06-21 09:00:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 175000 (88 MB) 2022-06-21 09:00:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 176000 (88 MB) 2022-06-21 09:00:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 177000 (89 MB) 2022-06-21 09:00:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 178000 (90 MB) 2022-06-21 09:00:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 179000 (90 MB) 2022-06-21 09:00:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 180000 (90 MB) 2022-06-21 09:00:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 181000 (91 MB) 2022-06-21 09:00:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 182000 (91 MB) 2022-06-21 09:00:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 183000 (92 MB) 2022-06-21 09:00:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 184000 (92 MB) 2022-06-21 09:00:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 185000 (93 MB) 2022-06-21 09:00:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 186000 (93 MB) 2022-06-21 09:00:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 187000 (93 MB) 2022-06-21 09:00:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 188000 (94 MB) 2022-06-21 09:00:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 189000 (94 MB) 2022-06-21 09:00:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 190000 (95 MB) 2022-06-21 09:00:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 191000 (95 MB) 2022-06-21 09:00:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 192000 (96 MB) 2022-06-21 09:00:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 193000 (96 MB) 2022-06-21 09:00:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 194000 (97 MB) 2022-06-21 09:00:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 195000 (97 MB) 2022-06-21 09:00:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 196000 (98 MB) 2022-06-21 09:00:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 197000 (98 MB) 2022-06-21 09:00:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 198000 (99 MB) 2022-06-21 09:00:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 199000 (99 MB) 2022-06-21 09:00:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 200000 (99 MB) 2022-06-21 09:01:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 201000 (100 MB) 2022-06-21 09:01:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 202000 (100 MB) 2022-06-21 09:01:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 203000 (101 MB) 2022-06-21 09:01:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 204000 (101 MB) 2022-06-21 09:01:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 205000 (102 MB) 2022-06-21 09:01:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 206000 (103 MB) 2022-06-21 09:01:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 207000 (103 MB) 2022-06-21 09:01:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 208000 (104 MB) 2022-06-21 09:01:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 209000 (104 MB) 2022-06-21 09:01:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 210000 (104 MB) 2022-06-21 09:01:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 211000 (105 MB) 2022-06-21 09:01:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 212000 (105 MB) 2022-06-21 09:01:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 213000 (106 MB) 2022-06-21 09:01:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 214000 (106 MB) 2022-06-21 09:01:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 215000 (107 MB) 2022-06-21 09:01:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 216000 (107 MB) 2022-06-21 09:02:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 217000 (108 MB) 2022-06-21 09:02:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 218000 (108 MB) 2022-06-21 09:02:03 source > Advancing bookmark for email_events stream from 2021-04-03T23:53:58.571000+00:00 to 2021-05-03T23:49:45.890000+00:00 2022-06-21 09:02:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 219000 (109 MB) 2022-06-21 09:02:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 220000 (109 MB) 2022-06-21 09:02:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 221000 (110 MB) 2022-06-21 09:02:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 222000 (110 MB) 2022-06-21 09:02:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 223000 (110 MB) 2022-06-21 09:02:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 224000 (111 MB) 2022-06-21 09:02:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 225000 (111 MB) 2022-06-21 09:02:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 226000 (112 MB) 2022-06-21 09:02:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 227000 (112 MB) 2022-06-21 09:02:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 228000 (113 MB) 2022-06-21 09:02:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 229000 (114 MB) 2022-06-21 09:02:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 230000 (114 MB) 2022-06-21 09:02:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 231000 (114 MB) 2022-06-21 09:02:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 232000 (115 MB) 2022-06-21 09:02:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 233000 (115 MB) 2022-06-21 09:02:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 234000 (115 MB) 2022-06-21 09:02:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 235000 (116 MB) 2022-06-21 09:02:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 236000 (117 MB) 2022-06-21 09:02:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 237000 (117 MB) 2022-06-21 09:03:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 238000 (118 MB) 2022-06-21 09:03:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 239000 (118 MB) 2022-06-21 09:03:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 240000 (119 MB) 2022-06-21 09:03:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 241000 (119 MB) 2022-06-21 09:03:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 242000 (119 MB) 2022-06-21 09:03:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 243000 (120 MB) 2022-06-21 09:03:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 244000 (120 MB) 2022-06-21 09:03:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 245000 (121 MB) 2022-06-21 09:03:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 246000 (121 MB) 2022-06-21 09:03:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 247000 (122 MB) 2022-06-21 09:03:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 248000 (122 MB) 2022-06-21 09:03:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 249000 (123 MB) 2022-06-21 09:03:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 250000 (123 MB) 2022-06-21 09:03:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 251000 (123 MB) 2022-06-21 09:03:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 252000 (124 MB) 2022-06-21 09:03:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 253000 (125 MB) 2022-06-21 09:03:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 254000 (125 MB) 2022-06-21 09:03:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 255000 (126 MB) 2022-06-21 09:03:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 256000 (126 MB) 2022-06-21 09:03:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 257000 (126 MB) 2022-06-21 09:03:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 258000 (127 MB) 2022-06-21 09:03:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 259000 (127 MB) 2022-06-21 09:03:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 260000 (128 MB) 2022-06-21 09:04:01 source > Advancing bookmark for email_events stream from 2021-05-03T23:49:45.890000+00:00 to 2021-06-02T23:47:09.827000+00:00 2022-06-21 09:04:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 261000 (128 MB) 2022-06-21 09:04:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 262000 (129 MB) 2022-06-21 09:04:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 263000 (130 MB) 2022-06-21 09:04:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 264000 (130 MB) 2022-06-21 09:04:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 265000 (130 MB) 2022-06-21 09:04:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 266000 (131 MB) 2022-06-21 09:04:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 267000 (131 MB) 2022-06-21 09:04:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 268000 (132 MB) 2022-06-21 09:04:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 269000 (132 MB) 2022-06-21 09:04:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 270000 (133 MB) 2022-06-21 09:04:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 271000 (133 MB) 2022-06-21 09:04:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 272000 (134 MB) 2022-06-21 09:04:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 273000 (134 MB) 2022-06-21 09:04:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 274000 (134 MB) 2022-06-21 09:04:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 275000 (135 MB) 2022-06-21 09:04:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 276000 (135 MB) 2022-06-21 09:04:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 277000 (136 MB) 2022-06-21 09:04:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 278000 (136 MB) 2022-06-21 09:04:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 279000 (137 MB) 2022-06-21 09:04:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 280000 (138 MB) 2022-06-21 09:04:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 281000 (138 MB) 2022-06-21 09:04:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 282000 (138 MB) 2022-06-21 09:04:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 283000 (139 MB) 2022-06-21 09:04:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 284000 (139 MB) 2022-06-21 09:05:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 285000 (140 MB) 2022-06-21 09:05:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 286000 (140 MB) 2022-06-21 09:05:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 287000 (141 MB) 2022-06-21 09:05:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 288000 (141 MB) 2022-06-21 09:05:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 289000 (142 MB) 2022-06-21 09:05:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 290000 (142 MB) 2022-06-21 09:05:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 291000 (143 MB) 2022-06-21 09:05:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 292000 (143 MB) 2022-06-21 09:05:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 293000 (144 MB) 2022-06-21 09:05:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 294000 (144 MB) 2022-06-21 09:05:29 source > Advancing bookmark for email_events stream from 2021-06-02T23:47:09.827000+00:00 to 2021-07-02T23:59:32.569000+00:00 2022-06-21 09:05:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 295000 (145 MB) 2022-06-21 09:05:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 296000 (145 MB) 2022-06-21 09:05:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 297000 (146 MB) 2022-06-21 09:05:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 298000 (146 MB) 2022-06-21 09:05:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 299000 (147 MB) 2022-06-21 09:05:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 300000 (147 MB) 2022-06-21 09:05:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 301000 (148 MB) 2022-06-21 09:05:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 302000 (148 MB) 2022-06-21 09:05:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 303000 (149 MB) 2022-06-21 09:05:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 304000 (150 MB) 2022-06-21 09:05:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 305000 (150 MB) 2022-06-21 09:06:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 306000 (150 MB) 2022-06-21 09:06:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 307000 (151 MB) 2022-06-21 09:06:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 308000 (151 MB) 2022-06-21 09:06:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 309000 (152 MB) 2022-06-21 09:06:08 source > Advancing bookmark for email_events stream from 2021-07-02T23:59:32.569000+00:00 to 2021-08-01T23:53:05.519000+00:00 2022-06-21 09:06:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 310000 (152 MB) 2022-06-21 09:06:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 311000 (153 MB) 2022-06-21 09:06:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 312000 (153 MB) 2022-06-21 09:06:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 313000 (154 MB) 2022-06-21 09:06:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 314000 (154 MB) 2022-06-21 09:06:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 315000 (155 MB) 2022-06-21 09:06:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 316000 (155 MB) 2022-06-21 09:06:20 source > Advancing bookmark for email_events stream from 2021-08-01T23:53:05.519000+00:00 to 2021-08-31T23:55:40.926000+00:00 2022-06-21 09:06:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 317000 (156 MB) 2022-06-21 09:06:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 318000 (156 MB) 2022-06-21 09:06:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 319000 (157 MB) 2022-06-21 09:06:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 320000 (157 MB) 2022-06-21 09:06:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 321000 (158 MB) 2022-06-21 09:06:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 322000 (158 MB) 2022-06-21 09:06:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 323000 (159 MB) 2022-06-21 09:06:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 324000 (159 MB) 2022-06-21 09:06:38 source > Advancing bookmark for email_events stream from 2021-08-31T23:55:40.926000+00:00 to 2021-09-30T23:49:47.578000+00:00 2022-06-21 09:06:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 325000 (160 MB) 2022-06-21 09:06:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 326000 (160 MB) 2022-06-21 09:06:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 327000 (161 MB) 2022-06-21 09:06:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 328000 (161 MB) 2022-06-21 09:06:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 329000 (162 MB) 2022-06-21 09:06:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 330000 (162 MB) 2022-06-21 09:06:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 331000 (163 MB) 2022-06-21 09:06:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 332000 (163 MB) 2022-06-21 09:06:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 333000 (164 MB) 2022-06-21 09:06:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 334000 (164 MB) 2022-06-21 09:06:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 335000 (165 MB) 2022-06-21 09:06:58 source > Advancing bookmark for email_events stream from 2021-09-30T23:49:47.578000+00:00 to 2021-10-30T22:59:57.073000+00:00 2022-06-21 09:06:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 336000 (165 MB) 2022-06-21 09:07:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 337000 (166 MB) 2022-06-21 09:07:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 338000 (166 MB) 2022-06-21 09:07:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 339000 (167 MB) 2022-06-21 09:07:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 340000 (167 MB) 2022-06-21 09:07:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 341000 (168 MB) 2022-06-21 09:07:10 source > Advancing bookmark for email_events stream from 2021-10-30T22:59:57.073000+00:00 to 2021-11-29T23:58:52.623000+00:00 2022-06-21 09:07:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 342000 (168 MB) 2022-06-21 09:07:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 343000 (168 MB) 2022-06-21 09:07:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 344000 (169 MB) 2022-06-21 09:07:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 345000 (169 MB) 2022-06-21 09:07:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 346000 (170 MB) 2022-06-21 09:07:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 347000 (170 MB) 2022-06-21 09:07:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 348000 (171 MB) 2022-06-21 09:07:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 349000 (171 MB) 2022-06-21 09:07:28 source > Advancing bookmark for email_events stream from 2021-11-29T23:58:52.623000+00:00 to 2021-12-29T23:58:15.967000+00:00 2022-06-21 09:07:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 350000 (172 MB) 2022-06-21 09:07:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 351000 (172 MB) 2022-06-21 09:07:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 352000 (173 MB) 2022-06-21 09:07:34 source > Advancing bookmark for email_events stream from 2021-12-29T23:58:15.967000+00:00 to 2022-01-28T09:00:13.527000+00:00 2022-06-21 09:07:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 353000 (173 MB) 2022-06-21 09:07:38 source > Advancing bookmark for email_events stream from 2022-01-28T09:00:13.527000+00:00 to 2022-02-27T23:14:49.840000+00:00 2022-06-21 09:07:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 354000 (174 MB) 2022-06-21 09:07:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 355000 (175 MB) 2022-06-21 09:07:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 356000 (175 MB) 2022-06-21 09:07:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 357000 (176 MB) 2022-06-21 09:07:49 source > Advancing bookmark for email_events stream from 2022-02-27T23:14:49.840000+00:00 to 2022-03-29T23:59:04.089000+00:00 2022-06-21 09:07:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 358000 (176 MB) 2022-06-21 09:07:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 359000 (177 MB) 2022-06-21 09:07:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 360000 (178 MB) 2022-06-21 09:07:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 361000 (178 MB) 2022-06-21 09:08:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 362000 (178 MB) 2022-06-21 09:08:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 363000 (179 MB) 2022-06-21 09:08:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 364000 (179 MB) 2022-06-21 09:08:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 365000 (180 MB) 2022-06-21 09:08:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 366000 (180 MB) 2022-06-21 09:08:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 367000 (181 MB) 2022-06-21 09:08:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 368000 (181 MB) 2022-06-21 09:08:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 369000 (182 MB) 2022-06-21 09:08:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 370000 (182 MB) 2022-06-21 09:08:23 source > Advancing bookmark for email_events stream from 2022-03-29T23:59:04.089000+00:00 to 2022-04-28T23:50:59.120000+00:00 2022-06-21 09:08:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 371000 (183 MB) 2022-06-21 09:08:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 372000 (183 MB) 2022-06-21 09:08:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 373000 (184 MB) 2022-06-21 09:08:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 374000 (184 MB) 2022-06-21 09:08:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 375000 (184 MB) 2022-06-21 09:08:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 376000 (185 MB) 2022-06-21 09:08:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 377000 (185 MB) 2022-06-21 09:08:36 source > Advancing bookmark for email_events stream from 2022-04-28T23:50:59.120000+00:00 to 2022-05-28T23:41:47.765000+00:00 2022-06-21 09:08:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 378000 (186 MB) 2022-06-21 09:08:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 379000 (187 MB) 2022-06-21 09:08:41 source > Advancing bookmark for email_events stream from 2022-05-28T23:41:47.765000+00:00 to 2022-06-21T07:50:41.750000+00:00 2022-06-21 09:08:41 source > Read 378916 records from email_events stream 2022-06-21 09:08:41 source > Finished syncing SourceHubspot 2022-06-21 09:08:41 source > SourceHubspot runtimes: 2022-06-21 09:08:41 source > Finished syncing SourceHubspot 2022-06-21 09:08:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):355 - Total records read: 379727 (187 MB) 2022-06-21 09:08:42 INFO i.a.w.g.DefaultReplicationWorker(run):174 - One of source or destination thread complete. Waiting on the other. 2022-06-21 09:08:42 destination > 2022-06-21 09:08:42 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded. 2022-06-21 09:08:42 destination > 2022-06-21 09:08:42 INFO i.a.i.d.b.BigQueryRecordConsumer(close):58 - Started closing all connections 2022-06-21 09:08:42 destination > 2022-06-21 09:08:42 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_email_events, tmpTable=_airbyte_tmp_ech_email_events, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-06-21 09:08:44 destination > 2022-06-21 09:08:44 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Waiting for job finish Job{job=JobId{project=analytics-platform-201110, job=def63728-8b44-447b-b090-28684fc1aa6a, location=asia-northeast1}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1655802523943, endTime=null, startTime=1655802524155, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=hubspot-bq@analytics-platform-201110.iam.gserviceaccount.com, etag=i6jAAndwxxDib64PRTiFQA==, generatedId=analytics-platform-201110:asia-northeast1.def63728-8b44-447b-b090-28684fc1aa6a, selfLink=https://www.googleapis.com/bigquery/v2/projects/analytics-platform-201110/jobs/def63728-8b44-447b-b090-28684fc1aa6a?location=asia-northeast1, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=hubspot_test_email, projectId=analytics-platform-201110, tableId=_airbyte_tmp_ech_email_events}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-06-21 09:08:57 destination > 2022-06-21 09:08:57 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):329 - Job finish Job{job=JobId{project=analytics-platform-201110, job=def63728-8b44-447b-b090-28684fc1aa6a, location=asia-northeast1}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1655802523943, endTime=null, startTime=1655802524155, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=hubspot-bq@analytics-platform-201110.iam.gserviceaccount.com, etag=i6jAAndwxxDib64PRTiFQA==, generatedId=analytics-platform-201110:asia-northeast1.def63728-8b44-447b-b090-28684fc1aa6a, selfLink=https://www.googleapis.com/bigquery/v2/projects/analytics-platform-201110/jobs/def63728-8b44-447b-b090-28684fc1aa6a?location=asia-northeast1, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=hubspot_test_email, projectId=analytics-platform-201110, tableId=_airbyte_tmp_ech_email_events}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-06-21 09:08:57 destination > 2022-06-21 09:08:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_ech_email_events to the source table _airbyte_raw_email_events. 2022-06-21 09:08:57 destination > 2022-06-21 09:08:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-06-21 09:09:02 destination > 2022-06-21 09:09:02 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=hubspot_test_email, tableId=_airbyte_tmp_ech_email_events}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=hubspot_test_email, tableId=_airbyte_raw_email_events}} 2022-06-21 09:09:02 destination > 2022-06-21 09:09:02 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_email_events! 2022-06-21 09:09:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):405 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@6a2f23a6[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@64e8d093[stateType=,stream=,global=,data={"email_events":{"created":1655797841750}},additionalProperties={streams=[]}],trace=,additionalProperties={}] 2022-06-21 09:09:02 destination > 2022-06-21 09:09:02 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-06-21 09:09:02 destination > 2022-06-21 09:09:02 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-06-21 09:09:02 destination > 2022-06-21 09:09:02 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-06-21 09:09:02 destination > 2022-06-21 09:09:02 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_email_events, tmpTable=_airbyte_tmp_ech_email_events, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-06-21 09:09:02 destination > 2022-06-21 09:09:02 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-06-21 09:09:02 INFO i.a.w.g.DefaultReplicationWorker(run):176 - Source and destination threads complete. 2022-06-21 09:09:02 INFO i.a.w.g.DefaultReplicationWorker(run):239 - sync summary: io.airbyte.config.ReplicationAttemptSummary@2ae509d1[status=completed,recordsSynced=378916,bytesSynced=196620076,startTime=1655801609861,endTime=1655802542881,totalStats=io.airbyte.config.SyncStats@4bab720d[recordsEmitted=378916,bytesEmitted=196620076,stateMessagesEmitted=811,recordsCommitted=378916],streamStats=[io.airbyte.config.StreamSyncStats@790282f2[streamName=email_events,stats=io.airbyte.config.SyncStats@70699f89[recordsEmitted=378916,bytesEmitted=196620076,stateMessagesEmitted=,recordsCommitted=378916]]]] 2022-06-21 09:09:02 INFO i.a.w.g.DefaultReplicationWorker(run):266 - Source output at least one state message 2022-06-21 09:09:02 INFO i.a.w.g.DefaultReplicationWorker(run):272 - State capture: Updated state to: Optional[io.airbyte.config.State@7240abd4[state={"email_events":{"created":1655797841750}}]] 2022-06-21 09:09:02 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-06-21 09:09:02 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):157 - sync summary: io.airbyte.config.StandardSyncOutput@69299f7b[standardSyncSummary=io.airbyte.config.StandardSyncSummary@2c2b1c3a[status=completed,recordsSynced=378916,bytesSynced=196620076,startTime=1655801609861,endTime=1655802542881,totalStats=io.airbyte.config.SyncStats@4bab720d[recordsEmitted=378916,bytesEmitted=196620076,stateMessagesEmitted=811,recordsCommitted=378916],streamStats=[io.airbyte.config.StreamSyncStats@790282f2[streamName=email_events,stats=io.airbyte.config.SyncStats@70699f89[recordsEmitted=378916,bytesEmitted=196620076,stateMessagesEmitted=,recordsCommitted=378916]]]],normalizationSummary=,state=io.airbyte.config.State@7240abd4[state={"email_events":{"created":1655797841750}}],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@4036c418[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@1d4d7401[stream=io.airbyte.protocol.models.AirbyteStream@38baf294[name=email_events,jsonSchema={"type":["null","object"],"$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","string"]},"url":{"type":["null","string"]},"from":{"type":["null","string"]},"hmid":{"type":["null","string"]},"type":{"type":["null","string"]},"appId":{"type":["null","integer"]},"linkId":{"type":["null","integer"]},"sentBy":{"type":["null","object"],"properties":{"id":{"type":["null","string"]},"created":{"type":["null","integer"]}}},"smtpId":{"type":["null","string"]},"source":{"type":["null","string"]},"status":{"type":["null","string"]},"appName":{"type":["null","string"]},"attempt":{"type":["null","integer"]},"bounced":{"type":["null","boolean"]},"browser":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"name":{"type":["null","string"]},"type":{"type":["null","string"]},"family":{"type":["null","string"]},"version":{"type":["null","array"],"items":{"type":["null","string"]}},"producer":{"type":["null","string"]},"producerUrl":{"type":["null","string"]}}},"created":{"type":["null","integer"]},"referer":{"type":["null","string"]},"replyTo":{"type":["null","array"],"items":{"type":["null","string"]}},"subject":{"type":["null","string"]},"category":{"type":["null","string"]},"causedBy":{"type":["null","object"],"properties":{"id":{"type":["null","string"]},"created":{"type":["null","integer"]}}},"duration":{"type":["null","integer"]},"location":{"type":["null","object"],"properties":{"city":{"type":["null","string"]},"state":{"type":["null","string"]},"country":{"type":["null","string"]},"zipcode":{"type":["null","string"]},"latitude":{"type":["null","number"]},"longitude":{"type":["null","number"]}}},"portalId":{"type":["null","integer"]},"response":{"type":["null","string"]},"sourceId":{"type":["null","string"]},"ipAddress":{"type":["null","string"]},"recipient":{"type":["null","string"]},"userAgent":{"type":["null","string"]},"deviceType":{"type":["null","string"]},"dropReason":{"type":["null","string"]},"dropMessage":{"type":["null","string"]},"obsoletedBy":{"type":["null","object"],"properties":{"id":{"type":["null","string"]},"created":{"type":["null","integer"]}}},"requestedBy":{"type":["null","string"]},"filteredEvent":{"type":["null","boolean"]},"emailCampaignId":{"type":["null","integer"]},"requestedByUserId":{"type":["null","integer"]},"emailCampaignGroupId":{"type":["null","integer"]},"portalSubscriptionStatus":{"type":["null","string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[created],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=incremental,cursorField=[created],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[]] 2022-06-21 09:09:02 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):237 - Stopping temporal heartbeating... 2022-06-21 09:09:02 INFO i.a.c.p.ConfigRepository(updateConnectionState):775 - Updating connection c546ad3d-d205-412c-9689-787be0935304 state: io.airbyte.config.State@4cff7ec8[state={"email_events":{"created":1655797841750}}] 2022-06-21 09:09:03 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/34/0/logs.log 2022-06-21 09:09:03 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.20-alpha 2022-06-21 09:09:03 INFO i.a.w.g.DefaultNormalizationWorker(run):49 - Running normalization. 2022-06-21 09:09:03 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):122 - Running with normalization version: airbyte/normalization:0.2.5 2022-06-21 09:09:03 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/normalization:0.2.5 exists... 2022-06-21 09:09:03 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/normalization:0.2.5 was found locally. 2022-06-21 09:09:03 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 34 2022-06-21 09:09:03 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/34/0/normalize --log-driver none --name normalization-normalize-34-0-akuqt --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.39.20-alpha airbyte/normalization:0.2.5 run --integration-type bigquery --config destination_config.json --catalog destination_catalog.json 2022-06-21 09:09:03 normalization > Running: transform-config --config destination_config.json --integration-type bigquery --out /data/34/0/normalize 2022-06-21 09:09:05 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/34/0/normalize') 2022-06-21 09:09:05 normalization > transform_bigquery 2022-06-21 09:09:05 normalization > Running: transform-catalog --integration-type bigquery --profile-config-dir /data/34/0/normalize --catalog destination_catalog.json --out /data/34/0/normalize/models/generated/ --json-column _airbyte_data 2022-06-21 09:09:07 normalization > Processing destination_catalog.json... 2022-06-21 09:09:07 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_ab1.sql from email_events 2022-06-21 09:09:07 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_ab2.sql from email_events 2022-06-21 09:09:07 normalization > Generating airbyte_views/hubspot_test_email/email_events_stg.sql from email_events 2022-06-21 09:09:07 normalization > Generating airbyte_incremental/scd/hubspot_test_email/email_events_scd.sql from email_events 2022-06-21 09:09:07 normalization > Generating airbyte_incremental/hubspot_test_email/email_events.sql from email_events 2022-06-21 09:09:07 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_sentBy_ab1.sql from email_events/sentBy 2022-06-21 09:09:07 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_sentBy_ab2.sql from email_events/sentBy 2022-06-21 09:09:07 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_sentBy_ab3.sql from email_events/sentBy 2022-06-21 09:09:07 normalization > Generating airbyte_incremental/hubspot_test_email/email_events_sentBy.sql from email_events/sentBy 2022-06-21 09:09:07 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_browser_ab1.sql from email_events/browser 2022-06-21 09:09:07 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_browser_ab2.sql from email_events/browser 2022-06-21 09:09:07 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_browser_ab3.sql from email_events/browser 2022-06-21 09:09:07 normalization > Generating airbyte_incremental/hubspot_test_email/email_events_browser.sql from email_events/browser 2022-06-21 09:09:07 normalization > Ignoring stream 'replyTo' from email_events/replyTo because properties list is empty 2022-06-21 09:09:07 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_causedBy_ab1.sql from email_events/causedBy 2022-06-21 09:09:07 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_causedBy_ab2.sql from email_events/causedBy 2022-06-21 09:09:07 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_causedBy_ab3.sql from email_events/causedBy 2022-06-21 09:09:07 normalization > Generating airbyte_incremental/hubspot_test_email/email_events_causedBy.sql from email_events/causedBy 2022-06-21 09:09:07 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_location_ab1.sql from email_events/location 2022-06-21 09:09:07 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_location_ab2.sql from email_events/location 2022-06-21 09:09:07 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_location_ab3.sql from email_events/location 2022-06-21 09:09:07 normalization > Generating airbyte_incremental/hubspot_test_email/email_events_location.sql from email_events/location 2022-06-21 09:09:07 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_obsoletedBy_ab1.sql from email_events/obsoletedBy 2022-06-21 09:09:07 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_obsoletedBy_ab2.sql from email_events/obsoletedBy 2022-06-21 09:09:07 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_obsoletedBy_ab3.sql from email_events/obsoletedBy 2022-06-21 09:09:07 normalization > Generating airbyte_incremental/hubspot_test_email/email_events_obsoletedBy.sql from email_events/obsoletedBy 2022-06-21 09:09:07 normalization > Ignoring stream 'version' from email_events/browser/version because properties list is empty 2022-06-21 09:09:07 normalization > detected no config file for ssh, assuming ssh is off. 2022-06-21 09:09:17 normalization > [--event-buffer-size EVENT_BUFFER_SIZE] 2022-06-21 09:09:17 normalization > --event-buffer-size EVENT_BUFFER_SIZE 2022-06-21 09:09:17 normalization > 2022-06-21 09:09:17 normalization > DBT >=1.0.0 detected; using 10K event buffer size 2022-06-21 09:09:17 normalization > 2022-06-21 09:09:29 normalization > 09:09:29 Running with dbt=1.0.0 2022-06-21 09:09:29 normalization > 09:09:29 Partial parse save file not found. Starting full parse. 2022-06-21 09:09:37 normalization > 09:09:37 [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. 2022-06-21 09:09:37 normalization > There are 1 unused configuration paths: 2022-06-21 09:09:37 normalization > - models.airbyte_utils.generated.airbyte_tables 2022-06-21 09:09:37 normalization > 2022-06-21 09:09:37 normalization > 09:09:37 Found 25 models, 0 tests, 0 snapshots, 0 analyses, 549 macros, 0 operations, 0 seed files, 1 source, 0 exposures, 0 metrics 2022-06-21 09:09:37 normalization > 09:09:37 2022-06-21 09:09:40 normalization > 09:09:40 Concurrency: 8 threads (target='prod') 2022-06-21 09:09:40 normalization > 09:09:40 2022-06-21 09:09:41 normalization > 09:09:41 1 of 8 START view model _airbyte_hubspot_test_email.email_events_stg.................................................... [RUN] 2022-06-21 09:09:42 normalization > 09:09:42 1 of 8 OK created view model _airbyte_hubspot_test_email.email_events_stg............................................... [OK in 1.71s] 2022-06-21 09:09:42 normalization > 09:09:42 2 of 8 START incremental model hubspot_test_email.email_events_scd...................................................... [RUN] 2022-06-21 09:09:43 normalization > 09:09:43 09:09:43 + `analytics-platform-201110`.hubspot_test_email.`email_events_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-06-21 09:11:38 normalization > 09:11:38 2 of 8 OK created incremental model hubspot_test_email.email_events_scd................................................. [CREATE TABLE (378.9k rows, 210.6 MB processed) in 115.78s] 2022-06-21 09:11:38 normalization > 09:11:38 3 of 8 START incremental model hubspot_test_email.email_events.......................................................... [RUN] 2022-06-21 09:11:39 normalization > 09:11:39 4 of 8 START incremental model hubspot_test_email.email_events_causedBy................................................. [RUN] 2022-06-21 09:11:39 normalization > 09:11:39 5 of 8 START incremental model hubspot_test_email.email_events_browser.................................................. [RUN] 2022-06-21 09:11:39 normalization > 09:11:39 6 of 8 START incremental model hubspot_test_email.email_events_obsoletedBy.............................................. [RUN] 2022-06-21 09:11:39 normalization > 09:11:39 7 of 8 START incremental model hubspot_test_email.email_events_sentBy................................................... [RUN] 2022-06-21 09:11:40 normalization > 09:11:39 8 of 8 START incremental model hubspot_test_email.email_events_location................................................. [RUN] 2022-06-21 09:11:40 normalization > 09:11:40 09:11:40 + `analytics-platform-201110`.hubspot_test_email.`email_events`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-06-21 09:11:40 normalization > 09:11:40 09:11:40 + `analytics-platform-201110`.hubspot_test_email.`email_events_causedBy`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-06-21 09:11:40 normalization > 09:11:40 09:11:40 + `analytics-platform-201110`.hubspot_test_email.`email_events_sentBy`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-06-21 09:11:40 normalization > 09:11:40 09:11:40 + `analytics-platform-201110`.hubspot_test_email.`email_events_browser`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-06-21 09:11:40 normalization > 09:11:40 09:11:40 + `analytics-platform-201110`.hubspot_test_email.`email_events_obsoletedBy`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-06-21 09:11:40 normalization > 09:11:40 09:11:40 + `analytics-platform-201110`.hubspot_test_email.`email_events_location`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-06-21 09:11:43 normalization > 09:11:43 4 of 8 OK created incremental model hubspot_test_email.email_events_causedBy............................................ [CREATE TABLE (5.8k rows, 29.2 MB processed) in 3.23s] 2022-06-21 09:11:43 normalization > 09:11:43 6 of 8 OK created incremental model hubspot_test_email.email_events_obsoletedBy......................................... [CREATE TABLE (201.0 rows, 28.9 MB processed) in 3.43s] 2022-06-21 09:11:45 normalization > 09:11:45 8 of 8 OK created incremental model hubspot_test_email.email_events_location............................................ [CREATE TABLE (120.1k rows, 37.7 MB processed) in 5.47s] 2022-06-21 09:11:47 normalization > 09:11:47 7 of 8 OK created incremental model hubspot_test_email.email_events_sentBy.............................................. [CREATE TABLE (375.8k rows, 54.4 MB processed) in 7.32s] 2022-06-21 09:11:48 normalization > 09:11:48 3 of 8 OK created incremental model hubspot_test_email.email_events..................................................... [CREATE TABLE (378.9k rows, 177.9 MB processed) in 10.36s] 2022-06-21 09:11:55 normalization > 09:11:55 5 of 8 ERROR creating incremental model hubspot_test_email.email_events_browser......................................... [ERROR in 15.99s] 2022-06-21 09:11:55 normalization > 09:11:55 2022-06-21 09:11:55 normalization > 09:11:55 Finished running 1 view model, 7 incremental models in 138.31s. 2022-06-21 09:11:56 normalization > 09:11:56 2022-06-21 09:11:56 normalization > 09:11:56 Completed with 1 error and 0 warnings: 2022-06-21 09:11:56 normalization > 09:11:56 2022-06-21 09:11:56 normalization > 09:11:56 Database Error in model email_events_browser (models/generated/airbyte_incremental/hubspot_test_email/email_events_browser.sql) 2022-06-21 09:11:56 normalization > 09:11:56 Array cannot have a null element; error in writing field version 2022-06-21 09:11:56 normalization > 09:11:56 compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_incremental/hubspot_test_email/email_events_browser.sql 2022-06-21 09:11:56 normalization > 09:11:56 2022-06-21 09:11:56 normalization > 09:11:56 Done. PASS=7 WARN=0 ERROR=1 SKIP=0 TOTAL=8 2022-06-21 09:11:56 normalization > 2022-06-21 09:11:56 normalization > Diagnosing dbt debug to check if destination is available for dbt and well configured (1): 2022-06-21 09:11:56 normalization > 2022-06-21 09:12:04 normalization > 09:12:04 Running with dbt=1.0.0 2022-06-21 09:12:04 normalization > dbt version: 1.0.0 2022-06-21 09:12:04 normalization > python version: 3.9.9 2022-06-21 09:12:04 normalization > python path: /usr/local/bin/python 2022-06-21 09:12:04 normalization > os info: Linux-5.4.0-113-generic-x86_64-with-glibc2.31 2022-06-21 09:12:04 normalization > Using profiles.yml file at /data/34/0/normalize/profiles.yml 2022-06-21 09:12:04 normalization > Using dbt_project.yml file at /data/34/0/normalize/dbt_project.yml 2022-06-21 09:12:04 normalization > 2022-06-21 09:12:05 normalization > Configuration: 2022-06-21 09:12:05 normalization > profiles.yml file [OK found and valid] 2022-06-21 09:12:05 normalization > dbt_project.yml file [OK found and valid] 2022-06-21 09:12:05 normalization > 2022-06-21 09:12:05 normalization > Required dependencies: 2022-06-21 09:12:05 normalization > - git [OK found] 2022-06-21 09:12:05 normalization > 2022-06-21 09:12:05 normalization > Connection: 2022-06-21 09:12:05 normalization > method: service-account-json 2022-06-21 09:12:05 normalization > database: analytics-platform-201110 2022-06-21 09:12:05 normalization > schema: hubspot_test_email 2022-06-21 09:12:05 normalization > location: asia-northeast1 2022-06-21 09:12:05 normalization > priority: interactive 2022-06-21 09:12:05 normalization > timeout_seconds: 300 2022-06-21 09:12:05 normalization > maximum_bytes_billed: None 2022-06-21 09:12:05 normalization > execution_project: analytics-platform-201110 2022-06-21 09:12:06 normalization > Connection test: [OK connection ok] 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > All checks passed! 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > Forward dbt output logs to diagnose/debug errors (0): 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > ============================== 2022-06-21 09:09:29.139595 | a12b669a-e0ae-4090-86cf-d2fa2e7494ea ============================== 2022-06-21 09:12:06 normalization > 09:09:29.139595 [info ] [MainThread]: Running with dbt=1.0.0 2022-06-21 09:12:06 normalization > 09:09:29.142136 [debug] [MainThread]: running dbt with arguments Namespace(record_timing_info=None, debug=None, log_format=None, write_json=None, use_colors=None, printer_width=None, warn_error=None, version_check=None, partial_parse=None, single_threaded=False, use_experimental_parser=None, static_parser=None, profiles_dir='/data/34/0/normalize', send_anonymous_usage_stats=None, fail_fast=None, event_buffer_size='10000', project_dir='/data/34/0/normalize', profile=None, target=None, vars='{}', log_cache_events=False, threads=None, select=None, exclude=None, selector_name=None, state=None, defer=None, full_refresh=False, cls=, which='run', rpc_method='run') 2022-06-21 09:12:06 normalization > 09:09:29.143470 [debug] [MainThread]: Tracking: do not track 2022-06-21 09:12:06 normalization > 09:09:29.330182 [info ] [MainThread]: Partial parse save file not found. Starting full parse. 2022-06-21 09:12:06 normalization > 09:09:29.563022 [debug] [MainThread]: Parsing macros/should_full_refresh.sql 2022-06-21 09:12:06 normalization > 09:09:29.611634 [debug] [MainThread]: Parsing macros/get_custom_schema.sql 2022-06-21 09:12:06 normalization > 09:09:29.616308 [debug] [MainThread]: Parsing macros/star_intersect.sql 2022-06-21 09:12:06 normalization > 09:09:29.667140 [debug] [MainThread]: Parsing macros/configuration.sql 2022-06-21 09:12:06 normalization > 09:09:29.684517 [debug] [MainThread]: Parsing macros/incremental.sql 2022-06-21 09:12:06 normalization > 09:09:29.735125 [debug] [MainThread]: Parsing macros/schema_tests/equal_rowcount.sql 2022-06-21 09:12:06 normalization > 09:09:29.744491 [debug] [MainThread]: Parsing macros/schema_tests/equality.sql 2022-06-21 09:12:06 normalization > 09:09:29.799079 [debug] [MainThread]: Parsing macros/cross_db_utils/current_timestamp.sql 2022-06-21 09:12:06 normalization > 09:09:29.804055 [debug] [MainThread]: Parsing macros/cross_db_utils/datatypes.sql 2022-06-21 09:12:06 normalization > 09:09:29.888520 [debug] [MainThread]: Parsing macros/cross_db_utils/hash.sql 2022-06-21 09:12:06 normalization > 09:09:29.892980 [debug] [MainThread]: Parsing macros/cross_db_utils/json_operations.sql 2022-06-21 09:12:06 normalization > 09:09:30.209420 [debug] [MainThread]: Parsing macros/cross_db_utils/array.sql 2022-06-21 09:12:06 normalization > 09:09:30.337695 [debug] [MainThread]: Parsing macros/cross_db_utils/concat.sql 2022-06-21 09:12:06 normalization > 09:09:30.359075 [debug] [MainThread]: Parsing macros/cross_db_utils/quote.sql 2022-06-21 09:12:06 normalization > 09:09:30.372864 [debug] [MainThread]: Parsing macros/cross_db_utils/type_conversions.sql 2022-06-21 09:12:06 normalization > 09:09:30.445380 [debug] [MainThread]: Parsing macros/cross_db_utils/surrogate_key.sql 2022-06-21 09:12:06 normalization > 09:09:30.463032 [debug] [MainThread]: Parsing macros/cross_db_utils/except.sql 2022-06-21 09:12:06 normalization > 09:09:30.469511 [debug] [MainThread]: Parsing macros/cross_db_utils/columns.sql 2022-06-21 09:12:06 normalization > 09:09:30.493686 [debug] [MainThread]: Parsing macros/adapters.sql 2022-06-21 09:12:06 normalization > 09:09:30.710421 [debug] [MainThread]: Parsing macros/catalog.sql 2022-06-21 09:12:06 normalization > 09:09:30.763163 [debug] [MainThread]: Parsing macros/etc.sql 2022-06-21 09:12:06 normalization > 09:09:30.780806 [debug] [MainThread]: Parsing macros/materializations/copy.sql 2022-06-21 09:12:06 normalization > 09:09:30.807963 [debug] [MainThread]: Parsing macros/materializations/view.sql 2022-06-21 09:12:06 normalization > 09:09:30.827808 [debug] [MainThread]: Parsing macros/materializations/table.sql 2022-06-21 09:12:06 normalization > 09:09:30.851372 [debug] [MainThread]: Parsing macros/materializations/snapshot.sql 2022-06-21 09:12:06 normalization > 09:09:30.860890 [debug] [MainThread]: Parsing macros/materializations/incremental.sql 2022-06-21 09:12:06 normalization > 09:09:30.953473 [debug] [MainThread]: Parsing macros/materializations/seed.sql 2022-06-21 09:12:06 normalization > 09:09:30.968134 [debug] [MainThread]: Parsing macros/etc/statement.sql 2022-06-21 09:12:06 normalization > 09:09:30.995237 [debug] [MainThread]: Parsing macros/etc/datetime.sql 2022-06-21 09:12:06 normalization > 09:09:31.046738 [debug] [MainThread]: Parsing macros/get_custom_name/get_custom_alias.sql 2022-06-21 09:12:06 normalization > 09:09:31.055196 [debug] [MainThread]: Parsing macros/get_custom_name/get_custom_schema.sql 2022-06-21 09:12:06 normalization > 09:09:31.069602 [debug] [MainThread]: Parsing macros/get_custom_name/get_custom_database.sql 2022-06-21 09:12:06 normalization > 09:09:31.079123 [debug] [MainThread]: Parsing macros/materializations/configs.sql 2022-06-21 09:12:06 normalization > 09:09:31.092772 [debug] [MainThread]: Parsing macros/materializations/hooks.sql 2022-06-21 09:12:06 normalization > 09:09:31.115703 [debug] [MainThread]: Parsing macros/materializations/models/table/create_table_as.sql 2022-06-21 09:12:06 normalization > 09:09:31.132887 [debug] [MainThread]: Parsing macros/materializations/models/table/table.sql 2022-06-21 09:12:06 normalization > 09:09:31.174917 [debug] [MainThread]: Parsing macros/materializations/models/view/view.sql 2022-06-21 09:12:06 normalization > 09:09:31.216039 [debug] [MainThread]: Parsing macros/materializations/models/view/helpers.sql 2022-06-21 09:12:06 normalization > 09:09:31.223543 [debug] [MainThread]: Parsing macros/materializations/models/view/create_view_as.sql 2022-06-21 09:12:06 normalization > 09:09:31.236874 [debug] [MainThread]: Parsing macros/materializations/models/view/create_or_replace_view.sql 2022-06-21 09:12:06 normalization > 09:09:31.252918 [debug] [MainThread]: Parsing macros/materializations/models/incremental/merge.sql 2022-06-21 09:12:06 normalization > 09:09:31.320924 [debug] [MainThread]: Parsing macros/materializations/models/incremental/column_helpers.sql 2022-06-21 09:12:06 normalization > 09:09:31.347799 [debug] [MainThread]: Parsing macros/materializations/models/incremental/is_incremental.sql 2022-06-21 09:12:06 normalization > 09:09:31.356455 [debug] [MainThread]: Parsing macros/materializations/models/incremental/incremental.sql 2022-06-21 09:12:06 normalization > 09:09:31.418680 [debug] [MainThread]: Parsing macros/materializations/models/incremental/on_schema_change.sql 2022-06-21 09:12:06 normalization > 09:09:31.514510 [debug] [MainThread]: Parsing macros/materializations/tests/test.sql 2022-06-21 09:12:06 normalization > 09:09:31.540987 [debug] [MainThread]: Parsing macros/materializations/tests/where_subquery.sql 2022-06-21 09:12:06 normalization > 09:09:31.551633 [debug] [MainThread]: Parsing macros/materializations/tests/helpers.sql 2022-06-21 09:12:06 normalization > 09:09:31.561948 [debug] [MainThread]: Parsing macros/materializations/seeds/helpers.sql 2022-06-21 09:12:06 normalization > 09:09:31.658667 [debug] [MainThread]: Parsing macros/materializations/seeds/seed.sql 2022-06-21 09:12:06 normalization > 09:09:31.694910 [debug] [MainThread]: Parsing macros/materializations/snapshots/snapshot_merge.sql 2022-06-21 09:12:06 normalization > 09:09:31.704511 [debug] [MainThread]: Parsing macros/materializations/snapshots/helpers.sql 2022-06-21 09:12:06 normalization > 09:09:31.769815 [debug] [MainThread]: Parsing macros/materializations/snapshots/strategies.sql 2022-06-21 09:12:06 normalization > 09:09:31.871440 [debug] [MainThread]: Parsing macros/materializations/snapshots/snapshot.sql 2022-06-21 09:12:06 normalization > 09:09:31.938575 [debug] [MainThread]: Parsing macros/generic_test_sql/not_null.sql 2022-06-21 09:12:06 normalization > 09:09:31.941590 [debug] [MainThread]: Parsing macros/generic_test_sql/accepted_values.sql 2022-06-21 09:12:06 normalization > 09:09:31.949424 [debug] [MainThread]: Parsing macros/generic_test_sql/relationships.sql 2022-06-21 09:12:06 normalization > 09:09:31.954430 [debug] [MainThread]: Parsing macros/generic_test_sql/unique.sql 2022-06-21 09:12:06 normalization > 09:09:31.958304 [debug] [MainThread]: Parsing macros/adapters/schema.sql 2022-06-21 09:12:06 normalization > 09:09:31.970699 [debug] [MainThread]: Parsing macros/adapters/metadata.sql 2022-06-21 09:12:06 normalization > 09:09:32.015975 [debug] [MainThread]: Parsing macros/adapters/freshness.sql 2022-06-21 09:12:06 normalization > 09:09:32.033167 [debug] [MainThread]: Parsing macros/adapters/indexes.sql 2022-06-21 09:12:06 normalization > 09:09:32.048633 [debug] [MainThread]: Parsing macros/adapters/persist_docs.sql 2022-06-21 09:12:06 normalization > 09:09:32.074455 [debug] [MainThread]: Parsing macros/adapters/relation.sql 2022-06-21 09:12:06 normalization > 09:09:32.130598 [debug] [MainThread]: Parsing macros/adapters/columns.sql 2022-06-21 09:12:06 normalization > 09:09:32.187569 [debug] [MainThread]: Parsing tests/generic/builtin.sql 2022-06-21 09:12:06 normalization > 09:09:32.205174 [debug] [MainThread]: Parsing macros/web/get_url_parameter.sql 2022-06-21 09:12:06 normalization > 09:09:32.214361 [debug] [MainThread]: Parsing macros/web/get_url_host.sql 2022-06-21 09:12:06 normalization > 09:09:32.226137 [debug] [MainThread]: Parsing macros/web/get_url_path.sql 2022-06-21 09:12:06 normalization > 09:09:32.240889 [debug] [MainThread]: Parsing macros/schema_tests/not_accepted_values.sql 2022-06-21 09:12:06 normalization > 09:09:32.253073 [debug] [MainThread]: Parsing macros/schema_tests/relationships_where.sql 2022-06-21 09:12:06 normalization > 09:09:32.265914 [debug] [MainThread]: Parsing macros/schema_tests/equal_rowcount.sql 2022-06-21 09:12:06 normalization > 09:09:32.275353 [debug] [MainThread]: Parsing macros/schema_tests/cardinality_equality.sql 2022-06-21 09:12:06 normalization > 09:09:32.286979 [debug] [MainThread]: Parsing macros/schema_tests/test_not_null_where.sql 2022-06-21 09:12:06 normalization > 09:09:32.295217 [debug] [MainThread]: Parsing macros/schema_tests/accepted_range.sql 2022-06-21 09:12:06 normalization > 09:09:32.309896 [debug] [MainThread]: Parsing macros/schema_tests/mutually_exclusive_ranges.sql 2022-06-21 09:12:06 normalization > 09:09:32.361549 [debug] [MainThread]: Parsing macros/schema_tests/expression_is_true.sql 2022-06-21 09:12:06 normalization > 09:09:32.372103 [debug] [MainThread]: Parsing macros/schema_tests/not_constant.sql 2022-06-21 09:12:06 normalization > 09:09:32.379184 [debug] [MainThread]: Parsing macros/schema_tests/fewer_rows_than.sql 2022-06-21 09:12:06 normalization > 09:09:32.388817 [debug] [MainThread]: Parsing macros/schema_tests/test_unique_where.sql 2022-06-21 09:12:06 normalization > 09:09:32.397006 [debug] [MainThread]: Parsing macros/schema_tests/equality.sql 2022-06-21 09:12:06 normalization > 09:09:32.418658 [debug] [MainThread]: Parsing macros/schema_tests/sequential_values.sql 2022-06-21 09:12:06 normalization > 09:09:32.435526 [debug] [MainThread]: Parsing macros/schema_tests/at_least_one.sql 2022-06-21 09:12:06 normalization > 09:09:32.442720 [debug] [MainThread]: Parsing macros/schema_tests/unique_combination_of_columns.sql 2022-06-21 09:12:06 normalization > 09:09:32.459849 [debug] [MainThread]: Parsing macros/schema_tests/recency.sql 2022-06-21 09:12:06 normalization > 09:09:32.465537 [debug] [MainThread]: Parsing macros/schema_tests/not_null_proportion.sql 2022-06-21 09:12:06 normalization > 09:09:32.472935 [debug] [MainThread]: Parsing macros/sql/star.sql 2022-06-21 09:12:06 normalization > 09:09:32.487565 [debug] [MainThread]: Parsing macros/sql/get_column_values.sql 2022-06-21 09:12:06 normalization > 09:09:32.505488 [debug] [MainThread]: Parsing macros/sql/get_tables_by_pattern_sql.sql 2022-06-21 09:12:06 normalization > 09:09:32.527441 [debug] [MainThread]: Parsing macros/sql/get_relations_by_prefix.sql 2022-06-21 09:12:06 normalization > 09:09:32.538546 [debug] [MainThread]: Parsing macros/sql/nullcheck_table.sql 2022-06-21 09:12:06 normalization > 09:09:32.543682 [debug] [MainThread]: Parsing macros/sql/get_relations_by_pattern.sql 2022-06-21 09:12:06 normalization > 09:09:32.555863 [debug] [MainThread]: Parsing macros/sql/generate_series.sql 2022-06-21 09:12:06 normalization > 09:09:32.570222 [debug] [MainThread]: Parsing macros/sql/get_tables_by_prefix_sql.sql 2022-06-21 09:12:06 normalization > 09:09:32.575571 [debug] [MainThread]: Parsing macros/sql/haversine_distance.sql 2022-06-21 09:12:06 normalization > 09:09:32.601653 [debug] [MainThread]: Parsing macros/sql/groupby.sql 2022-06-21 09:12:06 normalization > 09:09:32.605923 [debug] [MainThread]: Parsing macros/sql/date_spine.sql 2022-06-21 09:12:06 normalization > 09:09:32.619971 [debug] [MainThread]: Parsing macros/sql/unpivot.sql 2022-06-21 09:12:06 normalization > 09:09:32.647846 [debug] [MainThread]: Parsing macros/sql/get_table_types_sql.sql 2022-06-21 09:12:06 normalization > 09:09:32.652033 [debug] [MainThread]: Parsing macros/sql/surrogate_key.sql 2022-06-21 09:12:06 normalization > 09:09:32.663645 [debug] [MainThread]: Parsing macros/sql/safe_add.sql 2022-06-21 09:12:06 normalization > 09:09:32.668860 [debug] [MainThread]: Parsing macros/sql/union.sql 2022-06-21 09:12:06 normalization > 09:09:32.710598 [debug] [MainThread]: Parsing macros/sql/pivot.sql 2022-06-21 09:12:06 normalization > 09:09:32.724466 [debug] [MainThread]: Parsing macros/sql/get_query_results_as_dict.sql 2022-06-21 09:12:06 normalization > 09:09:32.732141 [debug] [MainThread]: Parsing macros/sql/nullcheck.sql 2022-06-21 09:12:06 normalization > 09:09:32.737448 [debug] [MainThread]: Parsing macros/materializations/insert_by_period_materialization.sql 2022-06-21 09:12:06 normalization > 09:09:32.823634 [debug] [MainThread]: Parsing macros/cross_db_utils/current_timestamp.sql 2022-06-21 09:12:06 normalization > 09:09:32.834799 [debug] [MainThread]: Parsing macros/cross_db_utils/datediff.sql 2022-06-21 09:12:06 normalization > 09:09:32.872134 [debug] [MainThread]: Parsing macros/cross_db_utils/dateadd.sql 2022-06-21 09:12:06 normalization > 09:09:32.881440 [debug] [MainThread]: Parsing macros/cross_db_utils/datatypes.sql 2022-06-21 09:12:06 normalization > 09:09:32.903245 [debug] [MainThread]: Parsing macros/cross_db_utils/replace.sql 2022-06-21 09:12:06 normalization > 09:09:32.907392 [debug] [MainThread]: Parsing macros/cross_db_utils/position.sql 2022-06-21 09:12:06 normalization > 09:09:32.912239 [debug] [MainThread]: Parsing macros/cross_db_utils/_is_relation.sql 2022-06-21 09:12:06 normalization > 09:09:32.918008 [debug] [MainThread]: Parsing macros/cross_db_utils/hash.sql 2022-06-21 09:12:06 normalization > 09:09:32.922500 [debug] [MainThread]: Parsing macros/cross_db_utils/date_trunc.sql 2022-06-21 09:12:06 normalization > 09:09:32.927157 [debug] [MainThread]: Parsing macros/cross_db_utils/safe_cast.sql 2022-06-21 09:12:06 normalization > 09:09:32.933153 [debug] [MainThread]: Parsing macros/cross_db_utils/literal.sql 2022-06-21 09:12:06 normalization > 09:09:32.936033 [debug] [MainThread]: Parsing macros/cross_db_utils/right.sql 2022-06-21 09:12:06 normalization > 09:09:32.944278 [debug] [MainThread]: Parsing macros/cross_db_utils/width_bucket.sql 2022-06-21 09:12:06 normalization > 09:09:32.962655 [debug] [MainThread]: Parsing macros/cross_db_utils/escape_single_quotes.sql 2022-06-21 09:12:06 normalization > 09:09:32.968321 [debug] [MainThread]: Parsing macros/cross_db_utils/identifier.sql 2022-06-21 09:12:06 normalization > 09:09:32.973484 [debug] [MainThread]: Parsing macros/cross_db_utils/bool_or.sql 2022-06-21 09:12:06 normalization > 09:09:32.979140 [debug] [MainThread]: Parsing macros/cross_db_utils/split_part.sql 2022-06-21 09:12:06 normalization > 09:09:32.984944 [debug] [MainThread]: Parsing macros/cross_db_utils/length.sql 2022-06-21 09:12:06 normalization > 09:09:32.988895 [debug] [MainThread]: Parsing macros/cross_db_utils/concat.sql 2022-06-21 09:12:06 normalization > 09:09:32.991906 [debug] [MainThread]: Parsing macros/cross_db_utils/any_value.sql 2022-06-21 09:12:06 normalization > 09:09:32.996020 [debug] [MainThread]: Parsing macros/cross_db_utils/intersect.sql 2022-06-21 09:12:06 normalization > 09:09:32.999288 [debug] [MainThread]: Parsing macros/cross_db_utils/last_day.sql 2022-06-21 09:12:06 normalization > 09:09:33.015704 [debug] [MainThread]: Parsing macros/cross_db_utils/except.sql 2022-06-21 09:12:06 normalization > 09:09:33.019235 [debug] [MainThread]: Parsing macros/cross_db_utils/cast_bool_to_text.sql 2022-06-21 09:12:06 normalization > 09:09:33.023906 [debug] [MainThread]: Parsing macros/cross_db_utils/_is_ephemeral.sql 2022-06-21 09:12:06 normalization > 09:09:33.030269 [debug] [MainThread]: Parsing macros/jinja_helpers/log_info.sql 2022-06-21 09:12:06 normalization > 09:09:33.033879 [debug] [MainThread]: Parsing macros/jinja_helpers/slugify.sql 2022-06-21 09:12:06 normalization > 09:09:33.037557 [debug] [MainThread]: Parsing macros/jinja_helpers/pretty_log_format.sql 2022-06-21 09:12:06 normalization > 09:09:33.041296 [debug] [MainThread]: Parsing macros/jinja_helpers/pretty_time.sql 2022-06-21 09:12:06 normalization > 09:09:35.444470 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/hubspot_test_email/email_events_stg.sql 2022-06-21 09:12:06 normalization > 09:09:35.875340 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/hubspot_test_email/email_events_stg.sql 2022-06-21 09:12:06 normalization > 09:09:35.881747 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/hubspot_test_email/email_events_causedBy.sql 2022-06-21 09:12:06 normalization > 09:09:35.924570 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/hubspot_test_email/email_events_causedBy.sql 2022-06-21 09:12:06 normalization > 09:09:35.930953 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/hubspot_test_email/email_events.sql 2022-06-21 09:12:06 normalization > 09:09:36.059513 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/hubspot_test_email/email_events.sql 2022-06-21 09:12:06 normalization > 09:09:36.065760 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/hubspot_test_email/email_events_sentBy.sql 2022-06-21 09:12:06 normalization > 09:09:36.100255 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/hubspot_test_email/email_events_sentBy.sql 2022-06-21 09:12:06 normalization > 09:09:36.106622 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/hubspot_test_email/email_events_location.sql 2022-06-21 09:12:06 normalization > 09:09:36.140401 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/hubspot_test_email/email_events_location.sql 2022-06-21 09:12:06 normalization > 09:09:36.146685 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/hubspot_test_email/email_events_browser.sql 2022-06-21 09:12:06 normalization > 09:09:36.180442 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/hubspot_test_email/email_events_browser.sql 2022-06-21 09:12:06 normalization > 09:09:36.189078 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/hubspot_test_email/email_events_obsoletedBy.sql 2022-06-21 09:12:06 normalization > 09:09:36.225034 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/hubspot_test_email/email_events_obsoletedBy.sql 2022-06-21 09:12:06 normalization > 09:09:36.233104 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/hubspot_test_email/email_events_scd.sql 2022-06-21 09:12:06 normalization > 09:09:36.348935 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/hubspot_test_email/email_events_scd.sql 2022-06-21 09:12:06 normalization > 09:09:36.365892 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_obsoletedBy_ab1.sql 2022-06-21 09:12:06 normalization > 09:09:36.480007 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_obsoletedBy_ab1.sql 2022-06-21 09:12:06 normalization > 09:09:36.487413 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_location_ab2.sql 2022-06-21 09:12:06 normalization > 09:09:36.538164 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_location_ab2.sql 2022-06-21 09:12:06 normalization > 09:09:36.543070 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_sentBy_ab1.sql 2022-06-21 09:12:06 normalization > 09:09:36.581389 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_sentBy_ab1.sql 2022-06-21 09:12:06 normalization > 09:09:36.588486 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_location_ab3.sql 2022-06-21 09:12:06 normalization > 09:09:36.655292 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_location_ab3.sql 2022-06-21 09:12:06 normalization > 09:09:36.660726 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_location_ab1.sql 2022-06-21 09:12:06 normalization > 09:09:36.744640 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_location_ab1.sql 2022-06-21 09:12:06 normalization > 09:09:36.751156 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_browser_ab1.sql 2022-06-21 09:12:06 normalization > 09:09:36.829546 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_browser_ab1.sql 2022-06-21 09:12:06 normalization > 09:09:36.837426 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_ab2.sql 2022-06-21 09:12:06 normalization > 09:09:36.972288 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_ab2.sql 2022-06-21 09:12:06 normalization > 09:09:36.975825 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_obsoletedBy_ab2.sql 2022-06-21 09:12:06 normalization > 09:09:36.996483 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_obsoletedBy_ab2.sql 2022-06-21 09:12:06 normalization > 09:09:37.000556 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_sentBy_ab2.sql 2022-06-21 09:12:06 normalization > 09:09:37.023144 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_sentBy_ab2.sql 2022-06-21 09:12:06 normalization > 09:09:37.026724 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_obsoletedBy_ab3.sql 2022-06-21 09:12:06 normalization > 09:09:37.049182 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_obsoletedBy_ab3.sql 2022-06-21 09:12:06 normalization > 09:09:37.052736 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_causedBy_ab3.sql 2022-06-21 09:12:06 normalization > 09:09:37.075415 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_causedBy_ab3.sql 2022-06-21 09:12:06 normalization > 09:09:37.079833 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_ab1.sql 2022-06-21 09:12:06 normalization > 09:09:37.211040 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_ab1.sql 2022-06-21 09:12:06 normalization > 09:09:37.214594 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_browser_ab3.sql 2022-06-21 09:12:06 normalization > 09:09:37.242062 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_browser_ab3.sql 2022-06-21 09:12:06 normalization > 09:09:37.245601 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_causedBy_ab1.sql 2022-06-21 09:12:06 normalization > 09:09:37.268166 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_causedBy_ab1.sql 2022-06-21 09:12:06 normalization > 09:09:37.271694 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_sentBy_ab3.sql 2022-06-21 09:12:06 normalization > 09:09:37.294708 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_sentBy_ab3.sql 2022-06-21 09:12:06 normalization > 09:09:37.298966 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_browser_ab2.sql 2022-06-21 09:12:06 normalization > 09:09:37.324042 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_browser_ab2.sql 2022-06-21 09:12:06 normalization > 09:09:37.327956 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_causedBy_ab2.sql 2022-06-21 09:12:06 normalization > 09:09:37.351226 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_causedBy_ab2.sql 2022-06-21 09:12:06 normalization > 09:09:37.573347 [warn ] [MainThread]: [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. 2022-06-21 09:12:06 normalization > There are 1 unused configuration paths: 2022-06-21 09:12:06 normalization > - models.airbyte_utils.generated.airbyte_tables 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > 09:09:37.629245 [info ] [MainThread]: Found 25 models, 0 tests, 0 snapshots, 0 analyses, 549 macros, 0 operations, 0 seed files, 1 source, 0 exposures, 0 metrics 2022-06-21 09:12:06 normalization > 09:09:37.635982 [info ] [MainThread]: 2022-06-21 09:12:06 normalization > 09:09:37.638046 [debug] [MainThread]: Acquiring new bigquery connection "master" 2022-06-21 09:12:06 normalization > 09:09:37.641703 [debug] [ThreadPool]: Acquiring new bigquery connection "list_analytics-platform-201110" 2022-06-21 09:12:06 normalization > 09:09:37.643469 [debug] [ThreadPool]: Acquiring new bigquery connection "list_analytics-platform-201110" 2022-06-21 09:12:06 normalization > 09:09:37.644141 [debug] [ThreadPool]: Opening a new connection, currently in state init 2022-06-21 09:12:06 normalization > 09:09:37.644578 [debug] [ThreadPool]: Opening a new connection, currently in state init 2022-06-21 09:12:06 normalization > 09:09:38.858565 [debug] [ThreadPool]: Acquiring new bigquery connection "create_analytics-platform-201110__airbyte_hubspot_test_email" 2022-06-21 09:12:06 normalization > 09:09:38.862248 [debug] [ThreadPool]: Acquiring new bigquery connection "create_analytics-platform-201110__airbyte_hubspot_test_email" 2022-06-21 09:12:06 normalization > 09:09:38.863785 [debug] [ThreadPool]: BigQuery adapter: Creating schema "analytics-platform-201110._airbyte_hubspot_test_email". 2022-06-21 09:12:06 normalization > 09:09:38.864711 [debug] [ThreadPool]: Opening a new connection, currently in state closed 2022-06-21 09:12:06 normalization > 09:09:40.112593 [debug] [ThreadPool]: Acquiring new bigquery connection "list_analytics-platform-201110_hubspot_test_email" 2022-06-21 09:12:06 normalization > 09:09:40.116130 [debug] [ThreadPool]: Acquiring new bigquery connection "list_analytics-platform-201110__airbyte_hubspot_test_email" 2022-06-21 09:12:06 normalization > 09:09:40.117460 [debug] [ThreadPool]: Opening a new connection, currently in state closed 2022-06-21 09:12:06 normalization > 09:09:40.118565 [debug] [ThreadPool]: Opening a new connection, currently in state closed 2022-06-21 09:12:06 normalization > 09:09:40.616616 [info ] [MainThread]: Concurrency: 8 threads (target='prod') 2022-06-21 09:12:06 normalization > 09:09:40.617909 [info ] [MainThread]: 2022-06-21 09:12:06 normalization > 09:09:40.685335 [debug] [Thread-1 ]: Began running node model.airbyte_utils.email_events_ab1 2022-06-21 09:12:06 normalization > 09:09:40.688424 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_ab1" 2022-06-21 09:12:06 normalization > 09:09:40.689318 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.email_events_ab1 2022-06-21 09:12:06 normalization > 09:09:40.690155 [debug] [Thread-1 ]: Compiling model.airbyte_utils.email_events_ab1 2022-06-21 09:12:06 normalization > 09:09:40.853324 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.email_events_ab1" 2022-06-21 09:12:06 normalization > 09:09:40.854472 [debug] [Thread-1 ]: finished collecting timing info 2022-06-21 09:12:06 normalization > 09:09:40.855920 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.email_events_ab1 2022-06-21 09:12:06 normalization > 09:09:40.857272 [debug] [Thread-3 ]: Began running node model.airbyte_utils.email_events_ab2 2022-06-21 09:12:06 normalization > 09:09:40.859047 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_ab2" 2022-06-21 09:12:06 normalization > 09:09:40.859437 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.email_events_ab2 2022-06-21 09:12:06 normalization > 09:09:40.859730 [debug] [Thread-3 ]: Compiling model.airbyte_utils.email_events_ab2 2022-06-21 09:12:06 normalization > 09:09:41.072219 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.email_events_ab2" 2022-06-21 09:12:06 normalization > 09:09:41.072949 [debug] [Thread-3 ]: finished collecting timing info 2022-06-21 09:12:06 normalization > 09:09:41.074269 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.email_events_ab2 2022-06-21 09:12:06 normalization > 09:09:41.075478 [debug] [Thread-5 ]: Began running node model.airbyte_utils.email_events_stg 2022-06-21 09:12:06 normalization > 09:09:41.076348 [info ] [Thread-5 ]: 1 of 8 START view model _airbyte_hubspot_test_email.email_events_stg.................................................... [RUN] 2022-06-21 09:12:06 normalization > 09:09:41.079313 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_stg" 2022-06-21 09:12:06 normalization > 09:09:41.079745 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.email_events_stg 2022-06-21 09:12:06 normalization > 09:09:41.080042 [debug] [Thread-5 ]: Compiling model.airbyte_utils.email_events_stg 2022-06-21 09:12:06 normalization > 09:09:41.320726 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.email_events_stg" 2022-06-21 09:12:06 normalization > 09:09:41.321632 [debug] [Thread-5 ]: finished collecting timing info 2022-06-21 09:12:06 normalization > 09:09:41.322052 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.email_events_stg 2022-06-21 09:12:06 normalization > 09:09:41.419372 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.email_events_stg" 2022-06-21 09:12:06 normalization > 09:09:41.420577 [debug] [Thread-5 ]: Opening a new connection, currently in state init 2022-06-21 09:12:06 normalization > 09:09:41.434181 [debug] [Thread-5 ]: On model.airbyte_utils.email_events_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.email_events_stg"} */ 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > create or replace view `analytics-platform-201110`._airbyte_hubspot_test_email.`email_events_stg` 2022-06-21 09:12:06 normalization > OPTIONS() 2022-06-21 09:12:06 normalization > as 2022-06-21 09:12:06 normalization > with __dbt__cte__email_events_ab1 as ( 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-06-21 09:12:06 normalization > -- depends_on: `analytics-platform-201110`.hubspot_test_email._airbyte_raw_email_events 2022-06-21 09:12:06 normalization > select 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['url']") as url, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['from']") as `from`, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['hmid']") as hmid, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['type']") as type, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['appId']") as appId, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['linkId']") as linkId, 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > json_extract(table_alias._airbyte_data, "$['sentBy']") 2022-06-21 09:12:06 normalization > as sentBy, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['smtpId']") as smtpId, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['source']") as source, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['status']") as status, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['appName']") as appName, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['attempt']") as attempt, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['bounced']") as bounced, 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > json_extract(table_alias._airbyte_data, "$['browser']") 2022-06-21 09:12:06 normalization > as browser, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['created']") as created, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['referer']") as referer, 2022-06-21 09:12:06 normalization > json_extract_string_array(_airbyte_data, "$['replyTo']") as replyTo, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['subject']") as subject, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['category']") as category, 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > json_extract(table_alias._airbyte_data, "$['causedBy']") 2022-06-21 09:12:06 normalization > as causedBy, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['duration']") as duration, 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > json_extract(table_alias._airbyte_data, "$['location']") 2022-06-21 09:12:06 normalization > as location, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['portalId']") as portalId, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['response']") as response, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['sourceId']") as sourceId, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['ipAddress']") as ipAddress, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['recipient']") as recipient, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['userAgent']") as userAgent, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['deviceType']") as deviceType, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['dropReason']") as dropReason, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['dropMessage']") as dropMessage, 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > json_extract(table_alias._airbyte_data, "$['obsoletedBy']") 2022-06-21 09:12:06 normalization > as obsoletedBy, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['requestedBy']") as requestedBy, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['filteredEvent']") as filteredEvent, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['emailCampaignId']") as emailCampaignId, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['requestedByUserId']") as requestedByUserId, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['emailCampaignGroupId']") as emailCampaignGroupId, 2022-06-21 09:12:06 normalization > json_extract_scalar(_airbyte_data, "$['portalSubscriptionStatus']") as portalSubscriptionStatus, 2022-06-21 09:12:06 normalization > _airbyte_ab_id, 2022-06-21 09:12:06 normalization > _airbyte_emitted_at, 2022-06-21 09:12:06 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-06-21 09:12:06 normalization > from `analytics-platform-201110`.hubspot_test_email._airbyte_raw_email_events as table_alias 2022-06-21 09:12:06 normalization > -- email_events 2022-06-21 09:12:06 normalization > where 1 = 1 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > ), __dbt__cte__email_events_ab2 as ( 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-06-21 09:12:06 normalization > -- depends_on: __dbt__cte__email_events_ab1 2022-06-21 09:12:06 normalization > select 2022-06-21 09:12:06 normalization > cast(id as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ) as id, 2022-06-21 09:12:06 normalization > cast(url as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ) as url, 2022-06-21 09:12:06 normalization > cast(`from` as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ) as `from`, 2022-06-21 09:12:06 normalization > cast(hmid as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ) as hmid, 2022-06-21 09:12:06 normalization > cast(type as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ) as type, 2022-06-21 09:12:06 normalization > cast(appId as 2022-06-21 09:12:06 normalization > int64 2022-06-21 09:12:06 normalization > ) as appId, 2022-06-21 09:12:06 normalization > cast(linkId as 2022-06-21 09:12:06 normalization > int64 2022-06-21 09:12:06 normalization > ) as linkId, 2022-06-21 09:12:06 normalization > cast(sentBy as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ) as sentBy, 2022-06-21 09:12:06 normalization > cast(smtpId as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ) as smtpId, 2022-06-21 09:12:06 normalization > cast(source as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ) as source, 2022-06-21 09:12:06 normalization > cast(status as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ) as status, 2022-06-21 09:12:06 normalization > cast(appName as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ) as appName, 2022-06-21 09:12:06 normalization > cast(attempt as 2022-06-21 09:12:06 normalization > int64 2022-06-21 09:12:06 normalization > ) as attempt, 2022-06-21 09:12:06 normalization > cast(bounced as boolean) as bounced, 2022-06-21 09:12:06 normalization > cast(browser as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ) as browser, 2022-06-21 09:12:06 normalization > cast(created as 2022-06-21 09:12:06 normalization > int64 2022-06-21 09:12:06 normalization > ) as created, 2022-06-21 09:12:06 normalization > cast(referer as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ) as referer, 2022-06-21 09:12:06 normalization > replyTo, 2022-06-21 09:12:06 normalization > cast(subject as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ) as subject, 2022-06-21 09:12:06 normalization > cast(category as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ) as category, 2022-06-21 09:12:06 normalization > cast(causedBy as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ) as causedBy, 2022-06-21 09:12:06 normalization > cast(duration as 2022-06-21 09:12:06 normalization > int64 2022-06-21 09:12:06 normalization > ) as duration, 2022-06-21 09:12:06 normalization > cast(location as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ) as location, 2022-06-21 09:12:06 normalization > cast(portalId as 2022-06-21 09:12:06 normalization > int64 2022-06-21 09:12:06 normalization > ) as portalId, 2022-06-21 09:12:06 normalization > cast(response as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ) as response, 2022-06-21 09:12:06 normalization > cast(sourceId as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ) as sourceId, 2022-06-21 09:12:06 normalization > cast(ipAddress as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ) as ipAddress, 2022-06-21 09:12:06 normalization > cast(recipient as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ) as recipient, 2022-06-21 09:12:06 normalization > cast(userAgent as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ) as userAgent, 2022-06-21 09:12:06 normalization > cast(deviceType as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ) as deviceType, 2022-06-21 09:12:06 normalization > cast(dropReason as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ) as dropReason, 2022-06-21 09:12:06 normalization > cast(dropMessage as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ) as dropMessage, 2022-06-21 09:12:06 normalization > cast(obsoletedBy as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ) as obsoletedBy, 2022-06-21 09:12:06 normalization > cast(requestedBy as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ) as requestedBy, 2022-06-21 09:12:06 normalization > cast(filteredEvent as boolean) as filteredEvent, 2022-06-21 09:12:06 normalization > cast(emailCampaignId as 2022-06-21 09:12:06 normalization > int64 2022-06-21 09:12:06 normalization > ) as emailCampaignId, 2022-06-21 09:12:06 normalization > cast(requestedByUserId as 2022-06-21 09:12:06 normalization > int64 2022-06-21 09:12:06 normalization > ) as requestedByUserId, 2022-06-21 09:12:06 normalization > cast(emailCampaignGroupId as 2022-06-21 09:12:06 normalization > int64 2022-06-21 09:12:06 normalization > ) as emailCampaignGroupId, 2022-06-21 09:12:06 normalization > cast(portalSubscriptionStatus as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ) as portalSubscriptionStatus, 2022-06-21 09:12:06 normalization > _airbyte_ab_id, 2022-06-21 09:12:06 normalization > _airbyte_emitted_at, 2022-06-21 09:12:06 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-06-21 09:12:06 normalization > from __dbt__cte__email_events_ab1 2022-06-21 09:12:06 normalization > -- email_events 2022-06-21 09:12:06 normalization > where 1 = 1 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > )-- SQL model to build a hash column based on the values of this record 2022-06-21 09:12:06 normalization > -- depends_on: __dbt__cte__email_events_ab2 2022-06-21 09:12:06 normalization > select 2022-06-21 09:12:06 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(url as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(`from` as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(hmid as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(type as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(appId as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(linkId as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(sentBy as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(smtpId as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(source as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(status as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(appName as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(attempt as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(bounced as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(browser as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(created as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(referer as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(array_to_string(replyTo, "|", "") as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(subject as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(category as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(causedBy as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(duration as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(location as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(portalId as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(response as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(sourceId as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(ipAddress as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(recipient as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(userAgent as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(deviceType as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(dropReason as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(dropMessage as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(obsoletedBy as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(requestedBy as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(filteredEvent as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(emailCampaignId as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(requestedByUserId as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(emailCampaignGroupId as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(portalSubscriptionStatus as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), '')) as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ))) as _airbyte_email_events_hashid, 2022-06-21 09:12:06 normalization > tmp.* 2022-06-21 09:12:06 normalization > from __dbt__cte__email_events_ab2 tmp 2022-06-21 09:12:06 normalization > -- email_events 2022-06-21 09:12:06 normalization > where 1 = 1 2022-06-21 09:12:06 normalization > ; 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > 09:09:42.785543 [debug] [Thread-5 ]: finished collecting timing info 2022-06-21 09:12:06 normalization > 09:09:42.789763 [info ] [Thread-5 ]: 1 of 8 OK created view model _airbyte_hubspot_test_email.email_events_stg............................................... [OK in 1.71s] 2022-06-21 09:12:06 normalization > 09:09:42.791852 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.email_events_stg 2022-06-21 09:12:06 normalization > 09:09:42.794034 [debug] [Thread-7 ]: Began running node model.airbyte_utils.email_events_scd 2022-06-21 09:12:06 normalization > 09:09:42.795945 [info ] [Thread-7 ]: 2 of 8 START incremental model hubspot_test_email.email_events_scd...................................................... [RUN] 2022-06-21 09:12:06 normalization > 09:09:42.799855 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_scd" 2022-06-21 09:12:06 normalization > 09:09:42.800526 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.email_events_scd 2022-06-21 09:12:06 normalization > 09:09:42.801043 [debug] [Thread-7 ]: Compiling model.airbyte_utils.email_events_scd 2022-06-21 09:12:06 normalization > 09:09:42.881983 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.email_events_scd" 2022-06-21 09:12:06 normalization > 09:09:42.883381 [debug] [Thread-7 ]: finished collecting timing info 2022-06-21 09:12:06 normalization > 09:09:42.884011 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.email_events_scd 2022-06-21 09:12:06 normalization > 09:09:43.021896 [debug] [Thread-7 ]: Opening a new connection, currently in state init 2022-06-21 09:12:06 normalization > 09:09:43.604857 [debug] [Thread-7 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/analytics-platform-201110/datasets/hubspot_test_email/tables/email_events_scd?prettyPrint=false: Not found: Table analytics-platform-201110:hubspot_test_email.email_events_scd 2022-06-21 09:12:06 normalization > 09:09:43.651861 [info ] [Thread-7 ]: 09:09:43 + `analytics-platform-201110`.hubspot_test_email.`email_events_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-06-21 09:12:06 normalization > 09:09:43.786667 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.email_events_scd" 2022-06-21 09:12:06 normalization > 09:09:43.788103 [debug] [Thread-7 ]: On model.airbyte_utils.email_events_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.email_events_scd"} */ 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > create or replace table `analytics-platform-201110`.hubspot_test_email.`email_events_scd` 2022-06-21 09:12:06 normalization > partition by range_bucket( 2022-06-21 09:12:06 normalization > _airbyte_active_row, 2022-06-21 09:12:06 normalization > generate_array(0, 1, 1) 2022-06-21 09:12:06 normalization > ) 2022-06-21 09:12:06 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-06-21 09:12:06 normalization > OPTIONS() 2022-06-21 09:12:06 normalization > as ( 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > -- depends_on: ref('email_events_stg') 2022-06-21 09:12:06 normalization > with 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > input_data as ( 2022-06-21 09:12:06 normalization > select * 2022-06-21 09:12:06 normalization > from `analytics-platform-201110`._airbyte_hubspot_test_email.`email_events_stg` 2022-06-21 09:12:06 normalization > -- email_events from `analytics-platform-201110`.hubspot_test_email._airbyte_raw_email_events 2022-06-21 09:12:06 normalization > ), 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > scd_data as ( 2022-06-21 09:12:06 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-06-21 09:12:06 normalization > select 2022-06-21 09:12:06 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), '')) as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ))) as _airbyte_unique_key, 2022-06-21 09:12:06 normalization > id, 2022-06-21 09:12:06 normalization > url, 2022-06-21 09:12:06 normalization > `from`, 2022-06-21 09:12:06 normalization > hmid, 2022-06-21 09:12:06 normalization > type, 2022-06-21 09:12:06 normalization > appId, 2022-06-21 09:12:06 normalization > linkId, 2022-06-21 09:12:06 normalization > sentBy, 2022-06-21 09:12:06 normalization > smtpId, 2022-06-21 09:12:06 normalization > source, 2022-06-21 09:12:06 normalization > status, 2022-06-21 09:12:06 normalization > appName, 2022-06-21 09:12:06 normalization > attempt, 2022-06-21 09:12:06 normalization > bounced, 2022-06-21 09:12:06 normalization > browser, 2022-06-21 09:12:06 normalization > created, 2022-06-21 09:12:06 normalization > referer, 2022-06-21 09:12:06 normalization > replyTo, 2022-06-21 09:12:06 normalization > subject, 2022-06-21 09:12:06 normalization > category, 2022-06-21 09:12:06 normalization > causedBy, 2022-06-21 09:12:06 normalization > duration, 2022-06-21 09:12:06 normalization > location, 2022-06-21 09:12:06 normalization > portalId, 2022-06-21 09:12:06 normalization > response, 2022-06-21 09:12:06 normalization > sourceId, 2022-06-21 09:12:06 normalization > ipAddress, 2022-06-21 09:12:06 normalization > recipient, 2022-06-21 09:12:06 normalization > userAgent, 2022-06-21 09:12:06 normalization > deviceType, 2022-06-21 09:12:06 normalization > dropReason, 2022-06-21 09:12:06 normalization > dropMessage, 2022-06-21 09:12:06 normalization > obsoletedBy, 2022-06-21 09:12:06 normalization > requestedBy, 2022-06-21 09:12:06 normalization > filteredEvent, 2022-06-21 09:12:06 normalization > emailCampaignId, 2022-06-21 09:12:06 normalization > requestedByUserId, 2022-06-21 09:12:06 normalization > emailCampaignGroupId, 2022-06-21 09:12:06 normalization > portalSubscriptionStatus, 2022-06-21 09:12:06 normalization > created as _airbyte_start_at, 2022-06-21 09:12:06 normalization > lag(created) over ( 2022-06-21 09:12:06 normalization > partition by id 2022-06-21 09:12:06 normalization > order by 2022-06-21 09:12:06 normalization > created is null asc, 2022-06-21 09:12:06 normalization > created desc, 2022-06-21 09:12:06 normalization > _airbyte_emitted_at desc 2022-06-21 09:12:06 normalization > ) as _airbyte_end_at, 2022-06-21 09:12:06 normalization > case when row_number() over ( 2022-06-21 09:12:06 normalization > partition by id 2022-06-21 09:12:06 normalization > order by 2022-06-21 09:12:06 normalization > created is null asc, 2022-06-21 09:12:06 normalization > created desc, 2022-06-21 09:12:06 normalization > _airbyte_emitted_at desc 2022-06-21 09:12:06 normalization > ) = 1 then 1 else 0 end as _airbyte_active_row, 2022-06-21 09:12:06 normalization > _airbyte_ab_id, 2022-06-21 09:12:06 normalization > _airbyte_emitted_at, 2022-06-21 09:12:06 normalization > _airbyte_email_events_hashid 2022-06-21 09:12:06 normalization > from input_data 2022-06-21 09:12:06 normalization > ), 2022-06-21 09:12:06 normalization > dedup_data as ( 2022-06-21 09:12:06 normalization > select 2022-06-21 09:12:06 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-06-21 09:12:06 normalization > -- additionally, we generate a unique key for the scd table 2022-06-21 09:12:06 normalization > row_number() over ( 2022-06-21 09:12:06 normalization > partition by 2022-06-21 09:12:06 normalization > _airbyte_unique_key, 2022-06-21 09:12:06 normalization > _airbyte_start_at, 2022-06-21 09:12:06 normalization > _airbyte_emitted_at 2022-06-21 09:12:06 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-06-21 09:12:06 normalization > ) as _airbyte_row_num, 2022-06-21 09:12:06 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ), '')) as 2022-06-21 09:12:06 normalization > string 2022-06-21 09:12:06 normalization > ))) as _airbyte_unique_key_scd, 2022-06-21 09:12:06 normalization > scd_data.* 2022-06-21 09:12:06 normalization > from scd_data 2022-06-21 09:12:06 normalization > ) 2022-06-21 09:12:06 normalization > select 2022-06-21 09:12:06 normalization > _airbyte_unique_key, 2022-06-21 09:12:06 normalization > _airbyte_unique_key_scd, 2022-06-21 09:12:06 normalization > id, 2022-06-21 09:12:06 normalization > url, 2022-06-21 09:12:06 normalization > `from`, 2022-06-21 09:12:06 normalization > hmid, 2022-06-21 09:12:06 normalization > type, 2022-06-21 09:12:06 normalization > appId, 2022-06-21 09:12:06 normalization > linkId, 2022-06-21 09:12:06 normalization > sentBy, 2022-06-21 09:12:06 normalization > smtpId, 2022-06-21 09:12:06 normalization > source, 2022-06-21 09:12:06 normalization > status, 2022-06-21 09:12:06 normalization > appName, 2022-06-21 09:12:06 normalization > attempt, 2022-06-21 09:12:06 normalization > bounced, 2022-06-21 09:12:06 normalization > browser, 2022-06-21 09:12:06 normalization > created, 2022-06-21 09:12:06 normalization > referer, 2022-06-21 09:12:06 normalization > replyTo, 2022-06-21 09:12:06 normalization > subject, 2022-06-21 09:12:06 normalization > category, 2022-06-21 09:12:06 normalization > causedBy, 2022-06-21 09:12:06 normalization > duration, 2022-06-21 09:12:06 normalization > location, 2022-06-21 09:12:06 normalization > portalId, 2022-06-21 09:12:06 normalization > response, 2022-06-21 09:12:06 normalization > sourceId, 2022-06-21 09:12:06 normalization > ipAddress, 2022-06-21 09:12:06 normalization > recipient, 2022-06-21 09:12:06 normalization > userAgent, 2022-06-21 09:12:06 normalization > deviceType, 2022-06-21 09:12:06 normalization > dropReason, 2022-06-21 09:12:06 normalization > dropMessage, 2022-06-21 09:12:06 normalization > obsoletedBy, 2022-06-21 09:12:06 normalization > requestedBy, 2022-06-21 09:12:06 normalization > filteredEvent, 2022-06-21 09:12:06 normalization > emailCampaignId, 2022-06-21 09:12:06 normalization > requestedByUserId, 2022-06-21 09:12:06 normalization > emailCampaignGroupId, 2022-06-21 09:12:06 normalization > portalSubscriptionStatus, 2022-06-21 09:12:06 normalization > _airbyte_start_at, 2022-06-21 09:12:06 normalization > _airbyte_end_at, 2022-06-21 09:12:06 normalization > _airbyte_active_row, 2022-06-21 09:12:06 normalization > _airbyte_ab_id, 2022-06-21 09:12:06 normalization > _airbyte_emitted_at, 2022-06-21 09:12:06 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-06-21 09:12:06 normalization > _airbyte_email_events_hashid 2022-06-21 09:12:06 normalization > from dedup_data where _airbyte_row_num = 1 2022-06-21 09:12:06 normalization > ); 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > 09:11:35.579227 [debug] [Thread-7 ]: On model.airbyte_utils.email_events_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.email_events_scd"} */ 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > -- We have to have a non-empty query, so just do a noop delete 2022-06-21 09:12:06 normalization > delete from `analytics-platform-201110`.hubspot_test_email.`email_events_scd` where 1=0 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > 09:11:37.828200 [debug] [Thread-7 ]: On model.airbyte_utils.email_events_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.email_events_scd"} */ 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > drop view _airbyte_hubspot_test_email.email_events_stg 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > 09:11:38.575714 [debug] [Thread-7 ]: finished collecting timing info 2022-06-21 09:12:06 normalization > 09:11:38.578201 [info ] [Thread-7 ]: 2 of 8 OK created incremental model hubspot_test_email.email_events_scd................................................. [CREATE TABLE (378.9k rows, 210.6 MB processed) in 115.78s] 2022-06-21 09:12:06 normalization > 09:11:38.579759 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.email_events_scd 2022-06-21 09:12:06 normalization > 09:11:38.582119 [debug] [Thread-2 ]: Began running node model.airbyte_utils.email_events 2022-06-21 09:12:06 normalization > 09:11:38.583141 [info ] [Thread-2 ]: 3 of 8 START incremental model hubspot_test_email.email_events.......................................................... [RUN] 2022-06-21 09:12:06 normalization > 09:11:38.588127 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events" 2022-06-21 09:12:06 normalization > 09:11:38.588815 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.email_events 2022-06-21 09:12:06 normalization > 09:11:38.589373 [debug] [Thread-2 ]: Compiling model.airbyte_utils.email_events 2022-06-21 09:12:06 normalization > 09:11:38.591337 [debug] [Thread-4 ]: Began running node model.airbyte_utils.email_events_causedBy_ab1 2022-06-21 09:12:06 normalization > 09:11:38.590079 [debug] [Thread-7 ]: Began running node model.airbyte_utils.email_events_browser_ab1 2022-06-21 09:12:06 normalization > 09:11:38.592098 [debug] [Thread-3 ]: Began running node model.airbyte_utils.email_events_location_ab1 2022-06-21 09:12:06 normalization > 09:11:38.594425 [debug] [Thread-6 ]: Began running node model.airbyte_utils.email_events_obsoletedBy_ab1 2022-06-21 09:12:06 normalization > 09:11:38.595277 [debug] [Thread-5 ]: Began running node model.airbyte_utils.email_events_sentBy_ab1 2022-06-21 09:12:06 normalization > 09:11:38.622987 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_causedBy_ab1" 2022-06-21 09:12:06 normalization > 09:11:38.639184 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.email_events" 2022-06-21 09:12:06 normalization > 09:11:38.643553 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_location_ab1" 2022-06-21 09:12:06 normalization > 09:11:38.641399 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_browser_ab1" 2022-06-21 09:12:06 normalization > 09:11:38.645811 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_obsoletedBy_ab1" 2022-06-21 09:12:06 normalization > 09:11:38.647845 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_sentBy_ab1" 2022-06-21 09:12:06 normalization > 09:11:38.648555 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.email_events_causedBy_ab1 2022-06-21 09:12:06 normalization > 09:11:38.649507 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.email_events_location_ab1 2022-06-21 09:12:06 normalization > 09:11:38.650300 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.email_events_browser_ab1 2022-06-21 09:12:06 normalization > 09:11:38.650851 [debug] [Thread-2 ]: finished collecting timing info 2022-06-21 09:12:06 normalization > 09:11:38.651384 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.email_events_obsoletedBy_ab1 2022-06-21 09:12:06 normalization > 09:11:38.651949 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.email_events_sentBy_ab1 2022-06-21 09:12:06 normalization > 09:11:38.652523 [debug] [Thread-4 ]: Compiling model.airbyte_utils.email_events_causedBy_ab1 2022-06-21 09:12:06 normalization > 09:11:38.653085 [debug] [Thread-3 ]: Compiling model.airbyte_utils.email_events_location_ab1 2022-06-21 09:12:06 normalization > 09:11:38.653738 [debug] [Thread-7 ]: Compiling model.airbyte_utils.email_events_browser_ab1 2022-06-21 09:12:06 normalization > 09:11:38.654357 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.email_events 2022-06-21 09:12:06 normalization > 09:11:38.655849 [debug] [Thread-6 ]: Compiling model.airbyte_utils.email_events_obsoletedBy_ab1 2022-06-21 09:12:06 normalization > 09:11:38.656509 [debug] [Thread-5 ]: Compiling model.airbyte_utils.email_events_sentBy_ab1 2022-06-21 09:12:06 normalization > 09:11:38.719327 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.email_events_causedBy_ab1" 2022-06-21 09:12:06 normalization > 09:11:38.782976 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.email_events_location_ab1" 2022-06-21 09:12:06 normalization > 09:11:38.791034 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-06-21 09:12:06 normalization > 09:11:38.848874 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.email_events_browser_ab1" 2022-06-21 09:12:06 normalization > 09:11:38.902959 [debug] [Thread-7 ]: finished collecting timing info 2022-06-21 09:12:06 normalization > 09:11:38.905078 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.email_events_browser_ab1 2022-06-21 09:12:06 normalization > 09:11:38.868277 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.email_events_obsoletedBy_ab1" 2022-06-21 09:12:06 normalization > 09:11:38.906611 [debug] [Thread-6 ]: finished collecting timing info 2022-06-21 09:12:06 normalization > 09:11:38.908702 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.email_events_obsoletedBy_ab1 2022-06-21 09:12:06 normalization > 09:11:38.892454 [debug] [Thread-4 ]: finished collecting timing info 2022-06-21 09:12:06 normalization > 09:11:38.911667 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.email_events_causedBy_ab1 2022-06-21 09:12:06 normalization > 09:11:38.912504 [debug] [Thread-1 ]: Began running node model.airbyte_utils.email_events_browser_ab2 2022-06-21 09:12:06 normalization > 09:11:38.901055 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.email_events_sentBy_ab1" 2022-06-21 09:12:06 normalization > 09:11:38.901945 [debug] [Thread-3 ]: finished collecting timing info 2022-06-21 09:12:06 normalization > 09:11:38.918922 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.email_events_location_ab1 2022-06-21 09:12:06 normalization > 09:11:38.915326 [debug] [Thread-8 ]: Began running node model.airbyte_utils.email_events_obsoletedBy_ab2 2022-06-21 09:12:06 normalization > 09:11:38.921944 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_obsoletedBy_ab2" 2022-06-21 09:12:06 normalization > 09:11:38.922731 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.email_events_obsoletedBy_ab2 2022-06-21 09:12:06 normalization > 09:11:38.919506 [debug] [Thread-5 ]: finished collecting timing info 2022-06-21 09:12:06 normalization > 09:11:38.914716 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_browser_ab2" 2022-06-21 09:12:06 normalization > 09:11:38.923455 [debug] [Thread-8 ]: Compiling model.airbyte_utils.email_events_obsoletedBy_ab2 2022-06-21 09:12:06 normalization > 09:11:38.916474 [debug] [Thread-7 ]: Began running node model.airbyte_utils.email_events_causedBy_ab2 2022-06-21 09:12:06 normalization > 09:11:38.926089 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.email_events_sentBy_ab1 2022-06-21 09:12:06 normalization > 09:11:38.926617 [debug] [Thread-4 ]: Began running node model.airbyte_utils.email_events_location_ab2 2022-06-21 09:12:06 normalization > 09:11:38.963518 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_location_ab2" 2022-06-21 09:12:06 normalization > 09:11:38.940922 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_causedBy_ab2" 2022-06-21 09:12:06 normalization > 09:11:38.929466 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.email_events_browser_ab2 2022-06-21 09:12:06 normalization > 09:11:38.964223 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.email_events_location_ab2 2022-06-21 09:12:06 normalization > 09:11:38.999627 [debug] [Thread-4 ]: Compiling model.airbyte_utils.email_events_location_ab2 2022-06-21 09:12:06 normalization > 09:11:38.983311 [debug] [Thread-3 ]: Began running node model.airbyte_utils.email_events_sentBy_ab2 2022-06-21 09:12:06 normalization > 09:11:38.989182 [debug] [Thread-1 ]: Compiling model.airbyte_utils.email_events_browser_ab2 2022-06-21 09:12:06 normalization > 09:11:38.982568 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.email_events_causedBy_ab2 2022-06-21 09:12:06 normalization > 09:11:39.019287 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_sentBy_ab2" 2022-06-21 09:12:06 normalization > 09:11:39.027741 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.email_events_obsoletedBy_ab2" 2022-06-21 09:12:06 normalization > 09:11:39.068492 [debug] [Thread-7 ]: Compiling model.airbyte_utils.email_events_causedBy_ab2 2022-06-21 09:12:06 normalization > 09:11:39.122953 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.email_events_sentBy_ab2 2022-06-21 09:12:06 normalization > 09:11:39.180660 [debug] [Thread-3 ]: Compiling model.airbyte_utils.email_events_sentBy_ab2 2022-06-21 09:12:06 normalization > 09:11:39.163660 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.email_events_location_ab2" 2022-06-21 09:12:06 normalization > 09:11:39.232695 [debug] [Thread-4 ]: finished collecting timing info 2022-06-21 09:12:06 normalization > 09:11:39.149494 [debug] [Thread-8 ]: finished collecting timing info 2022-06-21 09:12:06 normalization > 09:11:39.234942 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.email_events_location_ab2 2022-06-21 09:12:06 normalization > 09:11:39.276562 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.email_events_browser_ab2" 2022-06-21 09:12:06 normalization > 09:11:39.332076 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.email_events_obsoletedBy_ab2 2022-06-21 09:12:06 normalization > 09:11:39.333717 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.email_events_causedBy_ab2" 2022-06-21 09:12:06 normalization > 09:11:39.339842 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.email_events_sentBy_ab2" 2022-06-21 09:12:06 normalization > 09:11:39.341260 [debug] [Thread-5 ]: Began running node model.airbyte_utils.email_events_location_ab3 2022-06-21 09:12:06 normalization > 09:11:39.342807 [debug] [Thread-1 ]: finished collecting timing info 2022-06-21 09:12:06 normalization > 09:11:39.348960 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.email_events_browser_ab2 2022-06-21 09:12:06 normalization > 09:11:39.344327 [debug] [Thread-7 ]: finished collecting timing info 2022-06-21 09:12:06 normalization > 09:11:39.346655 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_location_ab3" 2022-06-21 09:12:06 normalization > 09:11:39.343349 [debug] [Thread-4 ]: Began running node model.airbyte_utils.email_events_obsoletedBy_ab3 2022-06-21 09:12:06 normalization > 09:11:39.349612 [debug] [Thread-3 ]: finished collecting timing info 2022-06-21 09:12:06 normalization > 09:11:39.351069 [debug] [Thread-8 ]: Began running node model.airbyte_utils.email_events_browser_ab3 2022-06-21 09:12:06 normalization > 09:11:39.360093 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_browser_ab3" 2022-06-21 09:12:06 normalization > 09:11:39.360754 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.email_events_browser_ab3 2022-06-21 09:12:06 normalization > 09:11:39.355749 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_obsoletedBy_ab3" 2022-06-21 09:12:06 normalization > 09:11:39.361332 [debug] [Thread-8 ]: Compiling model.airbyte_utils.email_events_browser_ab3 2022-06-21 09:12:06 normalization > 09:11:39.353808 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.email_events_location_ab3 2022-06-21 09:12:06 normalization > 09:11:39.353105 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.email_events_causedBy_ab2 2022-06-21 09:12:06 normalization > 09:11:39.358006 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.email_events_sentBy_ab2 2022-06-21 09:12:06 normalization > 09:11:39.450981 [debug] [Thread-3 ]: Began running node model.airbyte_utils.email_events_causedBy_ab3 2022-06-21 09:12:06 normalization > 09:11:39.453049 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_causedBy_ab3" 2022-06-21 09:12:06 normalization > 09:11:39.453713 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.email_events_causedBy_ab3 2022-06-21 09:12:06 normalization > 09:11:39.454309 [debug] [Thread-3 ]: Compiling model.airbyte_utils.email_events_causedBy_ab3 2022-06-21 09:12:06 normalization > 09:11:39.361965 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.email_events_obsoletedBy_ab3 2022-06-21 09:12:06 normalization > 09:11:39.483982 [debug] [Thread-4 ]: Compiling model.airbyte_utils.email_events_obsoletedBy_ab3 2022-06-21 09:12:06 normalization > 09:11:39.409946 [debug] [Thread-5 ]: Compiling model.airbyte_utils.email_events_location_ab3 2022-06-21 09:12:06 normalization > 09:11:39.492200 [debug] [Thread-6 ]: Began running node model.airbyte_utils.email_events_sentBy_ab3 2022-06-21 09:12:06 normalization > 09:11:39.655377 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_sentBy_ab3" 2022-06-21 09:12:06 normalization > 09:11:39.724817 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.email_events_causedBy_ab3" 2022-06-21 09:12:06 normalization > 09:11:39.725796 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.email_events_sentBy_ab3 2022-06-21 09:12:06 normalization > 09:11:39.708255 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.email_events_browser_ab3" 2022-06-21 09:12:06 normalization > 09:11:39.759521 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.email_events_obsoletedBy_ab3" 2022-06-21 09:12:06 normalization > 09:11:39.760274 [debug] [Thread-6 ]: Compiling model.airbyte_utils.email_events_sentBy_ab3 2022-06-21 09:12:06 normalization > 09:11:39.760847 [debug] [Thread-3 ]: finished collecting timing info 2022-06-21 09:12:06 normalization > 09:11:39.762802 [debug] [Thread-8 ]: finished collecting timing info 2022-06-21 09:12:06 normalization > 09:11:39.781243 [debug] [Thread-4 ]: finished collecting timing info 2022-06-21 09:12:06 normalization > 09:11:39.841717 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.email_events_causedBy_ab3 2022-06-21 09:12:06 normalization > 09:11:39.878692 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.email_events_sentBy_ab3" 2022-06-21 09:12:06 normalization > 09:11:39.891253 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.email_events_browser_ab3 2022-06-21 09:12:06 normalization > 09:11:39.922129 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.email_events_obsoletedBy_ab3 2022-06-21 09:12:06 normalization > 09:11:39.931601 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.email_events_location_ab3" 2022-06-21 09:12:06 normalization > 09:11:39.932861 [debug] [Thread-1 ]: Began running node model.airbyte_utils.email_events_causedBy 2022-06-21 09:12:06 normalization > 09:11:39.934164 [debug] [Thread-6 ]: finished collecting timing info 2022-06-21 09:12:06 normalization > 09:11:39.934960 [debug] [Thread-3 ]: Began running node model.airbyte_utils.email_events_browser 2022-06-21 09:12:06 normalization > 09:11:39.935678 [debug] [Thread-8 ]: Began running node model.airbyte_utils.email_events_obsoletedBy 2022-06-21 09:12:06 normalization > 09:11:39.936463 [info ] [Thread-1 ]: 4 of 8 START incremental model hubspot_test_email.email_events_causedBy................................................. [RUN] 2022-06-21 09:12:06 normalization > 09:11:39.937122 [debug] [Thread-5 ]: finished collecting timing info 2022-06-21 09:12:06 normalization > 09:11:39.938848 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.email_events_sentBy_ab3 2022-06-21 09:12:06 normalization > 09:11:39.939573 [info ] [Thread-3 ]: 5 of 8 START incremental model hubspot_test_email.email_events_browser.................................................. [RUN] 2022-06-21 09:12:06 normalization > 09:11:39.940070 [info ] [Thread-8 ]: 6 of 8 START incremental model hubspot_test_email.email_events_obsoletedBy.............................................. [RUN] 2022-06-21 09:12:06 normalization > 09:11:39.942346 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_causedBy" 2022-06-21 09:12:06 normalization > 09:11:39.943862 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.email_events_location_ab3 2022-06-21 09:12:06 normalization > 09:11:39.945003 [debug] [Thread-7 ]: Began running node model.airbyte_utils.email_events_sentBy 2022-06-21 09:12:06 normalization > 09:11:39.948057 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_browser" 2022-06-21 09:12:06 normalization > 09:11:39.950554 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_obsoletedBy" 2022-06-21 09:12:06 normalization > 09:11:39.951155 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.email_events_causedBy 2022-06-21 09:12:06 normalization > 09:11:39.952301 [info ] [Thread-7 ]: 7 of 8 START incremental model hubspot_test_email.email_events_sentBy................................................... [RUN] 2022-06-21 09:12:06 normalization > 09:11:39.956439 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_sentBy" 2022-06-21 09:12:06 normalization > 09:11:39.953060 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.email_events_browser 2022-06-21 09:12:06 normalization > 09:11:39.953589 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.email_events_obsoletedBy 2022-06-21 09:12:06 normalization > 09:11:39.954157 [debug] [Thread-1 ]: Compiling model.airbyte_utils.email_events_causedBy 2022-06-21 09:12:06 normalization > 09:11:39.956863 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.email_events_sentBy 2022-06-21 09:12:06 normalization > 09:11:39.952632 [debug] [Thread-6 ]: Began running node model.airbyte_utils.email_events_location 2022-06-21 09:12:06 normalization > 09:11:39.957292 [debug] [Thread-3 ]: Compiling model.airbyte_utils.email_events_browser 2022-06-21 09:12:06 normalization > 09:11:39.957753 [debug] [Thread-8 ]: Compiling model.airbyte_utils.email_events_obsoletedBy 2022-06-21 09:12:06 normalization > 09:11:39.978929 [debug] [Thread-7 ]: Compiling model.airbyte_utils.email_events_sentBy 2022-06-21 09:12:06 normalization > 09:11:39.992270 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.email_events_causedBy" 2022-06-21 09:12:06 normalization > 09:11:39.994444 [debug] [Thread-2 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/analytics-platform-201110/datasets/hubspot_test_email/tables/email_events?prettyPrint=false: Not found: Table analytics-platform-201110:hubspot_test_email.email_events 2022-06-21 09:12:06 normalization > 09:11:39.994974 [info ] [Thread-6 ]: 8 of 8 START incremental model hubspot_test_email.email_events_location................................................. [RUN] 2022-06-21 09:12:06 normalization > 09:11:40.059186 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.email_events_browser" 2022-06-21 09:12:06 normalization > 09:11:40.087837 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.email_events_obsoletedBy" 2022-06-21 09:12:06 normalization > 09:11:40.096693 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.email_events_sentBy" 2022-06-21 09:12:06 normalization > 09:11:40.097217 [debug] [Thread-1 ]: finished collecting timing info 2022-06-21 09:12:06 normalization > 09:11:40.099567 [info ] [Thread-2 ]: 09:11:40 + `analytics-platform-201110`.hubspot_test_email.`email_events`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-06-21 09:12:06 normalization > 09:11:40.101632 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_location" 2022-06-21 09:12:06 normalization > 09:11:40.102772 [debug] [Thread-3 ]: finished collecting timing info 2022-06-21 09:12:06 normalization > 09:11:40.103532 [debug] [Thread-8 ]: finished collecting timing info 2022-06-21 09:12:06 normalization > 09:11:40.103828 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.email_events_causedBy 2022-06-21 09:12:06 normalization > 09:11:40.104142 [debug] [Thread-7 ]: finished collecting timing info 2022-06-21 09:12:06 normalization > 09:11:40.110480 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.email_events" 2022-06-21 09:12:06 normalization > 09:11:40.110937 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.email_events_location 2022-06-21 09:12:06 normalization > 09:11:40.123769 [debug] [Thread-6 ]: Compiling model.airbyte_utils.email_events_location 2022-06-21 09:12:06 normalization > 09:11:40.111749 [debug] [Thread-8 ]: Began executing node model.airbyte_utils.email_events_obsoletedBy 2022-06-21 09:12:06 normalization > 09:11:40.122767 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.email_events_sentBy 2022-06-21 09:12:06 normalization > 09:11:40.122159 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-06-21 09:12:06 normalization > 09:11:40.111312 [debug] [Thread-3 ]: Began executing node model.airbyte_utils.email_events_browser 2022-06-21 09:12:06 normalization > 09:11:40.134740 [debug] [Thread-2 ]: On model.airbyte_utils.email_events: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.email_events"} */ 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > create or replace table `analytics-platform-201110`.hubspot_test_email.`email_events` 2022-06-21 09:12:06 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-06-21 09:12:06 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-06-21 09:12:06 normalization > OPTIONS() 2022-06-21 09:12:06 normalization > as ( 2022-06-21 09:12:06 normalization > 2022-06-21 09:12:06 normalization > -- Final base SQL model 2022-06-21 09:12:06 normalization > -- depends_on: `analytics-platform-201110`.hubspot_test_email.`email_events_scd` 2022-06-21 09:12:06 normalization > select 2022-06-21 09:12:06 normalization > _airbyte_unique_key, 2022-06-21 09:12:06 normalization > id, 2022-06-21 09:12:06 normalization > url, 2022-06-21 09:12:06 normalization > `from`, 2022-06-21 09:12:06 normalization > hmid, 2022-06-21 09:12:06 normalization > type, 2022-06-21 09:12:06 normalization > appId, 2022-06-21 09:12:06 normalization > linkId, 2022-06-21 09:12:06 normalization > sentBy, 2022-06-21 09:12:06 normalization > smtpId, 2022-06-21 09:12:06 normalization > source, 2022-06-21 09:12:06 normalization > status, 2022-06-21 09:12:06 normalization > appName, 2022-06-21 09:12:06 normalization > attempt, 2022-06-21 09:12:06 normalization > bounced, 2022-06-21 09:12:06 normalization > browser, 2022-06-21 09:12:06 normalization > created, 2022-06-21 09:12:06 normalization > referer, 2022-06-21 09:12:06 normalization > replyTo, 2022-06-21 09:12:07 normalization > subject, 2022-06-21 09:12:07 normalization > category, 2022-06-21 09:12:07 normalization > causedBy, 2022-06-21 09:12:07 normalization > duration, 2022-06-21 09:12:07 normalization > location, 2022-06-21 09:12:07 normalization > portalId, 2022-06-21 09:12:07 normalization > response, 2022-06-21 09:12:07 normalization > sourceId, 2022-06-21 09:12:07 normalization > ipAddress, 2022-06-21 09:12:07 normalization > recipient, 2022-06-21 09:12:07 normalization > userAgent, 2022-06-21 09:12:07 normalization > deviceType, 2022-06-21 09:12:07 normalization > dropReason, 2022-06-21 09:12:07 normalization > dropMessage, 2022-06-21 09:12:07 normalization > obsoletedBy, 2022-06-21 09:12:07 normalization > requestedBy, 2022-06-21 09:12:07 normalization > filteredEvent, 2022-06-21 09:12:07 normalization > emailCampaignId, 2022-06-21 09:12:07 normalization > requestedByUserId, 2022-06-21 09:12:07 normalization > emailCampaignGroupId, 2022-06-21 09:12:07 normalization > portalSubscriptionStatus, 2022-06-21 09:12:07 normalization > _airbyte_ab_id, 2022-06-21 09:12:07 normalization > _airbyte_emitted_at, 2022-06-21 09:12:07 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-06-21 09:12:07 normalization > _airbyte_email_events_hashid 2022-06-21 09:12:07 normalization > from `analytics-platform-201110`.hubspot_test_email.`email_events_scd` 2022-06-21 09:12:07 normalization > -- email_events from `analytics-platform-201110`.hubspot_test_email._airbyte_raw_email_events 2022-06-21 09:12:07 normalization > where 1 = 1 2022-06-21 09:12:07 normalization > and _airbyte_active_row = 1 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > ); 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > 09:11:40.158845 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-06-21 09:12:07 normalization > 09:11:40.178638 [debug] [Thread-7 ]: Opening a new connection, currently in state closed 2022-06-21 09:12:07 normalization > 09:11:40.186593 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.email_events_location" 2022-06-21 09:12:07 normalization > 09:11:40.202650 [debug] [Thread-3 ]: Opening a new connection, currently in state closed 2022-06-21 09:12:07 normalization > 09:11:40.221932 [debug] [Thread-6 ]: finished collecting timing info 2022-06-21 09:12:07 normalization > 09:11:40.222623 [debug] [Thread-6 ]: Began executing node model.airbyte_utils.email_events_location 2022-06-21 09:12:07 normalization > 09:11:40.242428 [debug] [Thread-6 ]: Opening a new connection, currently in state closed 2022-06-21 09:12:07 normalization > 09:11:40.552270 [debug] [Thread-1 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/analytics-platform-201110/datasets/hubspot_test_email/tables/email_events_causedBy?prettyPrint=false: Not found: Table analytics-platform-201110:hubspot_test_email.email_events_causedBy 2022-06-21 09:12:07 normalization > 09:11:40.554624 [info ] [Thread-1 ]: 09:11:40 + `analytics-platform-201110`.hubspot_test_email.`email_events_causedBy`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-06-21 09:12:07 normalization > 09:11:40.562264 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.email_events_causedBy" 2022-06-21 09:12:07 normalization > 09:11:40.563027 [debug] [Thread-1 ]: On model.airbyte_utils.email_events_causedBy: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.email_events_causedBy"} */ 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > create or replace table `analytics-platform-201110`.hubspot_test_email.`email_events_causedBy` 2022-06-21 09:12:07 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-06-21 09:12:07 normalization > cluster by _airbyte_emitted_at 2022-06-21 09:12:07 normalization > OPTIONS() 2022-06-21 09:12:07 normalization > as ( 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > with __dbt__cte__email_events_causedBy_ab1 as ( 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-06-21 09:12:07 normalization > -- depends_on: `analytics-platform-201110`.hubspot_test_email.`email_events_scd` 2022-06-21 09:12:07 normalization > select 2022-06-21 09:12:07 normalization > _airbyte_email_events_hashid, 2022-06-21 09:12:07 normalization > json_extract_scalar(causedBy, "$['id']") as id, 2022-06-21 09:12:07 normalization > json_extract_scalar(causedBy, "$['created']") as created, 2022-06-21 09:12:07 normalization > _airbyte_ab_id, 2022-06-21 09:12:07 normalization > _airbyte_emitted_at, 2022-06-21 09:12:07 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-06-21 09:12:07 normalization > from `analytics-platform-201110`.hubspot_test_email.`email_events_scd` as table_alias 2022-06-21 09:12:07 normalization > -- causedBy at email_events/causedBy 2022-06-21 09:12:07 normalization > where 1 = 1 2022-06-21 09:12:07 normalization > and causedBy is not null 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > ), __dbt__cte__email_events_causedBy_ab2 as ( 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-06-21 09:12:07 normalization > -- depends_on: __dbt__cte__email_events_causedBy_ab1 2022-06-21 09:12:07 normalization > select 2022-06-21 09:12:07 normalization > _airbyte_email_events_hashid, 2022-06-21 09:12:07 normalization > cast(id as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ) as id, 2022-06-21 09:12:07 normalization > cast(created as 2022-06-21 09:12:07 normalization > int64 2022-06-21 09:12:07 normalization > ) as created, 2022-06-21 09:12:07 normalization > _airbyte_ab_id, 2022-06-21 09:12:07 normalization > _airbyte_emitted_at, 2022-06-21 09:12:07 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-06-21 09:12:07 normalization > from __dbt__cte__email_events_causedBy_ab1 2022-06-21 09:12:07 normalization > -- causedBy at email_events/causedBy 2022-06-21 09:12:07 normalization > where 1 = 1 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > ), __dbt__cte__email_events_causedBy_ab3 as ( 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > -- SQL model to build a hash column based on the values of this record 2022-06-21 09:12:07 normalization > -- depends_on: __dbt__cte__email_events_causedBy_ab2 2022-06-21 09:12:07 normalization > select 2022-06-21 09:12:07 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_email_events_hashid as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ), ''), '-', coalesce(cast(id as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ), ''), '-', coalesce(cast(created as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ), '')) as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ))) as _airbyte_causedBy_hashid, 2022-06-21 09:12:07 normalization > tmp.* 2022-06-21 09:12:07 normalization > from __dbt__cte__email_events_causedBy_ab2 tmp 2022-06-21 09:12:07 normalization > -- causedBy at email_events/causedBy 2022-06-21 09:12:07 normalization > where 1 = 1 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > )-- Final base SQL model 2022-06-21 09:12:07 normalization > -- depends_on: __dbt__cte__email_events_causedBy_ab3 2022-06-21 09:12:07 normalization > select 2022-06-21 09:12:07 normalization > _airbyte_email_events_hashid, 2022-06-21 09:12:07 normalization > id, 2022-06-21 09:12:07 normalization > created, 2022-06-21 09:12:07 normalization > _airbyte_ab_id, 2022-06-21 09:12:07 normalization > _airbyte_emitted_at, 2022-06-21 09:12:07 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-06-21 09:12:07 normalization > _airbyte_causedBy_hashid 2022-06-21 09:12:07 normalization > from __dbt__cte__email_events_causedBy_ab3 2022-06-21 09:12:07 normalization > -- causedBy at email_events/causedBy from `analytics-platform-201110`.hubspot_test_email.`email_events_scd` 2022-06-21 09:12:07 normalization > where 1 = 1 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > ); 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > 09:11:40.621937 [debug] [Thread-7 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/analytics-platform-201110/datasets/hubspot_test_email/tables/email_events_sentBy?prettyPrint=false: Not found: Table analytics-platform-201110:hubspot_test_email.email_events_sentBy 2022-06-21 09:12:07 normalization > 09:11:40.624900 [debug] [Thread-3 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/analytics-platform-201110/datasets/hubspot_test_email/tables/email_events_browser?prettyPrint=false: Not found: Table analytics-platform-201110:hubspot_test_email.email_events_browser 2022-06-21 09:12:07 normalization > 09:11:40.629585 [info ] [Thread-7 ]: 09:11:40 + `analytics-platform-201110`.hubspot_test_email.`email_events_sentBy`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-06-21 09:12:07 normalization > 09:11:40.630513 [debug] [Thread-8 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/analytics-platform-201110/datasets/hubspot_test_email/tables/email_events_obsoletedBy?prettyPrint=false: Not found: Table analytics-platform-201110:hubspot_test_email.email_events_obsoletedBy 2022-06-21 09:12:07 normalization > 09:11:40.633305 [info ] [Thread-3 ]: 09:11:40 + `analytics-platform-201110`.hubspot_test_email.`email_events_browser`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-06-21 09:12:07 normalization > 09:11:40.645783 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.email_events_sentBy" 2022-06-21 09:12:07 normalization > 09:11:40.649482 [info ] [Thread-8 ]: 09:11:40 + `analytics-platform-201110`.hubspot_test_email.`email_events_obsoletedBy`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-06-21 09:12:07 normalization > 09:11:40.650177 [debug] [Thread-6 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/analytics-platform-201110/datasets/hubspot_test_email/tables/email_events_location?prettyPrint=false: Not found: Table analytics-platform-201110:hubspot_test_email.email_events_location 2022-06-21 09:12:07 normalization > 09:11:40.657172 [debug] [Thread-3 ]: Writing runtime SQL for node "model.airbyte_utils.email_events_browser" 2022-06-21 09:12:07 normalization > 09:11:40.658853 [debug] [Thread-7 ]: On model.airbyte_utils.email_events_sentBy: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.email_events_sentBy"} */ 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > create or replace table `analytics-platform-201110`.hubspot_test_email.`email_events_sentBy` 2022-06-21 09:12:07 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-06-21 09:12:07 normalization > cluster by _airbyte_emitted_at 2022-06-21 09:12:07 normalization > OPTIONS() 2022-06-21 09:12:07 normalization > as ( 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > with __dbt__cte__email_events_sentBy_ab1 as ( 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-06-21 09:12:07 normalization > -- depends_on: `analytics-platform-201110`.hubspot_test_email.`email_events_scd` 2022-06-21 09:12:07 normalization > select 2022-06-21 09:12:07 normalization > _airbyte_email_events_hashid, 2022-06-21 09:12:07 normalization > json_extract_scalar(sentBy, "$['id']") as id, 2022-06-21 09:12:07 normalization > json_extract_scalar(sentBy, "$['created']") as created, 2022-06-21 09:12:07 normalization > _airbyte_ab_id, 2022-06-21 09:12:07 normalization > _airbyte_emitted_at, 2022-06-21 09:12:07 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-06-21 09:12:07 normalization > from `analytics-platform-201110`.hubspot_test_email.`email_events_scd` as table_alias 2022-06-21 09:12:07 normalization > -- sentBy at email_events/sentBy 2022-06-21 09:12:07 normalization > where 1 = 1 2022-06-21 09:12:07 normalization > and sentBy is not null 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > ), __dbt__cte__email_events_sentBy_ab2 as ( 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-06-21 09:12:07 normalization > -- depends_on: __dbt__cte__email_events_sentBy_ab1 2022-06-21 09:12:07 normalization > select 2022-06-21 09:12:07 normalization > _airbyte_email_events_hashid, 2022-06-21 09:12:07 normalization > cast(id as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ) as id, 2022-06-21 09:12:07 normalization > cast(created as 2022-06-21 09:12:07 normalization > int64 2022-06-21 09:12:07 normalization > ) as created, 2022-06-21 09:12:07 normalization > _airbyte_ab_id, 2022-06-21 09:12:07 normalization > _airbyte_emitted_at, 2022-06-21 09:12:07 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-06-21 09:12:07 normalization > from __dbt__cte__email_events_sentBy_ab1 2022-06-21 09:12:07 normalization > -- sentBy at email_events/sentBy 2022-06-21 09:12:07 normalization > where 1 = 1 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > ), __dbt__cte__email_events_sentBy_ab3 as ( 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > -- SQL model to build a hash column based on the values of this record 2022-06-21 09:12:07 normalization > -- depends_on: __dbt__cte__email_events_sentBy_ab2 2022-06-21 09:12:07 normalization > select 2022-06-21 09:12:07 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_email_events_hashid as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ), ''), '-', coalesce(cast(id as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ), ''), '-', coalesce(cast(created as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ), '')) as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ))) as _airbyte_sentBy_hashid, 2022-06-21 09:12:07 normalization > tmp.* 2022-06-21 09:12:07 normalization > from __dbt__cte__email_events_sentBy_ab2 tmp 2022-06-21 09:12:07 normalization > -- sentBy at email_events/sentBy 2022-06-21 09:12:07 normalization > where 1 = 1 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > )-- Final base SQL model 2022-06-21 09:12:07 normalization > -- depends_on: __dbt__cte__email_events_sentBy_ab3 2022-06-21 09:12:07 normalization > select 2022-06-21 09:12:07 normalization > _airbyte_email_events_hashid, 2022-06-21 09:12:07 normalization > id, 2022-06-21 09:12:07 normalization > created, 2022-06-21 09:12:07 normalization > _airbyte_ab_id, 2022-06-21 09:12:07 normalization > _airbyte_emitted_at, 2022-06-21 09:12:07 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-06-21 09:12:07 normalization > _airbyte_sentBy_hashid 2022-06-21 09:12:07 normalization > from __dbt__cte__email_events_sentBy_ab3 2022-06-21 09:12:07 normalization > -- sentBy at email_events/sentBy from `analytics-platform-201110`.hubspot_test_email.`email_events_scd` 2022-06-21 09:12:07 normalization > where 1 = 1 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > ); 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > 09:11:40.661380 [info ] [Thread-6 ]: 09:11:40 + `analytics-platform-201110`.hubspot_test_email.`email_events_location`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-06-21 09:12:07 normalization > 09:11:40.666812 [debug] [Thread-8 ]: Writing runtime SQL for node "model.airbyte_utils.email_events_obsoletedBy" 2022-06-21 09:12:07 normalization > 09:11:40.681214 [debug] [Thread-3 ]: On model.airbyte_utils.email_events_browser: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.email_events_browser"} */ 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > create or replace table `analytics-platform-201110`.hubspot_test_email.`email_events_browser` 2022-06-21 09:12:07 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-06-21 09:12:07 normalization > cluster by _airbyte_emitted_at 2022-06-21 09:12:07 normalization > OPTIONS() 2022-06-21 09:12:07 normalization > as ( 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > with __dbt__cte__email_events_browser_ab1 as ( 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-06-21 09:12:07 normalization > -- depends_on: `analytics-platform-201110`.hubspot_test_email.`email_events_scd` 2022-06-21 09:12:07 normalization > select 2022-06-21 09:12:07 normalization > _airbyte_email_events_hashid, 2022-06-21 09:12:07 normalization > json_extract_scalar(browser, "$['url']") as url, 2022-06-21 09:12:07 normalization > json_extract_scalar(browser, "$['name']") as name, 2022-06-21 09:12:07 normalization > json_extract_scalar(browser, "$['type']") as type, 2022-06-21 09:12:07 normalization > json_extract_scalar(browser, "$['family']") as family, 2022-06-21 09:12:07 normalization > json_extract_string_array(browser, "$['version']") as version, 2022-06-21 09:12:07 normalization > json_extract_scalar(browser, "$['producer']") as producer, 2022-06-21 09:12:07 normalization > json_extract_scalar(browser, "$['producerUrl']") as producerUrl, 2022-06-21 09:12:07 normalization > _airbyte_ab_id, 2022-06-21 09:12:07 normalization > _airbyte_emitted_at, 2022-06-21 09:12:07 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-06-21 09:12:07 normalization > from `analytics-platform-201110`.hubspot_test_email.`email_events_scd` as table_alias 2022-06-21 09:12:07 normalization > -- browser at email_events/browser 2022-06-21 09:12:07 normalization > where 1 = 1 2022-06-21 09:12:07 normalization > and browser is not null 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > ), __dbt__cte__email_events_browser_ab2 as ( 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-06-21 09:12:07 normalization > -- depends_on: __dbt__cte__email_events_browser_ab1 2022-06-21 09:12:07 normalization > select 2022-06-21 09:12:07 normalization > _airbyte_email_events_hashid, 2022-06-21 09:12:07 normalization > cast(url as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ) as url, 2022-06-21 09:12:07 normalization > cast(name as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ) as name, 2022-06-21 09:12:07 normalization > cast(type as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ) as type, 2022-06-21 09:12:07 normalization > cast(family as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ) as family, 2022-06-21 09:12:07 normalization > version, 2022-06-21 09:12:07 normalization > cast(producer as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ) as producer, 2022-06-21 09:12:07 normalization > cast(producerUrl as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ) as producerUrl, 2022-06-21 09:12:07 normalization > _airbyte_ab_id, 2022-06-21 09:12:07 normalization > _airbyte_emitted_at, 2022-06-21 09:12:07 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-06-21 09:12:07 normalization > from __dbt__cte__email_events_browser_ab1 2022-06-21 09:12:07 normalization > -- browser at email_events/browser 2022-06-21 09:12:07 normalization > where 1 = 1 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > ), __dbt__cte__email_events_browser_ab3 as ( 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > -- SQL model to build a hash column based on the values of this record 2022-06-21 09:12:07 normalization > -- depends_on: __dbt__cte__email_events_browser_ab2 2022-06-21 09:12:07 normalization > select 2022-06-21 09:12:07 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_email_events_hashid as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ), ''), '-', coalesce(cast(url as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ), ''), '-', coalesce(cast(name as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ), ''), '-', coalesce(cast(type as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ), ''), '-', coalesce(cast(family as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ), ''), '-', coalesce(cast(array_to_string(version, "|", "") as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ), ''), '-', coalesce(cast(producer as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ), ''), '-', coalesce(cast(producerUrl as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ), '')) as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ))) as _airbyte_browser_hashid, 2022-06-21 09:12:07 normalization > tmp.* 2022-06-21 09:12:07 normalization > from __dbt__cte__email_events_browser_ab2 tmp 2022-06-21 09:12:07 normalization > -- browser at email_events/browser 2022-06-21 09:12:07 normalization > where 1 = 1 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > )-- Final base SQL model 2022-06-21 09:12:07 normalization > -- depends_on: __dbt__cte__email_events_browser_ab3 2022-06-21 09:12:07 normalization > select 2022-06-21 09:12:07 normalization > _airbyte_email_events_hashid, 2022-06-21 09:12:07 normalization > url, 2022-06-21 09:12:07 normalization > name, 2022-06-21 09:12:07 normalization > type, 2022-06-21 09:12:07 normalization > family, 2022-06-21 09:12:07 normalization > version, 2022-06-21 09:12:07 normalization > producer, 2022-06-21 09:12:07 normalization > producerUrl, 2022-06-21 09:12:07 normalization > _airbyte_ab_id, 2022-06-21 09:12:07 normalization > _airbyte_emitted_at, 2022-06-21 09:12:07 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-06-21 09:12:07 normalization > _airbyte_browser_hashid 2022-06-21 09:12:07 normalization > from __dbt__cte__email_events_browser_ab3 2022-06-21 09:12:07 normalization > -- browser at email_events/browser from `analytics-platform-201110`.hubspot_test_email.`email_events_scd` 2022-06-21 09:12:07 normalization > where 1 = 1 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > ); 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > 09:11:40.682506 [debug] [Thread-6 ]: Writing runtime SQL for node "model.airbyte_utils.email_events_location" 2022-06-21 09:12:07 normalization > 09:11:40.689894 [debug] [Thread-8 ]: On model.airbyte_utils.email_events_obsoletedBy: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.email_events_obsoletedBy"} */ 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > create or replace table `analytics-platform-201110`.hubspot_test_email.`email_events_obsoletedBy` 2022-06-21 09:12:07 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-06-21 09:12:07 normalization > cluster by _airbyte_emitted_at 2022-06-21 09:12:07 normalization > OPTIONS() 2022-06-21 09:12:07 normalization > as ( 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > with __dbt__cte__email_events_obsoletedBy_ab1 as ( 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-06-21 09:12:07 normalization > -- depends_on: `analytics-platform-201110`.hubspot_test_email.`email_events_scd` 2022-06-21 09:12:07 normalization > select 2022-06-21 09:12:07 normalization > _airbyte_email_events_hashid, 2022-06-21 09:12:07 normalization > json_extract_scalar(obsoletedBy, "$['id']") as id, 2022-06-21 09:12:07 normalization > json_extract_scalar(obsoletedBy, "$['created']") as created, 2022-06-21 09:12:07 normalization > _airbyte_ab_id, 2022-06-21 09:12:07 normalization > _airbyte_emitted_at, 2022-06-21 09:12:07 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-06-21 09:12:07 normalization > from `analytics-platform-201110`.hubspot_test_email.`email_events_scd` as table_alias 2022-06-21 09:12:07 normalization > -- obsoletedBy at email_events/obsoletedBy 2022-06-21 09:12:07 normalization > where 1 = 1 2022-06-21 09:12:07 normalization > and obsoletedBy is not null 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > ), __dbt__cte__email_events_obsoletedBy_ab2 as ( 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-06-21 09:12:07 normalization > -- depends_on: __dbt__cte__email_events_obsoletedBy_ab1 2022-06-21 09:12:07 normalization > select 2022-06-21 09:12:07 normalization > _airbyte_email_events_hashid, 2022-06-21 09:12:07 normalization > cast(id as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ) as id, 2022-06-21 09:12:07 normalization > cast(created as 2022-06-21 09:12:07 normalization > int64 2022-06-21 09:12:07 normalization > ) as created, 2022-06-21 09:12:07 normalization > _airbyte_ab_id, 2022-06-21 09:12:07 normalization > _airbyte_emitted_at, 2022-06-21 09:12:07 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-06-21 09:12:07 normalization > from __dbt__cte__email_events_obsoletedBy_ab1 2022-06-21 09:12:07 normalization > -- obsoletedBy at email_events/obsoletedBy 2022-06-21 09:12:07 normalization > where 1 = 1 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > ), __dbt__cte__email_events_obsoletedBy_ab3 as ( 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > -- SQL model to build a hash column based on the values of this record 2022-06-21 09:12:07 normalization > -- depends_on: __dbt__cte__email_events_obsoletedBy_ab2 2022-06-21 09:12:07 normalization > select 2022-06-21 09:12:07 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_email_events_hashid as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ), ''), '-', coalesce(cast(id as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ), ''), '-', coalesce(cast(created as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ), '')) as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ))) as _airbyte_obsoletedBy_hashid, 2022-06-21 09:12:07 normalization > tmp.* 2022-06-21 09:12:07 normalization > from __dbt__cte__email_events_obsoletedBy_ab2 tmp 2022-06-21 09:12:07 normalization > -- obsoletedBy at email_events/obsoletedBy 2022-06-21 09:12:07 normalization > where 1 = 1 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > )-- Final base SQL model 2022-06-21 09:12:07 normalization > -- depends_on: __dbt__cte__email_events_obsoletedBy_ab3 2022-06-21 09:12:07 normalization > select 2022-06-21 09:12:07 normalization > _airbyte_email_events_hashid, 2022-06-21 09:12:07 normalization > id, 2022-06-21 09:12:07 normalization > created, 2022-06-21 09:12:07 normalization > _airbyte_ab_id, 2022-06-21 09:12:07 normalization > _airbyte_emitted_at, 2022-06-21 09:12:07 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-06-21 09:12:07 normalization > _airbyte_obsoletedBy_hashid 2022-06-21 09:12:07 normalization > from __dbt__cte__email_events_obsoletedBy_ab3 2022-06-21 09:12:07 normalization > -- obsoletedBy at email_events/obsoletedBy from `analytics-platform-201110`.hubspot_test_email.`email_events_scd` 2022-06-21 09:12:07 normalization > where 1 = 1 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > ); 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > 09:11:40.693002 [debug] [Thread-6 ]: On model.airbyte_utils.email_events_location: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.email_events_location"} */ 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > create or replace table `analytics-platform-201110`.hubspot_test_email.`email_events_location` 2022-06-21 09:12:07 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-06-21 09:12:07 normalization > cluster by _airbyte_emitted_at 2022-06-21 09:12:07 normalization > OPTIONS() 2022-06-21 09:12:07 normalization > as ( 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > with __dbt__cte__email_events_location_ab1 as ( 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-06-21 09:12:07 normalization > -- depends_on: `analytics-platform-201110`.hubspot_test_email.`email_events_scd` 2022-06-21 09:12:07 normalization > select 2022-06-21 09:12:07 normalization > _airbyte_email_events_hashid, 2022-06-21 09:12:07 normalization > json_extract_scalar(location, "$['city']") as city, 2022-06-21 09:12:07 normalization > json_extract_scalar(location, "$['state']") as state, 2022-06-21 09:12:07 normalization > json_extract_scalar(location, "$['country']") as country, 2022-06-21 09:12:07 normalization > json_extract_scalar(location, "$['zipcode']") as zipcode, 2022-06-21 09:12:07 normalization > json_extract_scalar(location, "$['latitude']") as latitude, 2022-06-21 09:12:07 normalization > json_extract_scalar(location, "$['longitude']") as longitude, 2022-06-21 09:12:07 normalization > _airbyte_ab_id, 2022-06-21 09:12:07 normalization > _airbyte_emitted_at, 2022-06-21 09:12:07 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-06-21 09:12:07 normalization > from `analytics-platform-201110`.hubspot_test_email.`email_events_scd` as table_alias 2022-06-21 09:12:07 normalization > -- location at email_events/location 2022-06-21 09:12:07 normalization > where 1 = 1 2022-06-21 09:12:07 normalization > and location is not null 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > ), __dbt__cte__email_events_location_ab2 as ( 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-06-21 09:12:07 normalization > -- depends_on: __dbt__cte__email_events_location_ab1 2022-06-21 09:12:07 normalization > select 2022-06-21 09:12:07 normalization > _airbyte_email_events_hashid, 2022-06-21 09:12:07 normalization > cast(city as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ) as city, 2022-06-21 09:12:07 normalization > cast(state as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ) as state, 2022-06-21 09:12:07 normalization > cast(country as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ) as country, 2022-06-21 09:12:07 normalization > cast(zipcode as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ) as zipcode, 2022-06-21 09:12:07 normalization > cast(latitude as 2022-06-21 09:12:07 normalization > float64 2022-06-21 09:12:07 normalization > ) as latitude, 2022-06-21 09:12:07 normalization > cast(longitude as 2022-06-21 09:12:07 normalization > float64 2022-06-21 09:12:07 normalization > ) as longitude, 2022-06-21 09:12:07 normalization > _airbyte_ab_id, 2022-06-21 09:12:07 normalization > _airbyte_emitted_at, 2022-06-21 09:12:07 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-06-21 09:12:07 normalization > from __dbt__cte__email_events_location_ab1 2022-06-21 09:12:07 normalization > -- location at email_events/location 2022-06-21 09:12:07 normalization > where 1 = 1 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > ), __dbt__cte__email_events_location_ab3 as ( 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > -- SQL model to build a hash column based on the values of this record 2022-06-21 09:12:07 normalization > -- depends_on: __dbt__cte__email_events_location_ab2 2022-06-21 09:12:07 normalization > select 2022-06-21 09:12:07 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_email_events_hashid as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ), ''), '-', coalesce(cast(city as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ), ''), '-', coalesce(cast(state as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ), ''), '-', coalesce(cast(country as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ), ''), '-', coalesce(cast(zipcode as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ), ''), '-', coalesce(cast(latitude as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ), ''), '-', coalesce(cast(longitude as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ), '')) as 2022-06-21 09:12:07 normalization > string 2022-06-21 09:12:07 normalization > ))) as _airbyte_location_hashid, 2022-06-21 09:12:07 normalization > tmp.* 2022-06-21 09:12:07 normalization > from __dbt__cte__email_events_location_ab2 tmp 2022-06-21 09:12:07 normalization > -- location at email_events/location 2022-06-21 09:12:07 normalization > where 1 = 1 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > )-- Final base SQL model 2022-06-21 09:12:07 normalization > -- depends_on: __dbt__cte__email_events_location_ab3 2022-06-21 09:12:07 normalization > select 2022-06-21 09:12:07 normalization > _airbyte_email_events_hashid, 2022-06-21 09:12:07 normalization > city, 2022-06-21 09:12:07 normalization > state, 2022-06-21 09:12:07 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):161 - Completing future exceptionally... io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:63) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:60) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] ... 3 more Suppressed: io.airbyte.workers.exception.WorkerException: Normalization process wasn't successful at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:162) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:48) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] 2022-06-21 09:12:07 normalization > country, 2022-06-21 09:12:07 normalization > zipcode, 2022-06-21 09:12:07 normalization > latitude, 2022-06-21 09:12:07 normalization > longitude, 2022-06-21 09:12:07 normalization > _airbyte_ab_id, 2022-06-21 09:12:07 normalization > _airbyte_emitted_at, 2022-06-21 09:12:07 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-06-21 09:12:07 normalization > _airbyte_location_hashid 2022-06-21 09:12:07 normalization > from __dbt__cte__email_events_location_ab3 2022-06-21 09:12:07 normalization > -- location at email_events/location from `analytics-platform-201110`.hubspot_test_email.`email_events_scd` 2022-06-21 09:12:07 normalization > where 1 = 1 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > ); 2022-06-21 09:12:07 normalization > 2022-06-21 09:12:07 normalization > 09:11:43.168557 [debug] [Thread-1 ]: finished collecting timing info 2022-06-21 09:12:07 normalization > 09:11:43.172849 [info ] [Thread-1 ]: 4 of 8 OK created incremental model hubspot_test_email.email_events_causedBy............................................ [CREATE TABLE (5.8k rows, 29.2 MB processed) in 3.23s] 2022-06-21 09:12:07 normalization > 09:11:43.175991 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.email_events_causedBy 2022-06-21 09:12:07 normalization > 09:11:43.379404 [debug] [Thread-8 ]: finished collecting timing info 2022-06-21 09:12:07 normalization > 09:11:43.383240 [info ] [Thread-8 ]: 6 of 8 OK created incremental model hubspot_test_email.email_events_obsoletedBy......................................... [CREATE TABLE (201.0 rows, 28.9 MB processed) in 3.43s] 2022-06-21 09:12:07 normalization > 09:11:43.390670 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.email_events_obsoletedBy 2022-06-21 09:12:07 normalization > 09:11:43.904528 [debug] [Thread-3 ]: BigQuery adapter: Retry attempt 1 of 3 after error: BadRequest('Array cannot have a null element; error in writing field version') 2022-06-21 09:12:07 normalization > 09:11:45.565550 [debug] [Thread-6 ]: finished collecting timing info 2022-06-21 09:12:07 normalization > 09:11:45.568197 [info ] [Thread-6 ]: 8 of 8 OK created incremental model hubspot_test_email.email_events_location............................................ [CREATE TABLE (120.1k rows, 37.7 MB processed) in 5.47s] 2022-06-21 09:12:07 normalization > 09:11:45.569973 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.email_events_location 2022-06-21 09:12:07 normalization > 09:11:47.277983 [debug] [Thread-7 ]: finished collecting timing info 2022-06-21 09:12:07 normalization > 09:11:47.280353 [info ] [Thread-7 ]: 7 of 8 OK created incremental model hubspot_test_email.email_events_sentBy.............................................. [CREATE TABLE (375.8k rows, 54.4 MB processed) in 7.32s] 2022-06-21 09:12:07 normalization > 09:11:47.281707 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.email_events_sentBy 2022-06-21 09:12:07 normalization > 09:11:48.269909 [debug] [Thread-3 ]: BigQuery adapter: Retry attempt 2 of 3 after error: BadRequest('Array cannot have a null element; error in writing field version') 2022-06-21 09:12:07 normalization > 09:11:48.943692 [debug] [Thread-2 ]: finished collecting timing info 2022-06-21 09:12:07 normalization > 09:11:48.947598 [info ] [Thread-2 ]: 3 of 8 OK created incremental model hubspot_test_email.email_events..................................................... [CREATE TABLE (378.9k rows, 177.9 MB processed) in 10.36s] 2022-06-21 09:12:07 normalization > 09:11:48.949818 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.email_events 2022-06-21 09:12:07 normalization > 09:11:52.111857 [debug] [Thread-3 ]: BigQuery adapter: Retry attempt 3 of 3 after error: BadRequest('Array cannot have a null element; error in writing field version') 2022-06-21 09:12:07 normalization > 09:11:55.934786 [debug] [Thread-3 ]: finished collecting timing info 2022-06-21 09:12:07 normalization > 09:11:55.936500 [debug] [Thread-3 ]: Database Error in model email_events_browser (models/generated/airbyte_incremental/hubspot_test_email/email_events_browser.sql) 2022-06-21 09:12:07 normalization > Array cannot have a null element; error in writing field version 2022-06-21 09:12:07 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-06-21 09:12:07 normalization > compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_incremental/hubspot_test_email/email_events_browser.sql 2022-06-21 09:12:07 normalization > 09:11:55.937754 [error] [Thread-3 ]: 5 of 8 ERROR creating incremental model hubspot_test_email.email_events_browser......................................... [ERROR in 15.99s] 2022-06-21 09:12:07 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):237 - Stopping temporal heartbeating... 2022-06-21 09:12:07 normalization > 09:11:55.939099 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.email_events_browser 2022-06-21 09:12:07 normalization > 09:11:55.943600 [debug] [MainThread]: Acquiring new bigquery connection "master" 2022-06-21 09:12:07 normalization > 09:11:55.944991 [info ] [MainThread]: 2022-06-21 09:12:07 normalization > 09:11:55.945690 [info ] [MainThread]: Finished running 1 view model, 7 incremental models in 138.31s. 2022-06-21 09:12:07 normalization > 09:11:55.946578 [debug] [MainThread]: Connection 'master' was properly closed. 2022-06-21 09:12:07 normalization > 09:11:55.947024 [debug] [MainThread]: Connection 'model.airbyte_utils.email_events' was properly closed. 2022-06-21 09:12:07 normalization > 09:11:55.947392 [debug] [MainThread]: Connection 'model.airbyte_utils.email_events_causedBy' was properly closed. 2022-06-21 09:12:07 normalization > 09:11:55.947814 [debug] [MainThread]: Connection 'model.airbyte_utils.email_events_browser' was properly closed. 2022-06-21 09:12:07 normalization > 09:11:55.948083 [debug] [MainThread]: Connection 'model.airbyte_utils.email_events_location_ab3' was properly closed. 2022-06-21 09:12:07 WARN i.t.i.a.POJOActivityTaskHandler(activityFailureToResult):307 - Activity failure. ActivityId=5bba4411-8339-3f3b-835a-71a82cb433cb, activityType=Normalize, attempt=1 java.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:235) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.normalize(NormalizationActivityImpl.java:75) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at jdk.internal.reflect.GeneratedMethodAccessor429.invoke(Unknown Source) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:214) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:180) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:120) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:204) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:164) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.8.1.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.temporal.serviceclient.CheckedExceptionWrapper.wrap(CheckedExceptionWrapper.java:56) ~[temporal-serviceclient-1.8.1.jar:?] at io.temporal.internal.sync.WorkflowInternal.wrap(WorkflowInternal.java:448) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.activity.Activity.wrap(Activity.java:51) ~[temporal-sdk-1.8.1.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:138) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:103) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:230) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] ... 13 more Caused by: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed. at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:132) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:103) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:230) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] ... 13 more Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:63) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:60) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] ... 1 more Suppressed: io.airbyte.workers.exception.WorkerException: Normalization process wasn't successful at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:162) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:48) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] 2022-06-21 09:12:07 normalization > 09:11:55.948333 [debug] [MainThread]: Connection 'model.airbyte_utils.email_events_sentBy' was properly closed. 2022-06-21 09:12:07 normalization > 09:11:55.948579 [debug] [MainThread]: Connection 'model.airbyte_utils.email_events_obsoletedBy_ab3' was properly closed. 2022-06-21 09:12:07 normalization > 09:11:55.948821 [debug] [MainThread]: Connection 'model.airbyte_utils.email_events_location' was properly closed. 2022-06-21 09:12:07 normalization > 09:11:55.949064 [debug] [MainThread]: Connection 'model.airbyte_utils.email_events_obsoletedBy' was properly closed. 2022-06-21 09:12:07 normalization > 09:11:56.001579 [info ] [MainThread]: 2022-06-21 09:12:07 normalization > 09:11:56.002289 [info ] [MainThread]: Completed with 1 error and 0 warnings: 2022-06-21 09:12:07 normalization > 09:11:56.003399 [info ] [MainThread]: 2022-06-21 09:12:07 normalization > 09:11:56.004284 [error] [MainThread]: Database Error in model email_events_browser (models/generated/airbyte_incremental/hubspot_test_email/email_events_browser.sql) 2022-06-21 09:12:07 normalization > 09:11:56.005362 [error] [MainThread]: Array cannot have a null element; error in writing field version 2022-06-21 09:12:07 normalization > 09:11:56.006281 [error] [MainThread]: compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_incremental/hubspot_test_email/email_events_browser.sql 2022-06-21 09:12:07 normalization > 09:11:56.007252 [info ] [MainThread]: 2022-06-21 09:12:07 normalization > 09:11:56.008108 [info ] [MainThread]: Done. PASS=7 WARN=0 ERROR=1 SKIP=0 TOTAL=8 2022-06-21 09:12:07 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.client_id: is missing but it is required, $.client_secret: is missing but it is required, $.refresh_token: is missing but it is required, $.credentials_title: must be a constant value OAuth Credentials 2022-06-21 09:12:07 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.api_key: object found, string expected 2022-06-21 09:12:07 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/34/1/logs.log 2022-06-21 09:12:07 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.20-alpha 2022-06-21 09:12:07 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-hubspot:0.1.70 exists... 2022-06-21 09:12:07 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-hubspot:0.1.70 was found locally. 2022-06-21 09:12:08 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 34 2022-06-21 09:12:08 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/34/1 --log-driver none --name source-hubspot-check-34-1-yaxoo --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_JOB_ATTEMPT=1 -e WORKER_CONNECTOR_IMAGE=airbyte/source-hubspot:0.1.70 -e AIRBYTE_VERSION=0.39.20-alpha -e WORKER_JOB_ID=34 airbyte/source-hubspot:0.1.70 check --config source_config.json 2022-06-21 09:12:13 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):97 - Check succeeded 2022-06-21 09:12:13 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-06-21 09:12:13 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/34/1/logs.log 2022-06-21 09:12:13 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.20-alpha 2022-06-21 09:12:13 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:1.1.8 exists... 2022-06-21 09:12:14 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:1.1.8 was found locally. 2022-06-21 09:12:14 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 34 2022-06-21 09:12:14 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/34/1 --log-driver none --name destination-bigquery-check-34-1-hhsxv --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_JOB_ATTEMPT=1 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.1.8 -e AIRBYTE_VERSION=0.39.20-alpha -e WORKER_JOB_ID=34 airbyte/destination-bigquery:1.1.8 check --config source_config.json 2022-06-21 09:12:15 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Class path contains multiple SLF4J bindings. 2022-06-21 09:12:15 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-06-21 09:12:15 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-06-21 09:12:15 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-06-21 09:12:15 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-06-21 09:12:15 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-06-21 09:12:18 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-21 09:12:18 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2022-06-21 09:12:18 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-21 09:12:18 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-06-21 09:12:18 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-21 09:12:18 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK 2022-06-21 09:12:18 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-21 09:12:18 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-06-21 09:12:19 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-21 09:12:19 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-06-21 09:12:19 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-21 09:12:19 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-06-21 09:12:19 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-21 09:12:19 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-06-21 09:12:20 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-21 09:12:20 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):306 - Selected loading method is set to: STANDARD 2022-06-21 09:12:24 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-06-21 09:12:24 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/34/1/logs.log 2022-06-21 09:12:24 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.20-alpha 2022-06-21 09:12:24 INFO i.a.w.g.DefaultReplicationWorker(run):115 - start sync worker. job id: 34 attempt id: 1 2022-06-21 09:12:24 INFO i.a.w.g.DefaultReplicationWorker(run):127 - configured sync modes: {null.email_events=incremental - append_dedup} 2022-06-21 09:12:24 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination... 2022-06-21 09:12:24 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:1.1.8 exists... 2022-06-21 09:12:25 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:1.1.8 was found locally. 2022-06-21 09:12:25 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 34 2022-06-21 09:12:25 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/34/1 --log-driver none --name destination-bigquery-write-34-1-maqii --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_JOB_ATTEMPT=1 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.1.8 -e AIRBYTE_VERSION=0.39.20-alpha -e WORKER_JOB_ID=34 airbyte/destination-bigquery:1.1.8 write --config destination_config.json --catalog destination_catalog.json 2022-06-21 09:12:25 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-hubspot:0.1.70 exists... 2022-06-21 09:12:25 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-hubspot:0.1.70 was found locally. 2022-06-21 09:12:25 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 34 2022-06-21 09:12:25 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/34/1 --log-driver none --name source-hubspot-read-34-1-itsof --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_JOB_ATTEMPT=1 -e WORKER_CONNECTOR_IMAGE=airbyte/source-hubspot:0.1.70 -e AIRBYTE_VERSION=0.39.20-alpha -e WORKER_JOB_ID=34 airbyte/source-hubspot:0.1.70 read --config source_config.json --catalog source_catalog.json 2022-06-21 09:12:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):395 - Destination output thread started. 2022-06-21 09:12:25 INFO i.a.w.g.DefaultReplicationWorker(run):169 - Waiting for source and destination threads to complete. 2022-06-21 09:12:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):298 - Replication thread started. 2022-06-21 09:12:26 destination > SLF4J: Class path contains multiple SLF4J bindings. 2022-06-21 09:12:26 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-06-21 09:12:26 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-06-21 09:12:26 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-06-21 09:12:26 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-06-21 09:12:27 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-06-21 09:12:30 source > Starting syncing SourceHubspot 2022-06-21 09:12:30 source > No scopes to grant when authenticating with API key. 2022-06-21 09:12:30 source > Syncing stream: email_events 2022-06-21 09:12:32 destination > 2022-06-21 09:12:32 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-06-21 09:12:32 destination > 2022-06-21 09:12:32 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-06-21 09:12:32 destination > 2022-06-21 09:12:32 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: WRITE 2022-06-21 09:12:32 destination > 2022-06-21 09:12:32 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-06-21 09:12:32 destination > 2022-06-21 09:12:32 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-06-21 09:12:32 destination > 2022-06-21 09:12:32 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-06-21 09:12:32 destination > 2022-06-21 09:12:32 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-06-21 09:12:32 destination > 2022-06-21 09:12:32 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):306 - Selected loading method is set to: STANDARD 2022-06-21 09:12:32 destination > 2022-06-21 09:12:32 WARN i.a.i.d.b.BigQueryDestination(getConsumer):197 - The "standard" upload mode is not performant, and is not recommended for production. Please use the GCS upload mode if you are syncing a large amount of data. 2022-06-21 09:12:32 destination > 2022-06-21 09:12:32 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):306 - Selected loading method is set to: STANDARD 2022-06-21 09:12:36 destination > 2022-06-21 09:12:36 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=hubspot_test_email, tableId=_airbyte_tmp_ioq_email_events}} 2022-06-21 09:12:42 source > Advancing bookmark for email_events stream from 2017-01-25T00:00:00+00:00 to 2019-07-22T23:00:17.728000+00:00 2022-06-21 09:12:42 source > Advancing bookmark for email_events stream from 2019-07-22T23:00:17.728000+00:00 to 2019-09-11T23:39:14.504000+00:00 2022-06-21 09:12:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 1000 (467 KB) 2022-06-21 09:12:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 2000 (968 KB) 2022-06-21 09:12:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 3000 (1 MB) 2022-06-21 09:12:50 source > Advancing bookmark for email_events stream from 2019-09-11T23:39:14.504000+00:00 to 2019-10-11T09:15:51.192000+00:00 2022-06-21 09:12:51 source > Advancing bookmark for email_events stream from 2019-10-11T09:15:51.192000+00:00 to 2019-11-08T02:14:41.600000+00:00 2022-06-21 09:12:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 4000 (1 MB) 2022-06-21 09:12:52 source > Advancing bookmark for email_events stream from 2019-11-08T02:14:41.600000+00:00 to 2019-12-10T04:04:46.135000+00:00 2022-06-21 09:12:53 source > Advancing bookmark for email_events stream from 2019-12-10T04:04:46.135000+00:00 to 2019-12-27T06:35:55.220000+00:00 2022-06-21 09:12:53 source > Advancing bookmark for email_events stream from 2019-12-27T06:35:55.220000+00:00 to 2020-02-08T11:42:51.286000+00:00 2022-06-21 09:12:54 source > Advancing bookmark for email_events stream from 2020-02-08T11:42:51.286000+00:00 to 2020-02-27T00:10:16.164000+00:00 2022-06-21 09:12:54 source > Advancing bookmark for email_events stream from 2020-02-27T00:10:16.164000+00:00 to 2020-03-31T07:43:59.762000+00:00 2022-06-21 09:12:55 source > Advancing bookmark for email_events stream from 2020-03-31T07:43:59.762000+00:00 to 2020-05-02T02:40:35.965000+00:00 2022-06-21 09:12:55 source > Advancing bookmark for email_events stream from 2020-05-02T02:40:35.965000+00:00 to 2020-06-06T23:53:26.866000+00:00 2022-06-21 09:12:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 5000 (2 MB) 2022-06-21 09:12:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 6000 (2 MB) 2022-06-21 09:12:58 source > Advancing bookmark for email_events stream from 2020-06-06T23:53:26.866000+00:00 to 2020-07-07T07:25:05.289000+00:00 2022-06-21 09:12:58 source > Advancing bookmark for email_events stream from 2020-07-07T07:25:05.289000+00:00 to 2020-08-06T12:52:08.518000+00:00 2022-06-21 09:13:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 7000 (3 MB) 2022-06-21 09:13:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 8000 (4 MB) 2022-06-21 09:13:02 source > Advancing bookmark for email_events stream from 2020-08-06T12:52:08.518000+00:00 to 2020-09-05T22:51:07.628000+00:00 2022-06-21 09:13:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 9000 (4 MB) 2022-06-21 09:13:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 10000 (5 MB) 2022-06-21 09:13:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 11000 (5 MB) 2022-06-21 09:13:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 12000 (6 MB) 2022-06-21 09:13:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 13000 (6 MB) 2022-06-21 09:13:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 14000 (7 MB) 2022-06-21 09:13:15 source > Advancing bookmark for email_events stream from 2020-09-05T22:51:07.628000+00:00 to 2020-10-05T14:23:34.722000+00:00 2022-06-21 09:13:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 15000 (8 MB) 2022-06-21 09:13:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 16000 (8 MB) 2022-06-21 09:13:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 17000 (9 MB) 2022-06-21 09:13:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 18000 (9 MB) 2022-06-21 09:13:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 19000 (10 MB) 2022-06-21 09:13:27 source > Advancing bookmark for email_events stream from 2020-10-05T14:23:34.722000+00:00 to 2020-11-04T23:44:38.787000+00:00 2022-06-21 09:13:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 20000 (10 MB) 2022-06-21 09:13:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 21000 (11 MB) 2022-06-21 09:13:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 22000 (11 MB) 2022-06-21 09:13:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 23000 (12 MB) 2022-06-21 09:13:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 24000 (13 MB) 2022-06-21 09:13:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 25000 (13 MB) 2022-06-21 09:13:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 26000 (14 MB) 2022-06-21 09:13:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 27000 (14 MB) 2022-06-21 09:13:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 28000 (15 MB) 2022-06-21 09:13:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 29000 (15 MB) 2022-06-21 09:13:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 30000 (16 MB) 2022-06-21 09:13:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 31000 (16 MB) 2022-06-21 09:13:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 32000 (17 MB) 2022-06-21 09:13:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 33000 (17 MB) 2022-06-21 09:13:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 34000 (18 MB) 2022-06-21 09:13:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 35000 (18 MB) 2022-06-21 09:13:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 36000 (19 MB) 2022-06-21 09:14:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 37000 (19 MB) 2022-06-21 09:14:01 source > Advancing bookmark for email_events stream from 2020-11-04T23:44:38.787000+00:00 to 2020-12-04T23:47:46.329000+00:00 2022-06-21 09:14:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 38000 (20 MB) 2022-06-21 09:14:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 39000 (21 MB) 2022-06-21 09:14:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 40000 (21 MB) 2022-06-21 09:14:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 41000 (22 MB) 2022-06-21 09:14:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 42000 (22 MB) 2022-06-21 09:14:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 43000 (23 MB) 2022-06-21 09:14:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 44000 (23 MB) 2022-06-21 09:14:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 45000 (23 MB) 2022-06-21 09:14:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 46000 (24 MB) 2022-06-21 09:14:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 47000 (25 MB) 2022-06-21 09:14:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 48000 (25 MB) 2022-06-21 09:14:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 49000 (26 MB) 2022-06-21 09:14:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 50000 (26 MB) 2022-06-21 09:14:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 51000 (27 MB) 2022-06-21 09:14:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 52000 (27 MB) 2022-06-21 09:14:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 53000 (28 MB) 2022-06-21 09:14:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 54000 (28 MB) 2022-06-21 09:14:36 source > Advancing bookmark for email_events stream from 2020-12-04T23:47:46.329000+00:00 to 2021-01-03T23:58:42.382000+00:00 2022-06-21 09:14:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 55000 (29 MB) 2022-06-21 09:14:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 56000 (30 MB) 2022-06-21 09:14:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 57000 (30 MB) 2022-06-21 09:14:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 58000 (30 MB) 2022-06-21 09:14:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 59000 (31 MB) 2022-06-21 09:14:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 60000 (31 MB) 2022-06-21 09:14:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 61000 (32 MB) 2022-06-21 09:14:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 62000 (32 MB) 2022-06-21 09:14:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 63000 (33 MB) 2022-06-21 09:14:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 64000 (34 MB) 2022-06-21 09:14:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 65000 (34 MB) 2022-06-21 09:14:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 66000 (34 MB) 2022-06-21 09:14:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 67000 (35 MB) 2022-06-21 09:15:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 68000 (36 MB) 2022-06-21 09:15:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 69000 (36 MB) 2022-06-21 09:15:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 70000 (37 MB) 2022-06-21 09:15:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 71000 (37 MB) 2022-06-21 09:15:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 72000 (38 MB) 2022-06-21 09:15:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 73000 (39 MB) 2022-06-21 09:15:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 74000 (39 MB) 2022-06-21 09:15:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 75000 (39 MB) 2022-06-21 09:15:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 76000 (40 MB) 2022-06-21 09:15:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 77000 (40 MB) 2022-06-21 09:15:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 78000 (41 MB) 2022-06-21 09:15:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 79000 (41 MB) 2022-06-21 09:15:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 80000 (42 MB) 2022-06-21 09:15:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 81000 (42 MB) 2022-06-21 09:15:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 82000 (43 MB) 2022-06-21 09:15:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 83000 (43 MB) 2022-06-21 09:15:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 84000 (43 MB) 2022-06-21 09:15:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 85000 (44 MB) 2022-06-21 09:15:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 86000 (45 MB) 2022-06-21 09:15:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 87000 (45 MB) 2022-06-21 09:15:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 88000 (46 MB) 2022-06-21 09:15:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 89000 (46 MB) 2022-06-21 09:15:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 90000 (46 MB) 2022-06-21 09:15:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 91000 (47 MB) 2022-06-21 09:15:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 92000 (47 MB) 2022-06-21 09:15:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 93000 (48 MB) 2022-06-21 09:15:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 94000 (48 MB) 2022-06-21 09:15:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 95000 (49 MB) 2022-06-21 09:15:54 source > Advancing bookmark for email_events stream from 2021-01-03T23:58:42.382000+00:00 to 2021-02-02T23:57:18.515000+00:00 2022-06-21 09:15:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 96000 (50 MB) 2022-06-21 09:15:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 97000 (50 MB) 2022-06-21 09:16:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 98000 (51 MB) 2022-06-21 09:16:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 99000 (51 MB) 2022-06-21 09:16:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 100000 (51 MB) 2022-06-21 09:16:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 101000 (52 MB) 2022-06-21 09:16:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 102000 (52 MB) 2022-06-21 09:16:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 103000 (53 MB) 2022-06-21 09:16:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 104000 (54 MB) 2022-06-21 09:16:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 105000 (54 MB) 2022-06-21 09:16:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 106000 (54 MB) 2022-06-21 09:16:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 107000 (55 MB) 2022-06-21 09:16:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 108000 (55 MB) 2022-06-21 09:16:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 109000 (56 MB) 2022-06-21 09:16:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 110000 (56 MB) 2022-06-21 09:16:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 111000 (57 MB) 2022-06-21 09:16:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 112000 (57 MB) 2022-06-21 09:16:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 113000 (58 MB) 2022-06-21 09:16:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 114000 (58 MB) 2022-06-21 09:16:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 115000 (59 MB) 2022-06-21 09:16:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 116000 (59 MB) 2022-06-21 09:16:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 117000 (60 MB) 2022-06-21 09:16:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 118000 (60 MB) 2022-06-21 09:16:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 119000 (61 MB) 2022-06-21 09:16:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 120000 (61 MB) 2022-06-21 09:16:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 121000 (62 MB) 2022-06-21 09:16:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 122000 (62 MB) 2022-06-21 09:16:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 123000 (63 MB) 2022-06-21 09:16:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 124000 (63 MB) 2022-06-21 09:16:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 125000 (64 MB) 2022-06-21 09:16:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 126000 (64 MB) 2022-06-21 09:16:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 127000 (65 MB) 2022-06-21 09:17:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 128000 (65 MB) 2022-06-21 09:17:01 source > Advancing bookmark for email_events stream from 2021-02-02T23:57:18.515000+00:00 to 2021-03-04T23:34:52.868000+00:00 2022-06-21 09:17:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 129000 (66 MB) 2022-06-21 09:17:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 130000 (66 MB) 2022-06-21 09:17:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 131000 (67 MB) 2022-06-21 09:17:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 132000 (67 MB) 2022-06-21 09:17:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 133000 (68 MB) 2022-06-21 09:17:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 134000 (68 MB) 2022-06-21 09:17:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 135000 (69 MB) 2022-06-21 09:17:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 136000 (69 MB) 2022-06-21 09:17:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 137000 (70 MB) 2022-06-21 09:17:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 138000 (70 MB) 2022-06-21 09:17:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 139000 (70 MB) 2022-06-21 09:17:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 140000 (71 MB) 2022-06-21 09:17:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 141000 (72 MB) 2022-06-21 09:17:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 142000 (72 MB) 2022-06-21 09:17:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 143000 (72 MB) 2022-06-21 09:17:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 144000 (73 MB) 2022-06-21 09:17:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 145000 (73 MB) 2022-06-21 09:17:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 146000 (74 MB) 2022-06-21 09:17:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 147000 (74 MB) 2022-06-21 09:17:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 148000 (75 MB) 2022-06-21 09:17:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 149000 (75 MB) 2022-06-21 09:17:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 150000 (76 MB) 2022-06-21 09:17:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 151000 (76 MB) 2022-06-21 09:17:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 152000 (77 MB) 2022-06-21 09:17:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 153000 (77 MB) 2022-06-21 09:17:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 154000 (78 MB) 2022-06-21 09:17:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 155000 (79 MB) 2022-06-21 09:17:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 156000 (79 MB) 2022-06-21 09:17:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 157000 (79 MB) 2022-06-21 09:17:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 158000 (80 MB) 2022-06-21 09:17:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 159000 (80 MB) 2022-06-21 09:17:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 160000 (81 MB) 2022-06-21 09:17:59 source > Advancing bookmark for email_events stream from 2021-03-04T23:34:52.868000+00:00 to 2021-04-03T23:53:58.571000+00:00 2022-06-21 09:18:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 161000 (81 MB) 2022-06-21 09:18:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 162000 (82 MB) 2022-06-21 09:18:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 163000 (83 MB) 2022-06-21 09:18:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 164000 (83 MB) 2022-06-21 09:18:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 165000 (83 MB) 2022-06-21 09:18:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 166000 (84 MB) 2022-06-21 09:18:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 167000 (84 MB) 2022-06-21 09:18:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 168000 (85 MB) 2022-06-21 09:18:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 169000 (85 MB) 2022-06-21 09:18:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 170000 (86 MB) 2022-06-21 09:18:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 171000 (86 MB) 2022-06-21 09:18:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 172000 (87 MB) 2022-06-21 09:18:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 173000 (87 MB) 2022-06-21 09:18:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 174000 (87 MB) 2022-06-21 09:18:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 175000 (88 MB) 2022-06-21 09:18:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 176000 (88 MB) 2022-06-21 09:18:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 177000 (89 MB) 2022-06-21 09:18:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 178000 (90 MB) 2022-06-21 09:18:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 179000 (90 MB) 2022-06-21 09:18:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 180000 (90 MB) 2022-06-21 09:18:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 181000 (91 MB) 2022-06-21 09:18:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 182000 (91 MB) 2022-06-21 09:18:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 183000 (92 MB) 2022-06-21 09:18:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 184000 (92 MB) 2022-06-21 09:18:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 185000 (93 MB) 2022-06-21 09:18:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 186000 (93 MB) 2022-06-21 09:18:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 187000 (93 MB) 2022-06-21 09:18:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 188000 (94 MB) 2022-06-21 09:18:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 189000 (94 MB) 2022-06-21 09:18:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 190000 (95 MB) 2022-06-21 09:18:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 191000 (95 MB) 2022-06-21 09:18:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 192000 (96 MB) 2022-06-21 09:18:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 193000 (96 MB) 2022-06-21 09:19:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 194000 (97 MB) 2022-06-21 09:19:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 195000 (97 MB) 2022-06-21 09:19:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 196000 (98 MB) 2022-06-21 09:19:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 197000 (98 MB) 2022-06-21 09:19:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 198000 (99 MB) 2022-06-21 09:19:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 199000 (99 MB) 2022-06-21 09:19:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 200000 (99 MB) 2022-06-21 09:19:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 201000 (100 MB) 2022-06-21 09:19:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 202000 (100 MB) 2022-06-21 09:19:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 203000 (101 MB) 2022-06-21 09:19:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 204000 (101 MB) 2022-06-21 09:19:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 205000 (102 MB) 2022-06-21 09:19:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 206000 (103 MB) 2022-06-21 09:19:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 207000 (103 MB) 2022-06-21 09:19:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 208000 (104 MB) 2022-06-21 09:19:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 209000 (104 MB) 2022-06-21 09:19:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 210000 (104 MB) 2022-06-21 09:19:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 211000 (105 MB) 2022-06-21 09:19:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 212000 (105 MB) 2022-06-21 09:19:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 213000 (106 MB) 2022-06-21 09:19:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 214000 (106 MB) 2022-06-21 09:19:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 215000 (107 MB) 2022-06-21 09:19:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 216000 (107 MB) 2022-06-21 09:19:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 217000 (108 MB) 2022-06-21 09:19:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 218000 (108 MB) 2022-06-21 09:19:45 source > Advancing bookmark for email_events stream from 2021-04-03T23:53:58.571000+00:00 to 2021-05-03T23:49:45.890000+00:00 2022-06-21 09:19:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 219000 (109 MB) 2022-06-21 09:19:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 220000 (109 MB) 2022-06-21 09:19:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 221000 (110 MB) 2022-06-21 09:19:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 222000 (110 MB) 2022-06-21 09:19:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 223000 (110 MB) 2022-06-21 09:19:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 224000 (111 MB) 2022-06-21 09:19:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 225000 (111 MB) 2022-06-21 09:19:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 226000 (112 MB) 2022-06-21 09:20:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 227000 (112 MB) 2022-06-21 09:20:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 228000 (113 MB) 2022-06-21 09:20:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 229000 (114 MB) 2022-06-21 09:20:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 230000 (114 MB) 2022-06-21 09:20:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 231000 (114 MB) 2022-06-21 09:20:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 232000 (115 MB) 2022-06-21 09:20:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 233000 (115 MB) 2022-06-21 09:20:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 234000 (115 MB) 2022-06-21 09:20:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 235000 (116 MB) 2022-06-21 09:20:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 236000 (117 MB) 2022-06-21 09:20:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 237000 (117 MB) 2022-06-21 09:20:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 238000 (118 MB) 2022-06-21 09:20:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 239000 (118 MB) 2022-06-21 09:20:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 240000 (119 MB) 2022-06-21 09:20:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 241000 (119 MB) 2022-06-21 09:20:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 242000 (119 MB) 2022-06-21 09:20:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 243000 (120 MB) 2022-06-21 09:20:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 244000 (120 MB) 2022-06-21 09:20:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 245000 (121 MB) 2022-06-21 09:20:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 246000 (121 MB) 2022-06-21 09:20:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 247000 (122 MB) 2022-06-21 09:20:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 248000 (122 MB) 2022-06-21 09:20:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 249000 (123 MB) 2022-06-21 09:20:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 250000 (123 MB) 2022-06-21 09:20:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 251000 (123 MB) 2022-06-21 09:20:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 252000 (124 MB) 2022-06-21 09:20:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 253000 (125 MB) 2022-06-21 09:20:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 254000 (125 MB) 2022-06-21 09:20:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 255000 (126 MB) 2022-06-21 09:20:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 256000 (126 MB) 2022-06-21 09:20:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 257000 (126 MB) 2022-06-21 09:20:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 258000 (127 MB) 2022-06-21 09:20:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 259000 (127 MB) 2022-06-21 09:21:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 260000 (128 MB) 2022-06-21 09:21:03 source > Advancing bookmark for email_events stream from 2021-05-03T23:49:45.890000+00:00 to 2021-06-02T23:47:09.827000+00:00 2022-06-21 09:21:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 261000 (128 MB) 2022-06-21 09:21:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 262000 (129 MB) 2022-06-21 09:21:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 263000 (130 MB) 2022-06-21 09:21:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 264000 (130 MB) 2022-06-21 09:21:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 265000 (130 MB) 2022-06-21 09:21:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 266000 (131 MB) 2022-06-21 09:21:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 267000 (131 MB) 2022-06-21 09:21:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 268000 (132 MB) 2022-06-21 09:21:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 269000 (132 MB) 2022-06-21 09:21:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 270000 (133 MB) 2022-06-21 09:21:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 271000 (133 MB) 2022-06-21 09:21:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 272000 (134 MB) 2022-06-21 09:21:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 273000 (134 MB) 2022-06-21 09:21:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 274000 (134 MB) 2022-06-21 09:21:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 275000 (135 MB) 2022-06-21 09:21:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 276000 (135 MB) 2022-06-21 09:21:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 277000 (136 MB) 2022-06-21 09:21:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 278000 (136 MB) 2022-06-21 09:21:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 279000 (137 MB) 2022-06-21 09:21:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 280000 (138 MB) 2022-06-21 09:21:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 281000 (138 MB) 2022-06-21 09:21:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 282000 (138 MB) 2022-06-21 09:21:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 283000 (139 MB) 2022-06-21 09:21:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 284000 (139 MB) 2022-06-21 09:21:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 285000 (140 MB) 2022-06-21 09:21:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 286000 (140 MB) 2022-06-21 09:21:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 287000 (141 MB) 2022-06-21 09:21:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 288000 (141 MB) 2022-06-21 09:21:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 289000 (142 MB) 2022-06-21 09:21:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 290000 (142 MB) 2022-06-21 09:21:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 291000 (143 MB) 2022-06-21 09:21:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 292000 (143 MB) 2022-06-21 09:21:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 293000 (144 MB) 2022-06-21 09:22:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 294000 (144 MB) 2022-06-21 09:22:03 source > Advancing bookmark for email_events stream from 2021-06-02T23:47:09.827000+00:00 to 2021-07-02T23:59:32.569000+00:00 2022-06-21 09:22:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 295000 (145 MB) 2022-06-21 09:22:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 296000 (145 MB) 2022-06-21 09:22:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 297000 (146 MB) 2022-06-21 09:22:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 298000 (146 MB) 2022-06-21 09:22:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 299000 (147 MB) 2022-06-21 09:22:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 300000 (147 MB) 2022-06-21 09:22:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 301000 (148 MB) 2022-06-21 09:22:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 302000 (148 MB) 2022-06-21 09:22:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 303000 (149 MB) 2022-06-21 09:22:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 304000 (150 MB) 2022-06-21 09:22:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 305000 (150 MB) 2022-06-21 09:22:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 306000 (150 MB) 2022-06-21 09:22:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 307000 (151 MB) 2022-06-21 09:22:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 308000 (151 MB) 2022-06-21 09:22:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 309000 (152 MB) 2022-06-21 09:22:29 source > Advancing bookmark for email_events stream from 2021-07-02T23:59:32.569000+00:00 to 2021-08-01T23:53:05.519000+00:00 2022-06-21 09:22:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 310000 (152 MB) 2022-06-21 09:22:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 311000 (153 MB) 2022-06-21 09:22:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 312000 (153 MB) 2022-06-21 09:22:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 313000 (154 MB) 2022-06-21 09:22:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 314000 (154 MB) 2022-06-21 09:22:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 315000 (155 MB) 2022-06-21 09:22:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 316000 (155 MB) 2022-06-21 09:22:42 source > Advancing bookmark for email_events stream from 2021-08-01T23:53:05.519000+00:00 to 2021-08-31T23:55:40.926000+00:00 2022-06-21 09:22:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 317000 (156 MB) 2022-06-21 09:22:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 318000 (156 MB) 2022-06-21 09:22:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 319000 (157 MB) 2022-06-21 09:22:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 320000 (157 MB) 2022-06-21 09:22:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 321000 (158 MB) 2022-06-21 09:22:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 322000 (158 MB) 2022-06-21 09:22:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 323000 (159 MB) 2022-06-21 09:22:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 324000 (159 MB) 2022-06-21 09:22:55 source > Advancing bookmark for email_events stream from 2021-08-31T23:55:40.926000+00:00 to 2021-09-30T23:49:47.578000+00:00 2022-06-21 09:22:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 325000 (160 MB) 2022-06-21 09:23:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 326000 (160 MB) 2022-06-21 09:23:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 327000 (161 MB) 2022-06-21 09:23:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 328000 (161 MB) 2022-06-21 09:23:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 329000 (162 MB) 2022-06-21 09:23:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 330000 (162 MB) 2022-06-21 09:23:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 331000 (163 MB) 2022-06-21 09:23:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 332000 (163 MB) 2022-06-21 09:23:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 333000 (164 MB) 2022-06-21 09:23:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 334000 (164 MB) 2022-06-21 09:23:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 335000 (165 MB) 2022-06-21 09:23:26 source > Advancing bookmark for email_events stream from 2021-09-30T23:49:47.578000+00:00 to 2021-10-30T22:59:57.073000+00:00 2022-06-21 09:23:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 336000 (165 MB) 2022-06-21 09:23:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 337000 (166 MB) 2022-06-21 09:23:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 338000 (166 MB) 2022-06-21 09:23:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 339000 (167 MB) 2022-06-21 09:23:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 340000 (167 MB) 2022-06-21 09:23:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 341000 (168 MB) 2022-06-21 09:23:38 source > Advancing bookmark for email_events stream from 2021-10-30T22:59:57.073000+00:00 to 2021-11-29T23:58:52.623000+00:00 2022-06-21 09:23:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 342000 (168 MB) 2022-06-21 09:23:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 343000 (168 MB) 2022-06-21 09:23:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 344000 (169 MB) 2022-06-21 09:23:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 345000 (169 MB) 2022-06-21 09:23:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 346000 (170 MB) 2022-06-21 09:23:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 347000 (170 MB) 2022-06-21 09:23:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 348000 (171 MB) 2022-06-21 09:23:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 349000 (171 MB) 2022-06-21 09:23:55 source > Advancing bookmark for email_events stream from 2021-11-29T23:58:52.623000+00:00 to 2021-12-29T23:58:15.967000+00:00 2022-06-21 09:23:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 350000 (172 MB) 2022-06-21 09:23:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 351000 (172 MB) 2022-06-21 09:23:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 352000 (173 MB) 2022-06-21 09:23:59 source > Advancing bookmark for email_events stream from 2021-12-29T23:58:15.967000+00:00 to 2022-01-28T09:00:13.527000+00:00 2022-06-21 09:24:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 353000 (173 MB) 2022-06-21 09:24:03 source > Advancing bookmark for email_events stream from 2022-01-28T09:00:13.527000+00:00 to 2022-02-27T23:14:49.840000+00:00 2022-06-21 09:24:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 354000 (174 MB) 2022-06-21 09:24:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 355000 (175 MB) 2022-06-21 09:24:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 356000 (175 MB) 2022-06-21 09:24:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 357000 (176 MB) 2022-06-21 09:24:10 source > Advancing bookmark for email_events stream from 2022-02-27T23:14:49.840000+00:00 to 2022-03-29T23:59:04.089000+00:00 2022-06-21 09:24:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 358000 (176 MB) 2022-06-21 09:24:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 359000 (177 MB) 2022-06-21 09:24:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 360000 (178 MB) 2022-06-21 09:24:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 361000 (178 MB) 2022-06-21 09:24:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 362000 (178 MB) 2022-06-21 09:24:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 363000 (179 MB) 2022-06-21 09:24:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 364000 (179 MB) 2022-06-21 09:24:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 365000 (180 MB) 2022-06-21 09:24:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 366000 (180 MB) 2022-06-21 09:24:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 367000 (181 MB) 2022-06-21 09:24:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 368000 (181 MB) 2022-06-21 09:24:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 369000 (182 MB) 2022-06-21 09:24:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 370000 (182 MB) 2022-06-21 09:24:35 source > Advancing bookmark for email_events stream from 2022-03-29T23:59:04.089000+00:00 to 2022-04-28T23:50:59.120000+00:00 2022-06-21 09:24:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 371000 (183 MB) 2022-06-21 09:24:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 372000 (183 MB) 2022-06-21 09:24:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 373000 (184 MB) 2022-06-21 09:24:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 374000 (184 MB) 2022-06-21 09:24:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 375000 (184 MB) 2022-06-21 09:24:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 376000 (185 MB) 2022-06-21 09:24:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 377000 (185 MB) 2022-06-21 09:24:50 source > Advancing bookmark for email_events stream from 2022-04-28T23:50:59.120000+00:00 to 2022-05-28T23:41:47.765000+00:00 2022-06-21 09:24:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 378000 (186 MB) 2022-06-21 09:24:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 379000 (187 MB) 2022-06-21 09:24:55 source > Advancing bookmark for email_events stream from 2022-05-28T23:41:47.765000+00:00 to 2022-06-21T09:18:23.521000+00:00 2022-06-21 09:24:55 source > Read 378920 records from email_events stream 2022-06-21 09:24:55 source > Finished syncing SourceHubspot 2022-06-21 09:24:55 source > SourceHubspot runtimes: 2022-06-21 09:24:55 source > Finished syncing SourceHubspot 2022-06-21 09:24:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):347 - Source has no more messages, closing connection. 2022-06-21 09:24:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):355 - Total records read: 379731 (187 MB) 2022-06-21 09:24:55 INFO i.a.w.g.DefaultReplicationWorker(run):174 - One of source or destination thread complete. Waiting on the other. 2022-06-21 09:24:55 destination > 2022-06-21 09:24:55 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded. 2022-06-21 09:24:55 destination > 2022-06-21 09:24:55 INFO i.a.i.d.b.BigQueryRecordConsumer(close):58 - Started closing all connections 2022-06-21 09:24:55 destination > 2022-06-21 09:24:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_email_events, tmpTable=_airbyte_tmp_ioq_email_events, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-06-21 09:24:57 destination > 2022-06-21 09:24:57 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Waiting for job finish Job{job=JobId{project=analytics-platform-201110, job=7bb9d7b8-9bc1-4419-b43b-ca8bf2b26397, location=asia-northeast1}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1655803497214, endTime=null, startTime=1655803497430, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=hubspot-bq@analytics-platform-201110.iam.gserviceaccount.com, etag=znmGR7A2kyhGzPMFczquJw==, generatedId=analytics-platform-201110:asia-northeast1.7bb9d7b8-9bc1-4419-b43b-ca8bf2b26397, selfLink=https://www.googleapis.com/bigquery/v2/projects/analytics-platform-201110/jobs/7bb9d7b8-9bc1-4419-b43b-ca8bf2b26397?location=asia-northeast1, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=hubspot_test_email, projectId=analytics-platform-201110, tableId=_airbyte_tmp_ioq_email_events}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-06-21 09:25:12 destination > 2022-06-21 09:25:12 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):329 - Job finish Job{job=JobId{project=analytics-platform-201110, job=7bb9d7b8-9bc1-4419-b43b-ca8bf2b26397, location=asia-northeast1}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1655803497214, endTime=null, startTime=1655803497430, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=hubspot-bq@analytics-platform-201110.iam.gserviceaccount.com, etag=znmGR7A2kyhGzPMFczquJw==, generatedId=analytics-platform-201110:asia-northeast1.7bb9d7b8-9bc1-4419-b43b-ca8bf2b26397, selfLink=https://www.googleapis.com/bigquery/v2/projects/analytics-platform-201110/jobs/7bb9d7b8-9bc1-4419-b43b-ca8bf2b26397?location=asia-northeast1, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=hubspot_test_email, projectId=analytics-platform-201110, tableId=_airbyte_tmp_ioq_email_events}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-06-21 09:25:12 destination > 2022-06-21 09:25:12 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_ioq_email_events to the source table _airbyte_raw_email_events. 2022-06-21 09:25:12 destination > 2022-06-21 09:25:12 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-06-21 09:25:16 destination > 2022-06-21 09:25:16 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=hubspot_test_email, tableId=_airbyte_tmp_ioq_email_events}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=hubspot_test_email, tableId=_airbyte_raw_email_events}} 2022-06-21 09:25:16 destination > 2022-06-21 09:25:16 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_email_events! 2022-06-21 09:25:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):405 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@6ad825a3[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@641fc688[stateType=,stream=,global=,data={"email_events":{"created":1655803103521}},additionalProperties={streams=[]}],trace=,additionalProperties={}] 2022-06-21 09:25:16 destination > 2022-06-21 09:25:16 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-06-21 09:25:16 destination > 2022-06-21 09:25:16 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-06-21 09:25:16 destination > 2022-06-21 09:25:16 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-06-21 09:25:16 destination > 2022-06-21 09:25:16 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_email_events, tmpTable=_airbyte_tmp_ioq_email_events, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-06-21 09:25:16 destination > 2022-06-21 09:25:16 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-06-21 09:25:17 INFO i.a.w.g.DefaultReplicationWorker(run):176 - Source and destination threads complete. 2022-06-21 09:25:17 INFO i.a.w.g.DefaultReplicationWorker(run):239 - sync summary: io.airbyte.config.ReplicationAttemptSummary@b00ed79[status=completed,recordsSynced=378920,bytesSynced=196622911,startTime=1655802744963,endTime=1655803517137,totalStats=io.airbyte.config.SyncStats@e5f87c1[recordsEmitted=378920,bytesEmitted=196622911,stateMessagesEmitted=811,recordsCommitted=378920],streamStats=[io.airbyte.config.StreamSyncStats@560bc4f2[streamName=email_events,stats=io.airbyte.config.SyncStats@64a5c51a[recordsEmitted=378920,bytesEmitted=196622911,stateMessagesEmitted=,recordsCommitted=378920]]]] 2022-06-21 09:25:17 INFO i.a.w.g.DefaultReplicationWorker(run):266 - Source output at least one state message 2022-06-21 09:25:17 INFO i.a.w.g.DefaultReplicationWorker(run):272 - State capture: Updated state to: Optional[io.airbyte.config.State@68c297d2[state={"email_events":{"created":1655803103521}}]] 2022-06-21 09:25:17 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-06-21 09:25:17 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):157 - sync summary: io.airbyte.config.StandardSyncOutput@65014eb9[standardSyncSummary=io.airbyte.config.StandardSyncSummary@12f00373[status=completed,recordsSynced=378920,bytesSynced=196622911,startTime=1655802744963,endTime=1655803517137,totalStats=io.airbyte.config.SyncStats@e5f87c1[recordsEmitted=378920,bytesEmitted=196622911,stateMessagesEmitted=811,recordsCommitted=378920],streamStats=[io.airbyte.config.StreamSyncStats@560bc4f2[streamName=email_events,stats=io.airbyte.config.SyncStats@64a5c51a[recordsEmitted=378920,bytesEmitted=196622911,stateMessagesEmitted=,recordsCommitted=378920]]]],normalizationSummary=,state=io.airbyte.config.State@68c297d2[state={"email_events":{"created":1655803103521}}],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@542e4dfb[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@6a355e8f[stream=io.airbyte.protocol.models.AirbyteStream@52eb1f6[name=email_events,jsonSchema={"type":["null","object"],"$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","string"]},"url":{"type":["null","string"]},"from":{"type":["null","string"]},"hmid":{"type":["null","string"]},"type":{"type":["null","string"]},"appId":{"type":["null","integer"]},"linkId":{"type":["null","integer"]},"sentBy":{"type":["null","object"],"properties":{"id":{"type":["null","string"]},"created":{"type":["null","integer"]}}},"smtpId":{"type":["null","string"]},"source":{"type":["null","string"]},"status":{"type":["null","string"]},"appName":{"type":["null","string"]},"attempt":{"type":["null","integer"]},"bounced":{"type":["null","boolean"]},"browser":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"name":{"type":["null","string"]},"type":{"type":["null","string"]},"family":{"type":["null","string"]},"version":{"type":["null","array"],"items":{"type":["null","string"]}},"producer":{"type":["null","string"]},"producerUrl":{"type":["null","string"]}}},"created":{"type":["null","integer"]},"referer":{"type":["null","string"]},"replyTo":{"type":["null","array"],"items":{"type":["null","string"]}},"subject":{"type":["null","string"]},"category":{"type":["null","string"]},"causedBy":{"type":["null","object"],"properties":{"id":{"type":["null","string"]},"created":{"type":["null","integer"]}}},"duration":{"type":["null","integer"]},"location":{"type":["null","object"],"properties":{"city":{"type":["null","string"]},"state":{"type":["null","string"]},"country":{"type":["null","string"]},"zipcode":{"type":["null","string"]},"latitude":{"type":["null","number"]},"longitude":{"type":["null","number"]}}},"portalId":{"type":["null","integer"]},"response":{"type":["null","string"]},"sourceId":{"type":["null","string"]},"ipAddress":{"type":["null","string"]},"recipient":{"type":["null","string"]},"userAgent":{"type":["null","string"]},"deviceType":{"type":["null","string"]},"dropReason":{"type":["null","string"]},"dropMessage":{"type":["null","string"]},"obsoletedBy":{"type":["null","object"],"properties":{"id":{"type":["null","string"]},"created":{"type":["null","integer"]}}},"requestedBy":{"type":["null","string"]},"filteredEvent":{"type":["null","boolean"]},"emailCampaignId":{"type":["null","integer"]},"requestedByUserId":{"type":["null","integer"]},"emailCampaignGroupId":{"type":["null","integer"]},"portalSubscriptionStatus":{"type":["null","string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[created],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=incremental,cursorField=[created],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[]] 2022-06-21 09:25:17 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):237 - Stopping temporal heartbeating... 2022-06-21 09:25:17 INFO i.a.c.p.ConfigRepository(updateConnectionState):775 - Updating connection c546ad3d-d205-412c-9689-787be0935304 state: io.airbyte.config.State@7131f6a0[state={"email_events":{"created":1655803103521}}] 2022-06-21 09:25:17 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/34/1/logs.log 2022-06-21 09:25:17 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.20-alpha 2022-06-21 09:25:17 INFO i.a.w.g.DefaultNormalizationWorker(run):49 - Running normalization. 2022-06-21 09:25:17 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):122 - Running with normalization version: airbyte/normalization:0.2.5 2022-06-21 09:25:17 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/normalization:0.2.5 exists... 2022-06-21 09:25:17 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/normalization:0.2.5 was found locally. 2022-06-21 09:25:17 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 34 2022-06-21 09:25:17 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/34/1/normalize --log-driver none --name normalization-normalize-34-1-ovfkh --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.39.20-alpha airbyte/normalization:0.2.5 run --integration-type bigquery --config destination_config.json --catalog destination_catalog.json 2022-06-21 09:25:17 normalization > Running: transform-config --config destination_config.json --integration-type bigquery --out /data/34/1/normalize 2022-06-21 09:25:18 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/34/1/normalize') 2022-06-21 09:25:18 normalization > transform_bigquery 2022-06-21 09:25:18 normalization > Running: transform-catalog --integration-type bigquery --profile-config-dir /data/34/1/normalize --catalog destination_catalog.json --out /data/34/1/normalize/models/generated/ --json-column _airbyte_data 2022-06-21 09:25:20 normalization > Processing destination_catalog.json... 2022-06-21 09:25:20 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_ab1.sql from email_events 2022-06-21 09:25:20 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_ab2.sql from email_events 2022-06-21 09:25:20 normalization > Generating airbyte_views/hubspot_test_email/email_events_stg.sql from email_events 2022-06-21 09:25:20 normalization > Generating airbyte_incremental/scd/hubspot_test_email/email_events_scd.sql from email_events 2022-06-21 09:25:20 normalization > Generating airbyte_incremental/hubspot_test_email/email_events.sql from email_events 2022-06-21 09:25:20 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_sentBy_ab1.sql from email_events/sentBy 2022-06-21 09:25:20 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_sentBy_ab2.sql from email_events/sentBy 2022-06-21 09:25:20 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_sentBy_ab3.sql from email_events/sentBy 2022-06-21 09:25:20 normalization > Generating airbyte_incremental/hubspot_test_email/email_events_sentBy.sql from email_events/sentBy 2022-06-21 09:25:20 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_browser_ab1.sql from email_events/browser 2022-06-21 09:25:20 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_browser_ab2.sql from email_events/browser 2022-06-21 09:25:20 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_browser_ab3.sql from email_events/browser 2022-06-21 09:25:20 normalization > Generating airbyte_incremental/hubspot_test_email/email_events_browser.sql from email_events/browser 2022-06-21 09:25:20 normalization > Ignoring stream 'replyTo' from email_events/replyTo because properties list is empty 2022-06-21 09:25:20 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_causedBy_ab1.sql from email_events/causedBy 2022-06-21 09:25:20 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_causedBy_ab2.sql from email_events/causedBy 2022-06-21 09:25:20 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_causedBy_ab3.sql from email_events/causedBy 2022-06-21 09:25:20 normalization > Generating airbyte_incremental/hubspot_test_email/email_events_causedBy.sql from email_events/causedBy 2022-06-21 09:25:20 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_location_ab1.sql from email_events/location 2022-06-21 09:25:20 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_location_ab2.sql from email_events/location 2022-06-21 09:25:20 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_location_ab3.sql from email_events/location 2022-06-21 09:25:20 normalization > Generating airbyte_incremental/hubspot_test_email/email_events_location.sql from email_events/location 2022-06-21 09:25:20 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_obsoletedBy_ab1.sql from email_events/obsoletedBy 2022-06-21 09:25:20 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_obsoletedBy_ab2.sql from email_events/obsoletedBy 2022-06-21 09:25:20 normalization > Generating airbyte_ctes/hubspot_test_email/email_events_obsoletedBy_ab3.sql from email_events/obsoletedBy 2022-06-21 09:25:20 normalization > Generating airbyte_incremental/hubspot_test_email/email_events_obsoletedBy.sql from email_events/obsoletedBy 2022-06-21 09:25:20 normalization > Ignoring stream 'version' from email_events/browser/version because properties list is empty 2022-06-21 09:25:20 normalization > detected no config file for ssh, assuming ssh is off. 2022-06-21 09:25:29 normalization > [--event-buffer-size EVENT_BUFFER_SIZE] 2022-06-21 09:25:29 normalization > --event-buffer-size EVENT_BUFFER_SIZE 2022-06-21 09:25:29 normalization > 2022-06-21 09:25:29 normalization > DBT >=1.0.0 detected; using 10K event buffer size 2022-06-21 09:25:29 normalization > 2022-06-21 09:25:37 normalization > 09:25:37 Running with dbt=1.0.0 2022-06-21 09:25:37 normalization > 09:25:37 Partial parse save file not found. Starting full parse. 2022-06-21 09:25:45 normalization > 09:25:45 [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. 2022-06-21 09:25:45 normalization > There are 1 unused configuration paths: 2022-06-21 09:25:45 normalization > - models.airbyte_utils.generated.airbyte_tables 2022-06-21 09:25:45 normalization > 2022-06-21 09:25:46 normalization > 09:25:46 Found 25 models, 0 tests, 0 snapshots, 0 analyses, 549 macros, 0 operations, 0 seed files, 1 source, 0 exposures, 0 metrics 2022-06-21 09:25:46 normalization > 09:25:46 2022-06-21 09:25:48 normalization > 09:25:48 Concurrency: 8 threads (target='prod') 2022-06-21 09:25:48 normalization > 09:25:48 2022-06-21 09:25:48 normalization > 09:25:48 1 of 8 START view model _airbyte_hubspot_test_email.email_events_stg.................................................... [RUN] 2022-06-21 09:25:50 normalization > 09:25:50 1 of 8 OK created view model _airbyte_hubspot_test_email.email_events_stg............................................... [OK in 1.94s] 2022-06-21 09:25:50 normalization > 09:25:50 2 of 8 START incremental model hubspot_test_email.email_events_scd...................................................... [RUN] 2022-06-21 09:28:08 normalization > 09:28:08 2 of 8 OK created incremental model hubspot_test_email.email_events_scd................................................. [MERGE (757.8k rows, 590.7 MB processed) in 137.77s] 2022-06-21 09:28:08 normalization > 09:28:08 3 of 8 START incremental model hubspot_test_email.email_events.......................................................... [RUN] 2022-06-21 09:28:09 normalization > 09:28:09 4 of 8 START incremental model hubspot_test_email.email_events_causedBy................................................. [RUN] 2022-06-21 09:28:09 normalization > 09:28:09 5 of 8 START incremental model hubspot_test_email.email_events_browser.................................................. [RUN] 2022-06-21 09:28:09 normalization > 09:28:09 6 of 8 START incremental model hubspot_test_email.email_events_sentBy................................................... [RUN] 2022-06-21 09:28:09 normalization > 09:28:09 7 of 8 START incremental model hubspot_test_email.email_events_obsoletedBy.............................................. [RUN] 2022-06-21 09:28:09 normalization > 09:28:09 8 of 8 START incremental model hubspot_test_email.email_events_location................................................. [RUN] 2022-06-21 09:28:09 normalization > 09:28:09 09:28:09 + `analytics-platform-201110`.hubspot_test_email.`email_events_browser`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-06-21 09:28:14 normalization > 09:28:14 7 of 8 OK created incremental model hubspot_test_email.email_events_obsoletedBy......................................... [MERGE (202.0 rows, 33.1 KB processed) in 5.04s] 2022-06-21 09:28:14 normalization > 09:28:14 4 of 8 OK created incremental model hubspot_test_email.email_events_causedBy............................................ [MERGE (5.8k rows, 862.5 KB processed) in 5.64s] 2022-06-21 09:28:18 normalization > 09:28:18 8 of 8 OK created incremental model hubspot_test_email.email_events_location............................................ [MERGE (120.1k rows, 17.8 MB processed) in 9.06s] 2022-06-21 09:28:23 normalization > 09:28:23 6 of 8 OK created incremental model hubspot_test_email.email_events_sentBy.............................................. [MERGE (375.8k rows, 60.2 MB processed) in 14.28s] 2022-06-21 09:28:26 normalization > 09:28:26 5 of 8 ERROR creating incremental model hubspot_test_email.email_events_browser......................................... [ERROR in 16.86s] 2022-06-21 09:28:41 normalization > 09:28:41 3 of 8 OK created incremental model hubspot_test_email.email_events..................................................... [MERGE (378.9k rows, 355.7 MB processed) in 33.27s] 2022-06-21 09:28:41 normalization > 09:28:41 2022-06-21 09:28:41 normalization > 09:28:41 Finished running 1 view model, 7 incremental models in 175.61s. 2022-06-21 09:28:41 normalization > 09:28:41 2022-06-21 09:28:41 normalization > 09:28:41 Completed with 1 error and 0 warnings: 2022-06-21 09:28:41 normalization > 09:28:41 2022-06-21 09:28:41 normalization > 09:28:41 Database Error in model email_events_browser (models/generated/airbyte_incremental/hubspot_test_email/email_events_browser.sql) 2022-06-21 09:28:41 normalization > 09:28:41 Array cannot have a null element; error in writing field version 2022-06-21 09:28:41 normalization > 09:28:41 compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_incremental/hubspot_test_email/email_events_browser.sql 2022-06-21 09:28:41 normalization > 09:28:41 2022-06-21 09:28:41 normalization > 09:28:41 Done. PASS=7 WARN=0 ERROR=1 SKIP=0 TOTAL=8 2022-06-21 09:28:42 normalization > 2022-06-21 09:28:42 normalization > Diagnosing dbt debug to check if destination is available for dbt and well configured (1): 2022-06-21 09:28:42 normalization > 2022-06-21 09:28:49 normalization > 09:28:49 Running with dbt=1.0.0 2022-06-21 09:28:49 normalization > dbt version: 1.0.0 2022-06-21 09:28:49 normalization > python version: 3.9.9 2022-06-21 09:28:49 normalization > python path: /usr/local/bin/python 2022-06-21 09:28:49 normalization > os info: Linux-5.4.0-113-generic-x86_64-with-glibc2.31 2022-06-21 09:28:49 normalization > Using profiles.yml file at /data/34/1/normalize/profiles.yml 2022-06-21 09:28:49 normalization > Using dbt_project.yml file at /data/34/1/normalize/dbt_project.yml 2022-06-21 09:28:49 normalization > 2022-06-21 09:28:51 normalization > Configuration: 2022-06-21 09:28:51 normalization > profiles.yml file [OK found and valid] 2022-06-21 09:28:51 normalization > dbt_project.yml file [OK found and valid] 2022-06-21 09:28:51 normalization > 2022-06-21 09:28:51 normalization > Required dependencies: 2022-06-21 09:28:51 normalization > - git [OK found] 2022-06-21 09:28:51 normalization > 2022-06-21 09:28:51 normalization > Connection: 2022-06-21 09:28:51 normalization > method: service-account-json 2022-06-21 09:28:51 normalization > database: analytics-platform-201110 2022-06-21 09:28:51 normalization > schema: hubspot_test_email 2022-06-21 09:28:51 normalization > location: asia-northeast1 2022-06-21 09:28:51 normalization > priority: interactive 2022-06-21 09:28:51 normalization > timeout_seconds: 300 2022-06-21 09:28:51 normalization > maximum_bytes_billed: None 2022-06-21 09:28:51 normalization > execution_project: analytics-platform-201110 2022-06-21 09:28:51 normalization > Connection test: [OK connection ok] 2022-06-21 09:28:51 normalization > 2022-06-21 09:28:51 normalization > All checks passed! 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > Forward dbt output logs to diagnose/debug errors (0): 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > ============================== 2022-06-21 09:25:37.838653 | f48615ae-c25c-4986-937c-ea4af5dd8450 ============================== 2022-06-21 09:28:52 normalization > 09:25:37.838653 [info ] [MainThread]: Running with dbt=1.0.0 2022-06-21 09:28:52 normalization > 09:25:37.840188 [debug] [MainThread]: running dbt with arguments Namespace(record_timing_info=None, debug=None, log_format=None, write_json=None, use_colors=None, printer_width=None, warn_error=None, version_check=None, partial_parse=None, single_threaded=False, use_experimental_parser=None, static_parser=None, profiles_dir='/data/34/1/normalize', send_anonymous_usage_stats=None, fail_fast=None, event_buffer_size='10000', project_dir='/data/34/1/normalize', profile=None, target=None, vars='{}', log_cache_events=False, threads=None, select=None, exclude=None, selector_name=None, state=None, defer=None, full_refresh=False, cls=, which='run', rpc_method='run') 2022-06-21 09:28:52 normalization > 09:25:37.841383 [debug] [MainThread]: Tracking: do not track 2022-06-21 09:28:52 normalization > 09:25:37.939879 [info ] [MainThread]: Partial parse save file not found. Starting full parse. 2022-06-21 09:28:52 normalization > 09:25:38.118694 [debug] [MainThread]: Parsing macros/should_full_refresh.sql 2022-06-21 09:28:52 normalization > 09:25:38.163897 [debug] [MainThread]: Parsing macros/get_custom_schema.sql 2022-06-21 09:28:52 normalization > 09:25:38.168177 [debug] [MainThread]: Parsing macros/star_intersect.sql 2022-06-21 09:28:52 normalization > 09:25:38.218311 [debug] [MainThread]: Parsing macros/configuration.sql 2022-06-21 09:28:52 normalization > 09:25:38.232746 [debug] [MainThread]: Parsing macros/incremental.sql 2022-06-21 09:28:52 normalization > 09:25:38.265045 [debug] [MainThread]: Parsing macros/schema_tests/equal_rowcount.sql 2022-06-21 09:28:52 normalization > 09:25:38.272972 [debug] [MainThread]: Parsing macros/schema_tests/equality.sql 2022-06-21 09:28:52 normalization > 09:25:38.307359 [debug] [MainThread]: Parsing macros/cross_db_utils/current_timestamp.sql 2022-06-21 09:28:52 normalization > 09:25:38.310150 [debug] [MainThread]: Parsing macros/cross_db_utils/datatypes.sql 2022-06-21 09:28:52 normalization > 09:25:38.364657 [debug] [MainThread]: Parsing macros/cross_db_utils/hash.sql 2022-06-21 09:28:52 normalization > 09:25:38.367379 [debug] [MainThread]: Parsing macros/cross_db_utils/json_operations.sql 2022-06-21 09:28:52 normalization > 09:25:38.565236 [debug] [MainThread]: Parsing macros/cross_db_utils/array.sql 2022-06-21 09:28:52 normalization > 09:25:38.644066 [debug] [MainThread]: Parsing macros/cross_db_utils/concat.sql 2022-06-21 09:28:52 normalization > 09:25:38.656080 [debug] [MainThread]: Parsing macros/cross_db_utils/quote.sql 2022-06-21 09:28:52 normalization > 09:25:38.663620 [debug] [MainThread]: Parsing macros/cross_db_utils/type_conversions.sql 2022-06-21 09:28:52 normalization > 09:25:38.704376 [debug] [MainThread]: Parsing macros/cross_db_utils/surrogate_key.sql 2022-06-21 09:28:52 normalization > 09:25:38.716596 [debug] [MainThread]: Parsing macros/cross_db_utils/except.sql 2022-06-21 09:28:52 normalization > 09:25:38.720160 [debug] [MainThread]: Parsing macros/cross_db_utils/columns.sql 2022-06-21 09:28:52 normalization > 09:25:38.733633 [debug] [MainThread]: Parsing macros/adapters.sql 2022-06-21 09:28:52 normalization > 09:25:38.869452 [debug] [MainThread]: Parsing macros/catalog.sql 2022-06-21 09:28:52 normalization > 09:25:38.905598 [debug] [MainThread]: Parsing macros/etc.sql 2022-06-21 09:28:52 normalization > 09:25:38.914648 [debug] [MainThread]: Parsing macros/materializations/copy.sql 2022-06-21 09:28:52 normalization > 09:25:38.927817 [debug] [MainThread]: Parsing macros/materializations/view.sql 2022-06-21 09:28:52 normalization > 09:25:38.941285 [debug] [MainThread]: Parsing macros/materializations/table.sql 2022-06-21 09:28:52 normalization > 09:25:38.961984 [debug] [MainThread]: Parsing macros/materializations/snapshot.sql 2022-06-21 09:28:52 normalization > 09:25:38.970851 [debug] [MainThread]: Parsing macros/materializations/incremental.sql 2022-06-21 09:28:52 normalization > 09:25:39.053409 [debug] [MainThread]: Parsing macros/materializations/seed.sql 2022-06-21 09:28:52 normalization > 09:25:39.066232 [debug] [MainThread]: Parsing macros/etc/statement.sql 2022-06-21 09:28:52 normalization > 09:25:39.089540 [debug] [MainThread]: Parsing macros/etc/datetime.sql 2022-06-21 09:28:52 normalization > 09:25:39.137322 [debug] [MainThread]: Parsing macros/get_custom_name/get_custom_alias.sql 2022-06-21 09:28:52 normalization > 09:25:39.146990 [debug] [MainThread]: Parsing macros/get_custom_name/get_custom_schema.sql 2022-06-21 09:28:52 normalization > 09:25:39.159689 [debug] [MainThread]: Parsing macros/get_custom_name/get_custom_database.sql 2022-06-21 09:28:52 normalization > 09:25:39.167463 [debug] [MainThread]: Parsing macros/materializations/configs.sql 2022-06-21 09:28:52 normalization > 09:25:39.180057 [debug] [MainThread]: Parsing macros/materializations/hooks.sql 2022-06-21 09:28:52 normalization > 09:25:39.205716 [debug] [MainThread]: Parsing macros/materializations/models/table/create_table_as.sql 2022-06-21 09:28:52 normalization > 09:25:39.221384 [debug] [MainThread]: Parsing macros/materializations/models/table/table.sql 2022-06-21 09:28:52 normalization > 09:25:39.261539 [debug] [MainThread]: Parsing macros/materializations/models/view/view.sql 2022-06-21 09:28:52 normalization > 09:25:39.301114 [debug] [MainThread]: Parsing macros/materializations/models/view/helpers.sql 2022-06-21 09:28:52 normalization > 09:25:39.307519 [debug] [MainThread]: Parsing macros/materializations/models/view/create_view_as.sql 2022-06-21 09:28:52 normalization > 09:25:39.318658 [debug] [MainThread]: Parsing macros/materializations/models/view/create_or_replace_view.sql 2022-06-21 09:28:52 normalization > 09:25:39.335998 [debug] [MainThread]: Parsing macros/materializations/models/incremental/merge.sql 2022-06-21 09:28:52 normalization > 09:25:39.403009 [debug] [MainThread]: Parsing macros/materializations/models/incremental/column_helpers.sql 2022-06-21 09:28:52 normalization > 09:25:39.430267 [debug] [MainThread]: Parsing macros/materializations/models/incremental/is_incremental.sql 2022-06-21 09:28:52 normalization > 09:25:39.437641 [debug] [MainThread]: Parsing macros/materializations/models/incremental/incremental.sql 2022-06-21 09:28:52 normalization > 09:25:39.493432 [debug] [MainThread]: Parsing macros/materializations/models/incremental/on_schema_change.sql 2022-06-21 09:28:52 normalization > 09:25:39.586160 [debug] [MainThread]: Parsing macros/materializations/tests/test.sql 2022-06-21 09:28:52 normalization > 09:25:39.612886 [debug] [MainThread]: Parsing macros/materializations/tests/where_subquery.sql 2022-06-21 09:28:52 normalization > 09:25:39.623597 [debug] [MainThread]: Parsing macros/materializations/tests/helpers.sql 2022-06-21 09:28:52 normalization > 09:25:39.632408 [debug] [MainThread]: Parsing macros/materializations/seeds/helpers.sql 2022-06-21 09:28:52 normalization > 09:25:39.726584 [debug] [MainThread]: Parsing macros/materializations/seeds/seed.sql 2022-06-21 09:28:52 normalization > 09:25:39.762719 [debug] [MainThread]: Parsing macros/materializations/snapshots/snapshot_merge.sql 2022-06-21 09:28:52 normalization > 09:25:39.771156 [debug] [MainThread]: Parsing macros/materializations/snapshots/helpers.sql 2022-06-21 09:28:52 normalization > 09:25:39.836988 [debug] [MainThread]: Parsing macros/materializations/snapshots/strategies.sql 2022-06-21 09:28:52 normalization > 09:25:39.932539 [debug] [MainThread]: Parsing macros/materializations/snapshots/snapshot.sql 2022-06-21 09:28:52 normalization > 09:25:39.973739 [debug] [MainThread]: Parsing macros/generic_test_sql/not_null.sql 2022-06-21 09:28:52 normalization > 09:25:39.975519 [debug] [MainThread]: Parsing macros/generic_test_sql/accepted_values.sql 2022-06-21 09:28:52 normalization > 09:25:39.980157 [debug] [MainThread]: Parsing macros/generic_test_sql/relationships.sql 2022-06-21 09:28:52 normalization > 09:25:39.983060 [debug] [MainThread]: Parsing macros/generic_test_sql/unique.sql 2022-06-21 09:28:52 normalization > 09:25:39.985176 [debug] [MainThread]: Parsing macros/adapters/schema.sql 2022-06-21 09:28:52 normalization > 09:25:39.991946 [debug] [MainThread]: Parsing macros/adapters/metadata.sql 2022-06-21 09:28:52 normalization > 09:25:40.032549 [debug] [MainThread]: Parsing macros/adapters/freshness.sql 2022-06-21 09:28:52 normalization > 09:25:40.049718 [debug] [MainThread]: Parsing macros/adapters/indexes.sql 2022-06-21 09:28:52 normalization > 09:25:40.065126 [debug] [MainThread]: Parsing macros/adapters/persist_docs.sql 2022-06-21 09:28:52 normalization > 09:25:40.091016 [debug] [MainThread]: Parsing macros/adapters/relation.sql 2022-06-21 09:28:52 normalization > 09:25:40.147008 [debug] [MainThread]: Parsing macros/adapters/columns.sql 2022-06-21 09:28:52 normalization > 09:25:40.204047 [debug] [MainThread]: Parsing tests/generic/builtin.sql 2022-06-21 09:28:52 normalization > 09:25:40.221531 [debug] [MainThread]: Parsing macros/web/get_url_parameter.sql 2022-06-21 09:28:52 normalization > 09:25:40.230637 [debug] [MainThread]: Parsing macros/web/get_url_host.sql 2022-06-21 09:28:52 normalization > 09:25:40.242369 [debug] [MainThread]: Parsing macros/web/get_url_path.sql 2022-06-21 09:28:52 normalization > 09:25:40.257007 [debug] [MainThread]: Parsing macros/schema_tests/not_accepted_values.sql 2022-06-21 09:28:52 normalization > 09:25:40.269311 [debug] [MainThread]: Parsing macros/schema_tests/relationships_where.sql 2022-06-21 09:28:52 normalization > 09:25:40.282301 [debug] [MainThread]: Parsing macros/schema_tests/equal_rowcount.sql 2022-06-21 09:28:52 normalization > 09:25:40.291758 [debug] [MainThread]: Parsing macros/schema_tests/cardinality_equality.sql 2022-06-21 09:28:52 normalization > 09:25:40.303535 [debug] [MainThread]: Parsing macros/schema_tests/test_not_null_where.sql 2022-06-21 09:28:52 normalization > 09:25:40.311702 [debug] [MainThread]: Parsing macros/schema_tests/accepted_range.sql 2022-06-21 09:28:52 normalization > 09:25:40.326205 [debug] [MainThread]: Parsing macros/schema_tests/mutually_exclusive_ranges.sql 2022-06-21 09:28:52 normalization > 09:25:40.380189 [debug] [MainThread]: Parsing macros/schema_tests/expression_is_true.sql 2022-06-21 09:28:52 normalization > 09:25:40.392213 [debug] [MainThread]: Parsing macros/schema_tests/not_constant.sql 2022-06-21 09:28:52 normalization > 09:25:40.399317 [debug] [MainThread]: Parsing macros/schema_tests/fewer_rows_than.sql 2022-06-21 09:28:52 normalization > 09:25:40.408973 [debug] [MainThread]: Parsing macros/schema_tests/test_unique_where.sql 2022-06-21 09:28:52 normalization > 09:25:40.417122 [debug] [MainThread]: Parsing macros/schema_tests/equality.sql 2022-06-21 09:28:52 normalization > 09:25:40.438478 [debug] [MainThread]: Parsing macros/schema_tests/sequential_values.sql 2022-06-21 09:28:52 normalization > 09:25:40.455308 [debug] [MainThread]: Parsing macros/schema_tests/at_least_one.sql 2022-06-21 09:28:52 normalization > 09:25:40.462487 [debug] [MainThread]: Parsing macros/schema_tests/unique_combination_of_columns.sql 2022-06-21 09:28:52 normalization > 09:25:40.480182 [debug] [MainThread]: Parsing macros/schema_tests/recency.sql 2022-06-21 09:28:52 normalization > 09:25:40.490494 [debug] [MainThread]: Parsing macros/schema_tests/not_null_proportion.sql 2022-06-21 09:28:52 normalization > 09:25:40.503352 [debug] [MainThread]: Parsing macros/sql/star.sql 2022-06-21 09:28:52 normalization > 09:25:40.528973 [debug] [MainThread]: Parsing macros/sql/get_column_values.sql 2022-06-21 09:28:52 normalization > 09:25:40.559566 [debug] [MainThread]: Parsing macros/sql/get_tables_by_pattern_sql.sql 2022-06-21 09:28:52 normalization > 09:25:40.596384 [debug] [MainThread]: Parsing macros/sql/get_relations_by_prefix.sql 2022-06-21 09:28:52 normalization > 09:25:40.616360 [debug] [MainThread]: Parsing macros/sql/nullcheck_table.sql 2022-06-21 09:28:52 normalization > 09:25:40.625664 [debug] [MainThread]: Parsing macros/sql/get_relations_by_pattern.sql 2022-06-21 09:28:52 normalization > 09:25:40.646106 [debug] [MainThread]: Parsing macros/sql/generate_series.sql 2022-06-21 09:28:52 normalization > 09:25:40.671263 [debug] [MainThread]: Parsing macros/sql/get_tables_by_prefix_sql.sql 2022-06-21 09:28:52 normalization > 09:25:40.680989 [debug] [MainThread]: Parsing macros/sql/haversine_distance.sql 2022-06-21 09:28:52 normalization > 09:25:40.715469 [debug] [MainThread]: Parsing macros/sql/groupby.sql 2022-06-21 09:28:52 normalization > 09:25:40.723068 [debug] [MainThread]: Parsing macros/sql/date_spine.sql 2022-06-21 09:28:52 normalization > 09:25:40.747674 [debug] [MainThread]: Parsing macros/sql/unpivot.sql 2022-06-21 09:28:52 normalization > 09:25:40.795206 [debug] [MainThread]: Parsing macros/sql/get_table_types_sql.sql 2022-06-21 09:28:52 normalization > 09:25:40.802357 [debug] [MainThread]: Parsing macros/sql/surrogate_key.sql 2022-06-21 09:28:52 normalization > 09:25:40.822741 [debug] [MainThread]: Parsing macros/sql/safe_add.sql 2022-06-21 09:28:52 normalization > 09:25:40.832124 [debug] [MainThread]: Parsing macros/sql/union.sql 2022-06-21 09:28:52 normalization > 09:25:40.894005 [debug] [MainThread]: Parsing macros/sql/pivot.sql 2022-06-21 09:28:52 normalization > 09:25:40.918275 [debug] [MainThread]: Parsing macros/sql/get_query_results_as_dict.sql 2022-06-21 09:28:52 normalization > 09:25:40.931677 [debug] [MainThread]: Parsing macros/sql/nullcheck.sql 2022-06-21 09:28:52 normalization > 09:25:40.941194 [debug] [MainThread]: Parsing macros/materializations/insert_by_period_materialization.sql 2022-06-21 09:28:52 normalization > 09:25:41.083151 [debug] [MainThread]: Parsing macros/cross_db_utils/current_timestamp.sql 2022-06-21 09:28:52 normalization > 09:25:41.102773 [debug] [MainThread]: Parsing macros/cross_db_utils/datediff.sql 2022-06-21 09:28:52 normalization > 09:25:41.163651 [debug] [MainThread]: Parsing macros/cross_db_utils/dateadd.sql 2022-06-21 09:28:52 normalization > 09:25:41.189091 [debug] [MainThread]: Parsing macros/cross_db_utils/datatypes.sql 2022-06-21 09:28:52 normalization > 09:25:41.230435 [debug] [MainThread]: Parsing macros/cross_db_utils/replace.sql 2022-06-21 09:28:52 normalization > 09:25:41.239245 [debug] [MainThread]: Parsing macros/cross_db_utils/position.sql 2022-06-21 09:28:52 normalization > 09:25:41.247672 [debug] [MainThread]: Parsing macros/cross_db_utils/_is_relation.sql 2022-06-21 09:28:52 normalization > 09:25:41.253680 [debug] [MainThread]: Parsing macros/cross_db_utils/hash.sql 2022-06-21 09:28:52 normalization > 09:25:41.261208 [debug] [MainThread]: Parsing macros/cross_db_utils/date_trunc.sql 2022-06-21 09:28:52 normalization > 09:25:41.269341 [debug] [MainThread]: Parsing macros/cross_db_utils/safe_cast.sql 2022-06-21 09:28:52 normalization > 09:25:41.279900 [debug] [MainThread]: Parsing macros/cross_db_utils/literal.sql 2022-06-21 09:28:52 normalization > 09:25:41.284921 [debug] [MainThread]: Parsing macros/cross_db_utils/right.sql 2022-06-21 09:28:52 normalization > 09:25:41.297049 [debug] [MainThread]: Parsing macros/cross_db_utils/width_bucket.sql 2022-06-21 09:28:52 normalization > 09:25:41.325997 [debug] [MainThread]: Parsing macros/cross_db_utils/escape_single_quotes.sql 2022-06-21 09:28:52 normalization > 09:25:41.336112 [debug] [MainThread]: Parsing macros/cross_db_utils/identifier.sql 2022-06-21 09:28:52 normalization > 09:25:41.346092 [debug] [MainThread]: Parsing macros/cross_db_utils/bool_or.sql 2022-06-21 09:28:52 normalization > 09:25:41.354894 [debug] [MainThread]: Parsing macros/cross_db_utils/split_part.sql 2022-06-21 09:28:52 normalization > 09:25:41.364640 [debug] [MainThread]: Parsing macros/cross_db_utils/length.sql 2022-06-21 09:28:52 normalization > 09:25:41.371343 [debug] [MainThread]: Parsing macros/cross_db_utils/concat.sql 2022-06-21 09:28:52 normalization > 09:25:41.376397 [debug] [MainThread]: Parsing macros/cross_db_utils/any_value.sql 2022-06-21 09:28:52 normalization > 09:25:41.383932 [debug] [MainThread]: Parsing macros/cross_db_utils/intersect.sql 2022-06-21 09:28:52 normalization > 09:25:41.389899 [debug] [MainThread]: Parsing macros/cross_db_utils/last_day.sql 2022-06-21 09:28:52 normalization > 09:25:41.416941 [debug] [MainThread]: Parsing macros/cross_db_utils/except.sql 2022-06-21 09:28:52 normalization > 09:25:41.424072 [debug] [MainThread]: Parsing macros/cross_db_utils/cast_bool_to_text.sql 2022-06-21 09:28:52 normalization > 09:25:41.431661 [debug] [MainThread]: Parsing macros/cross_db_utils/_is_ephemeral.sql 2022-06-21 09:28:52 normalization > 09:25:41.441993 [debug] [MainThread]: Parsing macros/jinja_helpers/log_info.sql 2022-06-21 09:28:52 normalization > 09:25:41.448290 [debug] [MainThread]: Parsing macros/jinja_helpers/slugify.sql 2022-06-21 09:28:52 normalization > 09:25:41.454846 [debug] [MainThread]: Parsing macros/jinja_helpers/pretty_log_format.sql 2022-06-21 09:28:52 normalization > 09:25:41.459973 [debug] [MainThread]: Parsing macros/jinja_helpers/pretty_time.sql 2022-06-21 09:28:52 normalization > 09:25:43.106586 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/hubspot_test_email/email_events_stg.sql 2022-06-21 09:28:52 normalization > 09:25:43.374392 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/hubspot_test_email/email_events_stg.sql 2022-06-21 09:28:52 normalization > 09:25:43.384027 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/hubspot_test_email/email_events_causedBy.sql 2022-06-21 09:28:52 normalization > 09:25:43.451650 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/hubspot_test_email/email_events_causedBy.sql 2022-06-21 09:28:52 normalization > 09:25:43.461297 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/hubspot_test_email/email_events.sql 2022-06-21 09:28:52 normalization > 09:25:43.648680 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/hubspot_test_email/email_events.sql 2022-06-21 09:28:52 normalization > 09:25:43.658451 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/hubspot_test_email/email_events_sentBy.sql 2022-06-21 09:28:52 normalization > 09:25:43.709803 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/hubspot_test_email/email_events_sentBy.sql 2022-06-21 09:28:52 normalization > 09:25:43.719454 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/hubspot_test_email/email_events_location.sql 2022-06-21 09:28:52 normalization > 09:25:43.771240 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/hubspot_test_email/email_events_location.sql 2022-06-21 09:28:52 normalization > 09:25:43.780808 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/hubspot_test_email/email_events_browser.sql 2022-06-21 09:28:52 normalization > 09:25:43.833666 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/hubspot_test_email/email_events_browser.sql 2022-06-21 09:28:52 normalization > 09:25:43.844022 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/hubspot_test_email/email_events_obsoletedBy.sql 2022-06-21 09:28:52 normalization > 09:25:43.895060 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/hubspot_test_email/email_events_obsoletedBy.sql 2022-06-21 09:28:52 normalization > 09:25:43.907151 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/hubspot_test_email/email_events_scd.sql 2022-06-21 09:28:52 normalization > 09:25:44.075244 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/hubspot_test_email/email_events_scd.sql 2022-06-21 09:28:52 normalization > 09:25:44.085123 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_obsoletedBy_ab1.sql 2022-06-21 09:28:52 normalization > 09:25:44.193865 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_obsoletedBy_ab1.sql 2022-06-21 09:28:52 normalization > 09:25:44.204806 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_location_ab2.sql 2022-06-21 09:28:52 normalization > 09:25:44.296730 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_location_ab2.sql 2022-06-21 09:28:52 normalization > 09:25:44.306319 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_sentBy_ab1.sql 2022-06-21 09:28:52 normalization > 09:25:44.368932 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_sentBy_ab1.sql 2022-06-21 09:28:52 normalization > 09:25:44.379868 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_location_ab3.sql 2022-06-21 09:28:52 normalization > 09:25:44.449456 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_location_ab3.sql 2022-06-21 09:28:52 normalization > 09:25:44.459734 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_location_ab1.sql 2022-06-21 09:28:52 normalization > 09:25:44.554517 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_location_ab1.sql 2022-06-21 09:28:52 normalization > 09:25:44.564431 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_browser_ab1.sql 2022-06-21 09:28:52 normalization > 09:25:44.681298 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_browser_ab1.sql 2022-06-21 09:28:52 normalization > 09:25:44.693261 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_ab2.sql 2022-06-21 09:28:52 normalization > 09:25:44.913688 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_ab2.sql 2022-06-21 09:28:52 normalization > 09:25:44.921060 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_obsoletedBy_ab2.sql 2022-06-21 09:28:52 normalization > 09:25:44.958259 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_obsoletedBy_ab2.sql 2022-06-21 09:28:52 normalization > 09:25:44.965539 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_sentBy_ab2.sql 2022-06-21 09:28:52 normalization > 09:25:45.005171 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_sentBy_ab2.sql 2022-06-21 09:28:52 normalization > 09:25:45.011412 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_obsoletedBy_ab3.sql 2022-06-21 09:28:52 normalization > 09:25:45.051201 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_obsoletedBy_ab3.sql 2022-06-21 09:28:52 normalization > 09:25:45.057409 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_causedBy_ab3.sql 2022-06-21 09:28:52 normalization > 09:25:45.097979 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_causedBy_ab3.sql 2022-06-21 09:28:52 normalization > 09:25:45.105712 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_ab1.sql 2022-06-21 09:28:52 normalization > 09:25:45.328192 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_ab1.sql 2022-06-21 09:28:52 normalization > 09:25:45.334523 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_browser_ab3.sql 2022-06-21 09:28:52 normalization > 09:25:45.383129 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_browser_ab3.sql 2022-06-21 09:28:52 normalization > 09:25:45.389401 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_causedBy_ab1.sql 2022-06-21 09:28:52 normalization > 09:25:45.429890 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_causedBy_ab1.sql 2022-06-21 09:28:52 normalization > 09:25:45.436129 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_sentBy_ab3.sql 2022-06-21 09:28:52 normalization > 09:25:45.476074 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_sentBy_ab3.sql 2022-06-21 09:28:52 normalization > 09:25:45.483401 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_browser_ab2.sql 2022-06-21 09:28:52 normalization > 09:25:45.528156 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_browser_ab2.sql 2022-06-21 09:28:52 normalization > 09:25:45.534657 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/hubspot_test_email/email_events_causedBy_ab2.sql 2022-06-21 09:28:52 normalization > 09:25:45.574534 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/hubspot_test_email/email_events_causedBy_ab2.sql 2022-06-21 09:28:52 normalization > 09:25:45.945924 [warn ] [MainThread]: [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. 2022-06-21 09:28:52 normalization > There are 1 unused configuration paths: 2022-06-21 09:28:52 normalization > - models.airbyte_utils.generated.airbyte_tables 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 09:25:46.039540 [info ] [MainThread]: Found 25 models, 0 tests, 0 snapshots, 0 analyses, 549 macros, 0 operations, 0 seed files, 1 source, 0 exposures, 0 metrics 2022-06-21 09:28:52 normalization > 09:25:46.049360 [info ] [MainThread]: 2022-06-21 09:28:52 normalization > 09:25:46.052099 [debug] [MainThread]: Acquiring new bigquery connection "master" 2022-06-21 09:28:52 normalization > 09:25:46.058249 [debug] [ThreadPool]: Acquiring new bigquery connection "list_analytics-platform-201110" 2022-06-21 09:28:52 normalization > 09:25:46.059033 [debug] [ThreadPool]: Opening a new connection, currently in state init 2022-06-21 09:28:52 normalization > 09:25:46.061815 [debug] [ThreadPool]: Acquiring new bigquery connection "list_analytics-platform-201110" 2022-06-21 09:28:52 normalization > 09:25:46.062839 [debug] [ThreadPool]: Opening a new connection, currently in state init 2022-06-21 09:28:52 normalization > 09:25:47.072380 [debug] [ThreadPool]: Acquiring new bigquery connection "create_analytics-platform-201110__airbyte_hubspot_test_email" 2022-06-21 09:28:52 normalization > 09:25:47.073906 [debug] [ThreadPool]: Acquiring new bigquery connection "create_analytics-platform-201110__airbyte_hubspot_test_email" 2022-06-21 09:28:52 normalization > 09:25:47.074306 [debug] [ThreadPool]: BigQuery adapter: Creating schema "analytics-platform-201110._airbyte_hubspot_test_email". 2022-06-21 09:28:52 normalization > 09:25:47.074641 [debug] [ThreadPool]: Opening a new connection, currently in state closed 2022-06-21 09:28:52 normalization > 09:25:47.655173 [debug] [ThreadPool]: Acquiring new bigquery connection "list_analytics-platform-201110_hubspot_test_email" 2022-06-21 09:28:52 normalization > 09:25:47.656701 [debug] [ThreadPool]: Acquiring new bigquery connection "list_analytics-platform-201110__airbyte_hubspot_test_email" 2022-06-21 09:28:52 normalization > 09:25:47.657474 [debug] [ThreadPool]: Opening a new connection, currently in state closed 2022-06-21 09:28:52 normalization > 09:25:47.657886 [debug] [ThreadPool]: Opening a new connection, currently in state closed 2022-06-21 09:28:52 normalization > 09:25:48.037177 [info ] [MainThread]: Concurrency: 8 threads (target='prod') 2022-06-21 09:28:52 normalization > 09:25:48.038316 [info ] [MainThread]: 2022-06-21 09:28:52 normalization > 09:25:48.102823 [debug] [Thread-1 ]: Began running node model.airbyte_utils.email_events_ab1 2022-06-21 09:28:52 normalization > 09:25:48.104755 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_ab1" 2022-06-21 09:28:52 normalization > 09:25:48.105296 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.email_events_ab1 2022-06-21 09:28:52 normalization > 09:25:48.105785 [debug] [Thread-1 ]: Compiling model.airbyte_utils.email_events_ab1 2022-06-21 09:28:52 normalization > 09:25:48.298533 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.email_events_ab1" 2022-06-21 09:28:52 normalization > 09:25:48.300057 [debug] [Thread-1 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:25:48.302018 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.email_events_ab1 2022-06-21 09:28:52 normalization > 09:25:48.303638 [debug] [Thread-3 ]: Began running node model.airbyte_utils.email_events_ab2 2022-06-21 09:28:52 normalization > 09:25:48.306227 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_ab2" 2022-06-21 09:28:52 normalization > 09:25:48.306768 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.email_events_ab2 2022-06-21 09:28:52 normalization > 09:25:48.307297 [debug] [Thread-3 ]: Compiling model.airbyte_utils.email_events_ab2 2022-06-21 09:28:52 normalization > 09:25:48.654149 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.email_events_ab2" 2022-06-21 09:28:52 normalization > 09:25:48.655678 [debug] [Thread-3 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:25:48.658030 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.email_events_ab2 2022-06-21 09:28:52 normalization > 09:25:48.659621 [debug] [Thread-5 ]: Began running node model.airbyte_utils.email_events_stg 2022-06-21 09:28:52 normalization > 09:25:48.660808 [info ] [Thread-5 ]: 1 of 8 START view model _airbyte_hubspot_test_email.email_events_stg.................................................... [RUN] 2022-06-21 09:28:52 normalization > 09:25:48.666121 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_stg" 2022-06-21 09:28:52 normalization > 09:25:48.666741 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.email_events_stg 2022-06-21 09:28:52 normalization > 09:25:48.667218 [debug] [Thread-5 ]: Compiling model.airbyte_utils.email_events_stg 2022-06-21 09:28:52 normalization > 09:25:49.244412 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.email_events_stg" 2022-06-21 09:28:52 normalization > 09:25:49.246265 [debug] [Thread-5 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:25:49.247132 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.email_events_stg 2022-06-21 09:28:52 normalization > 09:25:49.500738 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.email_events_stg" 2022-06-21 09:28:52 normalization > 09:25:49.503330 [debug] [Thread-5 ]: Opening a new connection, currently in state init 2022-06-21 09:28:52 normalization > 09:25:49.538429 [debug] [Thread-5 ]: On model.airbyte_utils.email_events_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.email_events_stg"} */ 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > create or replace view `analytics-platform-201110`._airbyte_hubspot_test_email.`email_events_stg` 2022-06-21 09:28:52 normalization > OPTIONS() 2022-06-21 09:28:52 normalization > as 2022-06-21 09:28:52 normalization > with __dbt__cte__email_events_ab1 as ( 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-06-21 09:28:52 normalization > -- depends_on: `analytics-platform-201110`.hubspot_test_email._airbyte_raw_email_events 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['id']") as id, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['url']") as url, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['from']") as `from`, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['hmid']") as hmid, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['type']") as type, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['appId']") as appId, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['linkId']") as linkId, 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > json_extract(table_alias._airbyte_data, "$['sentBy']") 2022-06-21 09:28:52 normalization > as sentBy, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['smtpId']") as smtpId, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['source']") as source, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['status']") as status, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['appName']") as appName, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['attempt']") as attempt, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['bounced']") as bounced, 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > json_extract(table_alias._airbyte_data, "$['browser']") 2022-06-21 09:28:52 normalization > as browser, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['created']") as created, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['referer']") as referer, 2022-06-21 09:28:52 normalization > json_extract_string_array(_airbyte_data, "$['replyTo']") as replyTo, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['subject']") as subject, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['category']") as category, 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > json_extract(table_alias._airbyte_data, "$['causedBy']") 2022-06-21 09:28:52 normalization > as causedBy, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['duration']") as duration, 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > json_extract(table_alias._airbyte_data, "$['location']") 2022-06-21 09:28:52 normalization > as location, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['portalId']") as portalId, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['response']") as response, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['sourceId']") as sourceId, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['ipAddress']") as ipAddress, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['recipient']") as recipient, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['userAgent']") as userAgent, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['deviceType']") as deviceType, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['dropReason']") as dropReason, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['dropMessage']") as dropMessage, 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > json_extract(table_alias._airbyte_data, "$['obsoletedBy']") 2022-06-21 09:28:52 normalization > as obsoletedBy, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['requestedBy']") as requestedBy, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['filteredEvent']") as filteredEvent, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['emailCampaignId']") as emailCampaignId, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['requestedByUserId']") as requestedByUserId, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['emailCampaignGroupId']") as emailCampaignGroupId, 2022-06-21 09:28:52 normalization > json_extract_scalar(_airbyte_data, "$['portalSubscriptionStatus']") as portalSubscriptionStatus, 2022-06-21 09:28:52 normalization > _airbyte_ab_id, 2022-06-21 09:28:52 normalization > _airbyte_emitted_at, 2022-06-21 09:28:52 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-06-21 09:28:52 normalization > from `analytics-platform-201110`.hubspot_test_email._airbyte_raw_email_events as table_alias 2022-06-21 09:28:52 normalization > -- email_events 2022-06-21 09:28:52 normalization > where 1 = 1 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > ), __dbt__cte__email_events_ab2 as ( 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-06-21 09:28:52 normalization > -- depends_on: __dbt__cte__email_events_ab1 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > cast(id as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as id, 2022-06-21 09:28:52 normalization > cast(url as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as url, 2022-06-21 09:28:52 normalization > cast(`from` as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as `from`, 2022-06-21 09:28:52 normalization > cast(hmid as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as hmid, 2022-06-21 09:28:52 normalization > cast(type as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as type, 2022-06-21 09:28:52 normalization > cast(appId as 2022-06-21 09:28:52 normalization > int64 2022-06-21 09:28:52 normalization > ) as appId, 2022-06-21 09:28:52 normalization > cast(linkId as 2022-06-21 09:28:52 normalization > int64 2022-06-21 09:28:52 normalization > ) as linkId, 2022-06-21 09:28:52 normalization > cast(sentBy as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as sentBy, 2022-06-21 09:28:52 normalization > cast(smtpId as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as smtpId, 2022-06-21 09:28:52 normalization > cast(source as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as source, 2022-06-21 09:28:52 normalization > cast(status as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as status, 2022-06-21 09:28:52 normalization > cast(appName as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as appName, 2022-06-21 09:28:52 normalization > cast(attempt as 2022-06-21 09:28:52 normalization > int64 2022-06-21 09:28:52 normalization > ) as attempt, 2022-06-21 09:28:52 normalization > cast(bounced as boolean) as bounced, 2022-06-21 09:28:52 normalization > cast(browser as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as browser, 2022-06-21 09:28:52 normalization > cast(created as 2022-06-21 09:28:52 normalization > int64 2022-06-21 09:28:52 normalization > ) as created, 2022-06-21 09:28:52 normalization > cast(referer as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as referer, 2022-06-21 09:28:52 normalization > replyTo, 2022-06-21 09:28:52 normalization > cast(subject as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as subject, 2022-06-21 09:28:52 normalization > cast(category as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as category, 2022-06-21 09:28:52 normalization > cast(causedBy as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as causedBy, 2022-06-21 09:28:52 normalization > cast(duration as 2022-06-21 09:28:52 normalization > int64 2022-06-21 09:28:52 normalization > ) as duration, 2022-06-21 09:28:52 normalization > cast(location as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as location, 2022-06-21 09:28:52 normalization > cast(portalId as 2022-06-21 09:28:52 normalization > int64 2022-06-21 09:28:52 normalization > ) as portalId, 2022-06-21 09:28:52 normalization > cast(response as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as response, 2022-06-21 09:28:52 normalization > cast(sourceId as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as sourceId, 2022-06-21 09:28:52 normalization > cast(ipAddress as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as ipAddress, 2022-06-21 09:28:52 normalization > cast(recipient as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as recipient, 2022-06-21 09:28:52 normalization > cast(userAgent as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as userAgent, 2022-06-21 09:28:52 normalization > cast(deviceType as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as deviceType, 2022-06-21 09:28:52 normalization > cast(dropReason as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as dropReason, 2022-06-21 09:28:52 normalization > cast(dropMessage as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as dropMessage, 2022-06-21 09:28:52 normalization > cast(obsoletedBy as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as obsoletedBy, 2022-06-21 09:28:52 normalization > cast(requestedBy as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as requestedBy, 2022-06-21 09:28:52 normalization > cast(filteredEvent as boolean) as filteredEvent, 2022-06-21 09:28:52 normalization > cast(emailCampaignId as 2022-06-21 09:28:52 normalization > int64 2022-06-21 09:28:52 normalization > ) as emailCampaignId, 2022-06-21 09:28:52 normalization > cast(requestedByUserId as 2022-06-21 09:28:52 normalization > int64 2022-06-21 09:28:52 normalization > ) as requestedByUserId, 2022-06-21 09:28:52 normalization > cast(emailCampaignGroupId as 2022-06-21 09:28:52 normalization > int64 2022-06-21 09:28:52 normalization > ) as emailCampaignGroupId, 2022-06-21 09:28:52 normalization > cast(portalSubscriptionStatus as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as portalSubscriptionStatus, 2022-06-21 09:28:52 normalization > _airbyte_ab_id, 2022-06-21 09:28:52 normalization > _airbyte_emitted_at, 2022-06-21 09:28:52 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-06-21 09:28:52 normalization > from __dbt__cte__email_events_ab1 2022-06-21 09:28:52 normalization > -- email_events 2022-06-21 09:28:52 normalization > where 1 = 1 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > )-- SQL model to build a hash column based on the values of this record 2022-06-21 09:28:52 normalization > -- depends_on: __dbt__cte__email_events_ab2 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(url as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(`from` as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(hmid as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(type as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(appId as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(linkId as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(sentBy as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(smtpId as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(source as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(status as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(appName as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(attempt as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(bounced as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(browser as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(created as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(referer as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(array_to_string(replyTo, "|", "") as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(subject as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(category as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(causedBy as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(duration as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(location as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(portalId as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(response as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(sourceId as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(ipAddress as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(recipient as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(userAgent as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(deviceType as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(dropReason as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(dropMessage as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(obsoletedBy as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(requestedBy as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(filteredEvent as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(emailCampaignId as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(requestedByUserId as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(emailCampaignGroupId as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(portalSubscriptionStatus as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), '')) as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ))) as _airbyte_email_events_hashid, 2022-06-21 09:28:52 normalization > tmp.* 2022-06-21 09:28:52 normalization > from __dbt__cte__email_events_ab2 tmp 2022-06-21 09:28:52 normalization > -- email_events 2022-06-21 09:28:52 normalization > where 1 = 1 2022-06-21 09:28:52 normalization > ; 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 09:25:50.596413 [debug] [Thread-5 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:25:50.598055 [info ] [Thread-5 ]: 1 of 8 OK created view model _airbyte_hubspot_test_email.email_events_stg............................................... [OK in 1.94s] 2022-06-21 09:28:52 normalization > 09:25:50.599095 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.email_events_stg 2022-06-21 09:28:52 normalization > 09:25:50.600415 [debug] [Thread-7 ]: Began running node model.airbyte_utils.email_events_scd 2022-06-21 09:28:52 normalization > 09:25:50.601186 [info ] [Thread-7 ]: 2 of 8 START incremental model hubspot_test_email.email_events_scd...................................................... [RUN] 2022-06-21 09:28:52 normalization > 09:25:50.603116 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_scd" 2022-06-21 09:28:52 normalization > 09:25:50.603525 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.email_events_scd 2022-06-21 09:28:52 normalization > 09:25:50.603818 [debug] [Thread-7 ]: Compiling model.airbyte_utils.email_events_scd 2022-06-21 09:28:52 normalization > 09:25:50.665571 [debug] [Thread-7 ]: Opening a new connection, currently in state init 2022-06-21 09:28:52 normalization > 09:25:51.583488 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.email_events_scd" 2022-06-21 09:28:52 normalization > 09:25:51.584404 [debug] [Thread-7 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:25:51.584742 [debug] [Thread-7 ]: Began executing node model.airbyte_utils.email_events_scd 2022-06-21 09:28:52 normalization > 09:25:51.847942 [debug] [Thread-7 ]: On model.airbyte_utils.email_events_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.email_events_scd"} */ 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > create or replace table `analytics-platform-201110`.hubspot_test_email.`email_events_scd__dbt_tmp` 2022-06-21 09:28:52 normalization > partition by range_bucket( 2022-06-21 09:28:52 normalization > _airbyte_active_row, 2022-06-21 09:28:52 normalization > generate_array(0, 1, 1) 2022-06-21 09:28:52 normalization > ) 2022-06-21 09:28:52 normalization > cluster by _airbyte_unique_key_scd, _airbyte_emitted_at 2022-06-21 09:28:52 normalization > OPTIONS( 2022-06-21 09:28:52 normalization > expiration_timestamp=TIMESTAMP_ADD(CURRENT_TIMESTAMP(), INTERVAL 12 hour) 2022-06-21 09:28:52 normalization > ) 2022-06-21 09:28:52 normalization > as ( 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > -- depends_on: ref('email_events_stg') 2022-06-21 09:28:52 normalization > with 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > new_data as ( 2022-06-21 09:28:52 normalization > -- retrieve incremental "new" data 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > * 2022-06-21 09:28:52 normalization > from `analytics-platform-201110`._airbyte_hubspot_test_email.`email_events_stg` 2022-06-21 09:28:52 normalization > -- email_events from `analytics-platform-201110`.hubspot_test_email._airbyte_raw_email_events 2022-06-21 09:28:52 normalization > where 1 = 1 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > and coalesce( 2022-06-21 09:28:52 normalization > cast(_airbyte_emitted_at as 2022-06-21 09:28:52 normalization > timestamp 2022-06-21 09:28:52 normalization > ) >= (select max(cast(_airbyte_emitted_at as 2022-06-21 09:28:52 normalization > timestamp 2022-06-21 09:28:52 normalization > )) from `analytics-platform-201110`.hubspot_test_email.`email_events_scd`), 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > true) 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > ), 2022-06-21 09:28:52 normalization > new_data_ids as ( 2022-06-21 09:28:52 normalization > -- build a subset of _airbyte_unique_key from rows that are new 2022-06-21 09:28:52 normalization > select distinct 2022-06-21 09:28:52 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), '')) as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ))) as _airbyte_unique_key 2022-06-21 09:28:52 normalization > from new_data 2022-06-21 09:28:52 normalization > ), 2022-06-21 09:28:52 normalization > empty_new_data as ( 2022-06-21 09:28:52 normalization > -- build an empty table to only keep the table's column types 2022-06-21 09:28:52 normalization > select * from new_data where 1 = 0 2022-06-21 09:28:52 normalization > ), 2022-06-21 09:28:52 normalization > previous_active_scd_data as ( 2022-06-21 09:28:52 normalization > -- retrieve "incomplete old" data that needs to be updated with an end date because of new changes 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > this_data.`_airbyte_email_events_hashid`, 2022-06-21 09:28:52 normalization > this_data.`id`, 2022-06-21 09:28:52 normalization > this_data.`url`, 2022-06-21 09:28:52 normalization > this_data.`from`, 2022-06-21 09:28:52 normalization > this_data.`hmid`, 2022-06-21 09:28:52 normalization > this_data.`type`, 2022-06-21 09:28:52 normalization > this_data.`appId`, 2022-06-21 09:28:52 normalization > this_data.`linkId`, 2022-06-21 09:28:52 normalization > this_data.`sentBy`, 2022-06-21 09:28:52 normalization > this_data.`smtpId`, 2022-06-21 09:28:52 normalization > this_data.`source`, 2022-06-21 09:28:52 normalization > this_data.`status`, 2022-06-21 09:28:52 normalization > this_data.`appName`, 2022-06-21 09:28:52 normalization > this_data.`attempt`, 2022-06-21 09:28:52 normalization > this_data.`bounced`, 2022-06-21 09:28:52 normalization > this_data.`browser`, 2022-06-21 09:28:52 normalization > this_data.`created`, 2022-06-21 09:28:52 normalization > this_data.`referer`, 2022-06-21 09:28:52 normalization > this_data.`replyTo`, 2022-06-21 09:28:52 normalization > this_data.`subject`, 2022-06-21 09:28:52 normalization > this_data.`category`, 2022-06-21 09:28:52 normalization > this_data.`causedBy`, 2022-06-21 09:28:52 normalization > this_data.`duration`, 2022-06-21 09:28:52 normalization > this_data.`location`, 2022-06-21 09:28:52 normalization > this_data.`portalId`, 2022-06-21 09:28:52 normalization > this_data.`response`, 2022-06-21 09:28:52 normalization > this_data.`sourceId`, 2022-06-21 09:28:52 normalization > this_data.`ipAddress`, 2022-06-21 09:28:52 normalization > this_data.`recipient`, 2022-06-21 09:28:52 normalization > this_data.`userAgent`, 2022-06-21 09:28:52 normalization > this_data.`deviceType`, 2022-06-21 09:28:52 normalization > this_data.`dropReason`, 2022-06-21 09:28:52 normalization > this_data.`dropMessage`, 2022-06-21 09:28:52 normalization > this_data.`obsoletedBy`, 2022-06-21 09:28:52 normalization > this_data.`requestedBy`, 2022-06-21 09:28:52 normalization > this_data.`filteredEvent`, 2022-06-21 09:28:52 normalization > this_data.`emailCampaignId`, 2022-06-21 09:28:52 normalization > this_data.`requestedByUserId`, 2022-06-21 09:28:52 normalization > this_data.`emailCampaignGroupId`, 2022-06-21 09:28:52 normalization > this_data.`portalSubscriptionStatus`, 2022-06-21 09:28:52 normalization > this_data.`_airbyte_ab_id`, 2022-06-21 09:28:52 normalization > this_data.`_airbyte_emitted_at`, 2022-06-21 09:28:52 normalization > this_data.`_airbyte_normalized_at` 2022-06-21 09:28:52 normalization > from `analytics-platform-201110`.hubspot_test_email.`email_events_scd` as this_data 2022-06-21 09:28:52 normalization > -- make a join with new_data using primary key to filter active data that need to be updated only 2022-06-21 09:28:52 normalization > join new_data_ids on this_data._airbyte_unique_key = new_data_ids._airbyte_unique_key 2022-06-21 09:28:52 normalization > -- force left join to NULL values (we just need to transfer column types only for the star_intersect macro on schema changes) 2022-06-21 09:28:52 normalization > left join empty_new_data as inc_data on this_data._airbyte_ab_id = inc_data._airbyte_ab_id 2022-06-21 09:28:52 normalization > where _airbyte_active_row = 1 2022-06-21 09:28:52 normalization > ), 2022-06-21 09:28:52 normalization > input_data as ( 2022-06-21 09:28:52 normalization > select `_airbyte_email_events_hashid`, 2022-06-21 09:28:52 normalization > `id`, 2022-06-21 09:28:52 normalization > `url`, 2022-06-21 09:28:52 normalization > `from`, 2022-06-21 09:28:52 normalization > `hmid`, 2022-06-21 09:28:52 normalization > `type`, 2022-06-21 09:28:52 normalization > `appId`, 2022-06-21 09:28:52 normalization > `linkId`, 2022-06-21 09:28:52 normalization > `sentBy`, 2022-06-21 09:28:52 normalization > `smtpId`, 2022-06-21 09:28:52 normalization > `source`, 2022-06-21 09:28:52 normalization > `status`, 2022-06-21 09:28:52 normalization > `appName`, 2022-06-21 09:28:52 normalization > `attempt`, 2022-06-21 09:28:52 normalization > `bounced`, 2022-06-21 09:28:52 normalization > `browser`, 2022-06-21 09:28:52 normalization > `created`, 2022-06-21 09:28:52 normalization > `referer`, 2022-06-21 09:28:52 normalization > `replyTo`, 2022-06-21 09:28:52 normalization > `subject`, 2022-06-21 09:28:52 normalization > `category`, 2022-06-21 09:28:52 normalization > `causedBy`, 2022-06-21 09:28:52 normalization > `duration`, 2022-06-21 09:28:52 normalization > `location`, 2022-06-21 09:28:52 normalization > `portalId`, 2022-06-21 09:28:52 normalization > `response`, 2022-06-21 09:28:52 normalization > `sourceId`, 2022-06-21 09:28:52 normalization > `ipAddress`, 2022-06-21 09:28:52 normalization > `recipient`, 2022-06-21 09:28:52 normalization > `userAgent`, 2022-06-21 09:28:52 normalization > `deviceType`, 2022-06-21 09:28:52 normalization > `dropReason`, 2022-06-21 09:28:52 normalization > `dropMessage`, 2022-06-21 09:28:52 normalization > `obsoletedBy`, 2022-06-21 09:28:52 normalization > `requestedBy`, 2022-06-21 09:28:52 normalization > `filteredEvent`, 2022-06-21 09:28:52 normalization > `emailCampaignId`, 2022-06-21 09:28:52 normalization > `requestedByUserId`, 2022-06-21 09:28:52 normalization > `emailCampaignGroupId`, 2022-06-21 09:28:52 normalization > `portalSubscriptionStatus`, 2022-06-21 09:28:52 normalization > `_airbyte_ab_id`, 2022-06-21 09:28:52 normalization > `_airbyte_emitted_at`, 2022-06-21 09:28:52 normalization > `_airbyte_normalized_at` from new_data 2022-06-21 09:28:52 normalization > union all 2022-06-21 09:28:52 normalization > select `_airbyte_email_events_hashid`, 2022-06-21 09:28:52 normalization > `id`, 2022-06-21 09:28:52 normalization > `url`, 2022-06-21 09:28:52 normalization > `from`, 2022-06-21 09:28:52 normalization > `hmid`, 2022-06-21 09:28:52 normalization > `type`, 2022-06-21 09:28:52 normalization > `appId`, 2022-06-21 09:28:52 normalization > `linkId`, 2022-06-21 09:28:52 normalization > `sentBy`, 2022-06-21 09:28:52 normalization > `smtpId`, 2022-06-21 09:28:52 normalization > `source`, 2022-06-21 09:28:52 normalization > `status`, 2022-06-21 09:28:52 normalization > `appName`, 2022-06-21 09:28:52 normalization > `attempt`, 2022-06-21 09:28:52 normalization > `bounced`, 2022-06-21 09:28:52 normalization > `browser`, 2022-06-21 09:28:52 normalization > `created`, 2022-06-21 09:28:52 normalization > `referer`, 2022-06-21 09:28:52 normalization > `replyTo`, 2022-06-21 09:28:52 normalization > `subject`, 2022-06-21 09:28:52 normalization > `category`, 2022-06-21 09:28:52 normalization > `causedBy`, 2022-06-21 09:28:52 normalization > `duration`, 2022-06-21 09:28:52 normalization > `location`, 2022-06-21 09:28:52 normalization > `portalId`, 2022-06-21 09:28:52 normalization > `response`, 2022-06-21 09:28:52 normalization > `sourceId`, 2022-06-21 09:28:52 normalization > `ipAddress`, 2022-06-21 09:28:52 normalization > `recipient`, 2022-06-21 09:28:52 normalization > `userAgent`, 2022-06-21 09:28:52 normalization > `deviceType`, 2022-06-21 09:28:52 normalization > `dropReason`, 2022-06-21 09:28:52 normalization > `dropMessage`, 2022-06-21 09:28:52 normalization > `obsoletedBy`, 2022-06-21 09:28:52 normalization > `requestedBy`, 2022-06-21 09:28:52 normalization > `filteredEvent`, 2022-06-21 09:28:52 normalization > `emailCampaignId`, 2022-06-21 09:28:52 normalization > `requestedByUserId`, 2022-06-21 09:28:52 normalization > `emailCampaignGroupId`, 2022-06-21 09:28:52 normalization > `portalSubscriptionStatus`, 2022-06-21 09:28:52 normalization > `_airbyte_ab_id`, 2022-06-21 09:28:52 normalization > `_airbyte_emitted_at`, 2022-06-21 09:28:52 normalization > `_airbyte_normalized_at` from previous_active_scd_data 2022-06-21 09:28:52 normalization > ), 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > scd_data as ( 2022-06-21 09:28:52 normalization > -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > to_hex(md5(cast(concat(coalesce(cast(id as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), '')) as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ))) as _airbyte_unique_key, 2022-06-21 09:28:52 normalization > id, 2022-06-21 09:28:52 normalization > url, 2022-06-21 09:28:52 normalization > `from`, 2022-06-21 09:28:52 normalization > hmid, 2022-06-21 09:28:52 normalization > type, 2022-06-21 09:28:52 normalization > appId, 2022-06-21 09:28:52 normalization > linkId, 2022-06-21 09:28:52 normalization > sentBy, 2022-06-21 09:28:52 normalization > smtpId, 2022-06-21 09:28:52 normalization > source, 2022-06-21 09:28:52 normalization > status, 2022-06-21 09:28:52 normalization > appName, 2022-06-21 09:28:52 normalization > attempt, 2022-06-21 09:28:52 normalization > bounced, 2022-06-21 09:28:52 normalization > browser, 2022-06-21 09:28:52 normalization > created, 2022-06-21 09:28:52 normalization > referer, 2022-06-21 09:28:52 normalization > replyTo, 2022-06-21 09:28:52 normalization > subject, 2022-06-21 09:28:52 normalization > category, 2022-06-21 09:28:52 normalization > causedBy, 2022-06-21 09:28:52 normalization > duration, 2022-06-21 09:28:52 normalization > location, 2022-06-21 09:28:52 normalization > portalId, 2022-06-21 09:28:52 normalization > response, 2022-06-21 09:28:52 normalization > sourceId, 2022-06-21 09:28:52 normalization > ipAddress, 2022-06-21 09:28:52 normalization > recipient, 2022-06-21 09:28:52 normalization > userAgent, 2022-06-21 09:28:52 normalization > deviceType, 2022-06-21 09:28:52 normalization > dropReason, 2022-06-21 09:28:52 normalization > dropMessage, 2022-06-21 09:28:52 normalization > obsoletedBy, 2022-06-21 09:28:52 normalization > requestedBy, 2022-06-21 09:28:52 normalization > filteredEvent, 2022-06-21 09:28:52 normalization > emailCampaignId, 2022-06-21 09:28:52 normalization > requestedByUserId, 2022-06-21 09:28:52 normalization > emailCampaignGroupId, 2022-06-21 09:28:52 normalization > portalSubscriptionStatus, 2022-06-21 09:28:52 normalization > created as _airbyte_start_at, 2022-06-21 09:28:52 normalization > lag(created) over ( 2022-06-21 09:28:52 normalization > partition by id 2022-06-21 09:28:52 normalization > order by 2022-06-21 09:28:52 normalization > created is null asc, 2022-06-21 09:28:52 normalization > created desc, 2022-06-21 09:28:52 normalization > _airbyte_emitted_at desc 2022-06-21 09:28:52 normalization > ) as _airbyte_end_at, 2022-06-21 09:28:52 normalization > case when row_number() over ( 2022-06-21 09:28:52 normalization > partition by id 2022-06-21 09:28:52 normalization > order by 2022-06-21 09:28:52 normalization > created is null asc, 2022-06-21 09:28:52 normalization > created desc, 2022-06-21 09:28:52 normalization > _airbyte_emitted_at desc 2022-06-21 09:28:52 normalization > ) = 1 then 1 else 0 end as _airbyte_active_row, 2022-06-21 09:28:52 normalization > _airbyte_ab_id, 2022-06-21 09:28:52 normalization > _airbyte_emitted_at, 2022-06-21 09:28:52 normalization > _airbyte_email_events_hashid 2022-06-21 09:28:52 normalization > from input_data 2022-06-21 09:28:52 normalization > ), 2022-06-21 09:28:52 normalization > dedup_data as ( 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > -- we need to ensure de-duplicated rows for merge/update queries 2022-06-21 09:28:52 normalization > -- additionally, we generate a unique key for the scd table 2022-06-21 09:28:52 normalization > row_number() over ( 2022-06-21 09:28:52 normalization > partition by 2022-06-21 09:28:52 normalization > _airbyte_unique_key, 2022-06-21 09:28:52 normalization > _airbyte_start_at, 2022-06-21 09:28:52 normalization > _airbyte_emitted_at 2022-06-21 09:28:52 normalization > order by _airbyte_active_row desc, _airbyte_ab_id 2022-06-21 09:28:52 normalization > ) as _airbyte_row_num, 2022-06-21 09:28:52 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), '')) as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ))) as _airbyte_unique_key_scd, 2022-06-21 09:28:52 normalization > scd_data.* 2022-06-21 09:28:52 normalization > from scd_data 2022-06-21 09:28:52 normalization > ) 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > _airbyte_unique_key, 2022-06-21 09:28:52 normalization > _airbyte_unique_key_scd, 2022-06-21 09:28:52 normalization > id, 2022-06-21 09:28:52 normalization > url, 2022-06-21 09:28:52 normalization > `from`, 2022-06-21 09:28:52 normalization > hmid, 2022-06-21 09:28:52 normalization > type, 2022-06-21 09:28:52 normalization > appId, 2022-06-21 09:28:52 normalization > linkId, 2022-06-21 09:28:52 normalization > sentBy, 2022-06-21 09:28:52 normalization > smtpId, 2022-06-21 09:28:52 normalization > source, 2022-06-21 09:28:52 normalization > status, 2022-06-21 09:28:52 normalization > appName, 2022-06-21 09:28:52 normalization > attempt, 2022-06-21 09:28:52 normalization > bounced, 2022-06-21 09:28:52 normalization > browser, 2022-06-21 09:28:52 normalization > created, 2022-06-21 09:28:52 normalization > referer, 2022-06-21 09:28:52 normalization > replyTo, 2022-06-21 09:28:52 normalization > subject, 2022-06-21 09:28:52 normalization > category, 2022-06-21 09:28:52 normalization > causedBy, 2022-06-21 09:28:52 normalization > duration, 2022-06-21 09:28:52 normalization > location, 2022-06-21 09:28:52 normalization > portalId, 2022-06-21 09:28:52 normalization > response, 2022-06-21 09:28:52 normalization > sourceId, 2022-06-21 09:28:52 normalization > ipAddress, 2022-06-21 09:28:52 normalization > recipient, 2022-06-21 09:28:52 normalization > userAgent, 2022-06-21 09:28:52 normalization > deviceType, 2022-06-21 09:28:52 normalization > dropReason, 2022-06-21 09:28:52 normalization > dropMessage, 2022-06-21 09:28:52 normalization > obsoletedBy, 2022-06-21 09:28:52 normalization > requestedBy, 2022-06-21 09:28:52 normalization > filteredEvent, 2022-06-21 09:28:52 normalization > emailCampaignId, 2022-06-21 09:28:52 normalization > requestedByUserId, 2022-06-21 09:28:52 normalization > emailCampaignGroupId, 2022-06-21 09:28:52 normalization > portalSubscriptionStatus, 2022-06-21 09:28:52 normalization > _airbyte_start_at, 2022-06-21 09:28:52 normalization > _airbyte_end_at, 2022-06-21 09:28:52 normalization > _airbyte_active_row, 2022-06-21 09:28:52 normalization > _airbyte_ab_id, 2022-06-21 09:28:52 normalization > _airbyte_emitted_at, 2022-06-21 09:28:52 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-06-21 09:28:52 normalization > _airbyte_email_events_hashid 2022-06-21 09:28:52 normalization > from dedup_data where _airbyte_row_num = 1 2022-06-21 09:28:52 normalization > ); 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 09:27:36.917573 [debug] [Thread-7 ]: 2022-06-21 09:28:52 normalization > In `analytics-platform-201110`.`hubspot_test_email`.`email_events_scd`: 2022-06-21 09:28:52 normalization > Schema changed: False 2022-06-21 09:28:52 normalization > Source columns not in target: [] 2022-06-21 09:28:52 normalization > Target columns not in source: [] 2022-06-21 09:28:52 normalization > New column types: [] 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 09:27:36.971615 [debug] [Thread-7 ]: Writing runtime SQL for node "model.airbyte_utils.email_events_scd" 2022-06-21 09:28:52 normalization > 09:27:36.972606 [debug] [Thread-7 ]: On model.airbyte_utils.email_events_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.email_events_scd"} */ 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > merge into `analytics-platform-201110`.hubspot_test_email.`email_events_scd` as DBT_INTERNAL_DEST 2022-06-21 09:28:52 normalization > using ( 2022-06-21 09:28:52 normalization > select * from `analytics-platform-201110`.hubspot_test_email.`email_events_scd__dbt_tmp` 2022-06-21 09:28:52 normalization > ) as DBT_INTERNAL_SOURCE 2022-06-21 09:28:52 normalization > on 2022-06-21 09:28:52 normalization > DBT_INTERNAL_SOURCE._airbyte_unique_key_scd = DBT_INTERNAL_DEST._airbyte_unique_key_scd 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > when matched then update set 2022-06-21 09:28:52 normalization > `_airbyte_unique_key` = DBT_INTERNAL_SOURCE.`_airbyte_unique_key`,`_airbyte_unique_key_scd` = DBT_INTERNAL_SOURCE.`_airbyte_unique_key_scd`,`id` = DBT_INTERNAL_SOURCE.`id`,`url` = DBT_INTERNAL_SOURCE.`url`,`from` = DBT_INTERNAL_SOURCE.`from`,`hmid` = DBT_INTERNAL_SOURCE.`hmid`,`type` = DBT_INTERNAL_SOURCE.`type`,`appId` = DBT_INTERNAL_SOURCE.`appId`,`linkId` = DBT_INTERNAL_SOURCE.`linkId`,`sentBy` = DBT_INTERNAL_SOURCE.`sentBy`,`smtpId` = DBT_INTERNAL_SOURCE.`smtpId`,`source` = DBT_INTERNAL_SOURCE.`source`,`status` = DBT_INTERNAL_SOURCE.`status`,`appName` = DBT_INTERNAL_SOURCE.`appName`,`attempt` = DBT_INTERNAL_SOURCE.`attempt`,`bounced` = DBT_INTERNAL_SOURCE.`bounced`,`browser` = DBT_INTERNAL_SOURCE.`browser`,`created` = DBT_INTERNAL_SOURCE.`created`,`referer` = DBT_INTERNAL_SOURCE.`referer`,`replyTo` = DBT_INTERNAL_SOURCE.`replyTo`,`subject` = DBT_INTERNAL_SOURCE.`subject`,`category` = DBT_INTERNAL_SOURCE.`category`,`causedBy` = DBT_INTERNAL_SOURCE.`causedBy`,`duration` = DBT_INTERNAL_SOURCE.`duration`,`location` = DBT_INTERNAL_SOURCE.`location`,`portalId` = DBT_INTERNAL_SOURCE.`portalId`,`response` = DBT_INTERNAL_SOURCE.`response`,`sourceId` = DBT_INTERNAL_SOURCE.`sourceId`,`ipAddress` = DBT_INTERNAL_SOURCE.`ipAddress`,`recipient` = DBT_INTERNAL_SOURCE.`recipient`,`userAgent` = DBT_INTERNAL_SOURCE.`userAgent`,`deviceType` = DBT_INTERNAL_SOURCE.`deviceType`,`dropReason` = DBT_INTERNAL_SOURCE.`dropReason`,`dropMessage` = DBT_INTERNAL_SOURCE.`dropMessage`,`obsoletedBy` = DBT_INTERNAL_SOURCE.`obsoletedBy`,`requestedBy` = DBT_INTERNAL_SOURCE.`requestedBy`,`filteredEvent` = DBT_INTERNAL_SOURCE.`filteredEvent`,`emailCampaignId` = DBT_INTERNAL_SOURCE.`emailCampaignId`,`requestedByUserId` = DBT_INTERNAL_SOURCE.`requestedByUserId`,`emailCampaignGroupId` = DBT_INTERNAL_SOURCE.`emailCampaignGroupId`,`portalSubscriptionStatus` = DBT_INTERNAL_SOURCE.`portalSubscriptionStatus`,`_airbyte_start_at` = DBT_INTERNAL_SOURCE.`_airbyte_start_at`,`_airbyte_end_at` = DBT_INTERNAL_SOURCE.`_airbyte_end_at`,`_airbyte_active_row` = DBT_INTERNAL_SOURCE.`_airbyte_active_row`,`_airbyte_ab_id` = DBT_INTERNAL_SOURCE.`_airbyte_ab_id`,`_airbyte_emitted_at` = DBT_INTERNAL_SOURCE.`_airbyte_emitted_at`,`_airbyte_normalized_at` = DBT_INTERNAL_SOURCE.`_airbyte_normalized_at`,`_airbyte_email_events_hashid` = DBT_INTERNAL_SOURCE.`_airbyte_email_events_hashid` 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > when not matched then insert 2022-06-21 09:28:52 normalization > (`_airbyte_unique_key`, `_airbyte_unique_key_scd`, `id`, `url`, `from`, `hmid`, `type`, `appId`, `linkId`, `sentBy`, `smtpId`, `source`, `status`, `appName`, `attempt`, `bounced`, `browser`, `created`, `referer`, `replyTo`, `subject`, `category`, `causedBy`, `duration`, `location`, `portalId`, `response`, `sourceId`, `ipAddress`, `recipient`, `userAgent`, `deviceType`, `dropReason`, `dropMessage`, `obsoletedBy`, `requestedBy`, `filteredEvent`, `emailCampaignId`, `requestedByUserId`, `emailCampaignGroupId`, `portalSubscriptionStatus`, `_airbyte_start_at`, `_airbyte_end_at`, `_airbyte_active_row`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_email_events_hashid`) 2022-06-21 09:28:52 normalization > values 2022-06-21 09:28:52 normalization > (`_airbyte_unique_key`, `_airbyte_unique_key_scd`, `id`, `url`, `from`, `hmid`, `type`, `appId`, `linkId`, `sentBy`, `smtpId`, `source`, `status`, `appName`, `attempt`, `bounced`, `browser`, `created`, `referer`, `replyTo`, `subject`, `category`, `causedBy`, `duration`, `location`, `portalId`, `response`, `sourceId`, `ipAddress`, `recipient`, `userAgent`, `deviceType`, `dropReason`, `dropMessage`, `obsoletedBy`, `requestedBy`, `filteredEvent`, `emailCampaignId`, `requestedByUserId`, `emailCampaignGroupId`, `portalSubscriptionStatus`, `_airbyte_start_at`, `_airbyte_end_at`, `_airbyte_active_row`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_email_events_hashid`) 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 09:28:03.420171 [debug] [Thread-7 ]: On model.airbyte_utils.email_events_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.email_events_scd"} */ 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > -- Delete records which are no longer active: 2022-06-21 09:28:52 normalization > -- This query is equivalent, but the left join version is more performant: 2022-06-21 09:28:52 normalization > -- delete from final_table where unique_key in ( 2022-06-21 09:28:52 normalization > -- select unique_key from scd_table where 1 = 1 2022-06-21 09:28:52 normalization > -- ) and unique_key not in ( 2022-06-21 09:28:52 normalization > -- select unique_key from scd_table where active_row = 1 2022-06-21 09:28:52 normalization > -- ) 2022-06-21 09:28:52 normalization > -- We're incremental against normalized_at rather than emitted_at because we need to fetch the SCD 2022-06-21 09:28:52 normalization > -- entries that were _updated_ recently. This is because a deleted record will have an SCD record 2022-06-21 09:28:52 normalization > -- which was emitted a long time ago, but recently re-normalized to have active_row = 0. 2022-06-21 09:28:52 normalization > delete from `analytics-platform-201110`.`hubspot_test_email`.`email_events` final_table where final_table._airbyte_unique_key in ( 2022-06-21 09:28:52 normalization > select recent_records.unique_key 2022-06-21 09:28:52 normalization > from ( 2022-06-21 09:28:52 normalization > select distinct _airbyte_unique_key as unique_key 2022-06-21 09:28:52 normalization > from `analytics-platform-201110`.hubspot_test_email.`email_events_scd` 2022-06-21 09:28:52 normalization > where 1=1 2022-06-21 09:28:52 normalization > and coalesce( 2022-06-21 09:28:52 normalization > cast(_airbyte_normalized_at as 2022-06-21 09:28:52 normalization > timestamp 2022-06-21 09:28:52 normalization > ) >= (select max(cast(_airbyte_normalized_at as 2022-06-21 09:28:52 normalization > timestamp 2022-06-21 09:28:52 normalization > )) from hubspot_test_email.`email_events`), 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > true) 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > ) recent_records 2022-06-21 09:28:52 normalization > left join ( 2022-06-21 09:28:52 normalization > select _airbyte_unique_key as unique_key, count(_airbyte_unique_key) as active_count 2022-06-21 09:28:52 normalization > from `analytics-platform-201110`.hubspot_test_email.`email_events_scd` 2022-06-21 09:28:52 normalization > where _airbyte_active_row = 1 2022-06-21 09:28:52 normalization > and coalesce( 2022-06-21 09:28:52 normalization > cast(_airbyte_normalized_at as 2022-06-21 09:28:52 normalization > timestamp 2022-06-21 09:28:52 normalization > ) >= (select max(cast(_airbyte_normalized_at as 2022-06-21 09:28:52 normalization > timestamp 2022-06-21 09:28:52 normalization > )) from hubspot_test_email.`email_events`), 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > true) 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > group by _airbyte_unique_key 2022-06-21 09:28:52 normalization > ) active_counts 2022-06-21 09:28:52 normalization > on recent_records.unique_key = active_counts.unique_key 2022-06-21 09:28:52 normalization > where active_count is null or active_count = 0 2022-06-21 09:28:52 normalization > ) 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 09:28:07.594235 [debug] [Thread-7 ]: On model.airbyte_utils.email_events_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.email_events_scd"} */ 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > drop view _airbyte_hubspot_test_email.email_events_stg 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 09:28:08.364819 [debug] [Thread-7 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:08.367293 [info ] [Thread-7 ]: 2 of 8 OK created incremental model hubspot_test_email.email_events_scd................................................. [MERGE (757.8k rows, 590.7 MB processed) in 137.77s] 2022-06-21 09:28:52 normalization > 09:28:08.368806 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.email_events_scd 2022-06-21 09:28:52 normalization > 09:28:08.371727 [debug] [Thread-2 ]: Began running node model.airbyte_utils.email_events 2022-06-21 09:28:52 normalization > 09:28:08.373526 [debug] [Thread-1 ]: Began running node model.airbyte_utils.email_events_browser_ab1 2022-06-21 09:28:52 normalization > 09:28:08.374124 [debug] [Thread-4 ]: Began running node model.airbyte_utils.email_events_causedBy_ab1 2022-06-21 09:28:52 normalization > 09:28:08.374786 [debug] [Thread-3 ]: Began running node model.airbyte_utils.email_events_location_ab1 2022-06-21 09:28:52 normalization > 09:28:08.375968 [info ] [Thread-2 ]: 3 of 8 START incremental model hubspot_test_email.email_events.......................................................... [RUN] 2022-06-21 09:28:52 normalization > 09:28:08.376646 [debug] [Thread-6 ]: Began running node model.airbyte_utils.email_events_obsoletedBy_ab1 2022-06-21 09:28:52 normalization > 09:28:08.388884 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_obsoletedBy_ab1" 2022-06-21 09:28:52 normalization > 09:28:08.383010 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_causedBy_ab1" 2022-06-21 09:28:52 normalization > 09:28:08.392071 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.email_events_causedBy_ab1 2022-06-21 09:28:52 normalization > 09:28:08.385513 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_location_ab1" 2022-06-21 09:28:52 normalization > 09:28:08.378808 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_browser_ab1" 2022-06-21 09:28:52 normalization > 09:28:08.393736 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.email_events_browser_ab1 2022-06-21 09:28:52 normalization > 09:28:08.391492 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.email_events_obsoletedBy_ab1 2022-06-21 09:28:52 normalization > 09:28:08.392627 [debug] [Thread-4 ]: Compiling model.airbyte_utils.email_events_causedBy_ab1 2022-06-21 09:28:52 normalization > 09:28:08.383590 [debug] [Thread-5 ]: Began running node model.airbyte_utils.email_events_sentBy_ab1 2022-06-21 09:28:52 normalization > 09:28:08.393187 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.email_events_location_ab1 2022-06-21 09:28:52 normalization > 09:28:08.394327 [debug] [Thread-1 ]: Compiling model.airbyte_utils.email_events_browser_ab1 2022-06-21 09:28:52 normalization > 09:28:08.390805 [debug] [Thread-2 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events" 2022-06-21 09:28:52 normalization > 09:28:08.394890 [debug] [Thread-6 ]: Compiling model.airbyte_utils.email_events_obsoletedBy_ab1 2022-06-21 09:28:52 normalization > 09:28:08.418421 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_sentBy_ab1" 2022-06-21 09:28:52 normalization > 09:28:08.435116 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.email_events_causedBy_ab1" 2022-06-21 09:28:52 normalization > 09:28:08.435872 [debug] [Thread-3 ]: Compiling model.airbyte_utils.email_events_location_ab1 2022-06-21 09:28:52 normalization > 09:28:08.457276 [debug] [Thread-2 ]: Began compiling node model.airbyte_utils.email_events 2022-06-21 09:28:52 normalization > 09:28:08.491640 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.email_events_browser_ab1" 2022-06-21 09:28:52 normalization > 09:28:08.517777 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.email_events_sentBy_ab1 2022-06-21 09:28:52 normalization > 09:28:08.568103 [debug] [Thread-5 ]: Compiling model.airbyte_utils.email_events_sentBy_ab1 2022-06-21 09:28:52 normalization > 09:28:08.545702 [debug] [Thread-2 ]: Compiling model.airbyte_utils.email_events 2022-06-21 09:28:52 normalization > 09:28:08.551476 [debug] [Thread-4 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:08.567375 [debug] [Thread-1 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:08.533996 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.email_events_obsoletedBy_ab1" 2022-06-21 09:28:52 normalization > 09:28:08.613817 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.email_events_causedBy_ab1 2022-06-21 09:28:52 normalization > 09:28:08.627068 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.email_events_location_ab1" 2022-06-21 09:28:52 normalization > 09:28:08.641770 [debug] [Thread-2 ]: Opening a new connection, currently in state closed 2022-06-21 09:28:52 normalization > 09:28:08.646935 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.email_events_browser_ab1 2022-06-21 09:28:52 normalization > 09:28:08.657476 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.email_events_sentBy_ab1" 2022-06-21 09:28:52 normalization > 09:28:08.658995 [debug] [Thread-6 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:08.659475 [debug] [Thread-7 ]: Began running node model.airbyte_utils.email_events_causedBy_ab2 2022-06-21 09:28:52 normalization > 09:28:08.665032 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_causedBy_ab2" 2022-06-21 09:28:52 normalization > 09:28:08.665543 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.email_events_causedBy_ab2 2022-06-21 09:28:52 normalization > 09:28:08.665970 [debug] [Thread-7 ]: Compiling model.airbyte_utils.email_events_causedBy_ab2 2022-06-21 09:28:52 normalization > 09:28:08.660421 [debug] [Thread-3 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:08.675151 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.email_events_location_ab1 2022-06-21 09:28:52 normalization > 09:28:08.673051 [debug] [Thread-4 ]: Began running node model.airbyte_utils.email_events_browser_ab2 2022-06-21 09:28:52 normalization > 09:28:08.677077 [debug] [Thread-4 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_browser_ab2" 2022-06-21 09:28:52 normalization > 09:28:08.685099 [debug] [Thread-4 ]: Began compiling node model.airbyte_utils.email_events_browser_ab2 2022-06-21 09:28:52 normalization > 09:28:08.686761 [debug] [Thread-4 ]: Compiling model.airbyte_utils.email_events_browser_ab2 2022-06-21 09:28:52 normalization > 09:28:08.677605 [debug] [Thread-5 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:08.686080 [debug] [Thread-1 ]: Began running node model.airbyte_utils.email_events_location_ab2 2022-06-21 09:28:52 normalization > 09:28:08.752763 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_location_ab2" 2022-06-21 09:28:52 normalization > 09:28:08.753256 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.email_events_location_ab2 2022-06-21 09:28:52 normalization > 09:28:08.753670 [debug] [Thread-1 ]: Compiling model.airbyte_utils.email_events_location_ab2 2022-06-21 09:28:52 normalization > 09:28:08.663418 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.email_events_obsoletedBy_ab1 2022-06-21 09:28:52 normalization > 09:28:08.711306 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.email_events_sentBy_ab1 2022-06-21 09:28:52 normalization > 09:28:08.751021 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.email_events_causedBy_ab2" 2022-06-21 09:28:52 normalization > 09:28:08.769789 [debug] [Thread-3 ]: Began running node model.airbyte_utils.email_events_obsoletedBy_ab2 2022-06-21 09:28:52 normalization > 09:28:08.787904 [debug] [Thread-6 ]: Began running node model.airbyte_utils.email_events_sentBy_ab2 2022-06-21 09:28:52 normalization > 09:28:08.830527 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_obsoletedBy_ab2" 2022-06-21 09:28:52 normalization > 09:28:08.839426 [debug] [Thread-7 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:08.841632 [debug] [Thread-4 ]: Writing injected SQL for node "model.airbyte_utils.email_events_browser_ab2" 2022-06-21 09:28:52 normalization > 09:28:08.860321 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.email_events_location_ab2" 2022-06-21 09:28:52 normalization > 09:28:08.861628 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_sentBy_ab2" 2022-06-21 09:28:52 normalization > 09:28:08.862007 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.email_events_obsoletedBy_ab2 2022-06-21 09:28:52 normalization > 09:28:08.862992 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.email_events_causedBy_ab2 2022-06-21 09:28:52 normalization > 09:28:08.863921 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.email_events_sentBy_ab2 2022-06-21 09:28:52 normalization > 09:28:08.864181 [debug] [Thread-1 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:08.864478 [debug] [Thread-4 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:08.864768 [debug] [Thread-3 ]: Compiling model.airbyte_utils.email_events_obsoletedBy_ab2 2022-06-21 09:28:52 normalization > 09:28:08.865554 [debug] [Thread-8 ]: Began running node model.airbyte_utils.email_events_causedBy_ab3 2022-06-21 09:28:52 normalization > 09:28:08.865896 [debug] [Thread-6 ]: Compiling model.airbyte_utils.email_events_sentBy_ab2 2022-06-21 09:28:52 normalization > 09:28:08.867309 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.email_events_location_ab2 2022-06-21 09:28:52 normalization > 09:28:08.868393 [debug] [Thread-4 ]: Finished running node model.airbyte_utils.email_events_browser_ab2 2022-06-21 09:28:52 normalization > 09:28:08.880450 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_causedBy_ab3" 2022-06-21 09:28:52 normalization > 09:28:08.907422 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.email_events_obsoletedBy_ab2" 2022-06-21 09:28:52 normalization > 09:28:08.936157 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.email_events_sentBy_ab2" 2022-06-21 09:28:52 normalization > 09:28:08.936643 [debug] [Thread-7 ]: Began running node model.airbyte_utils.email_events_location_ab3 2022-06-21 09:28:52 normalization > 09:28:08.937377 [debug] [Thread-1 ]: Began running node model.airbyte_utils.email_events_browser_ab3 2022-06-21 09:28:52 normalization > 09:28:08.937673 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.email_events_causedBy_ab3 2022-06-21 09:28:52 normalization > 09:28:08.943315 [debug] [Thread-8 ]: Compiling model.airbyte_utils.email_events_causedBy_ab3 2022-06-21 09:28:52 normalization > 09:28:08.940982 [debug] [Thread-7 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_location_ab3" 2022-06-21 09:28:52 normalization > 09:28:08.942392 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_browser_ab3" 2022-06-21 09:28:52 normalization > 09:28:08.938362 [debug] [Thread-3 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:08.965266 [debug] [Thread-7 ]: Began compiling node model.airbyte_utils.email_events_location_ab3 2022-06-21 09:28:52 normalization > 09:28:08.965726 [debug] [Thread-6 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:08.977476 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.email_events_causedBy_ab3" 2022-06-21 09:28:52 normalization > 09:28:08.977879 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.email_events_browser_ab3 2022-06-21 09:28:52 normalization > 09:28:08.979348 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.email_events_obsoletedBy_ab2 2022-06-21 09:28:52 normalization > 09:28:08.979792 [debug] [Thread-7 ]: Compiling model.airbyte_utils.email_events_location_ab3 2022-06-21 09:28:52 normalization > 09:28:08.980786 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.email_events_sentBy_ab2 2022-06-21 09:28:52 normalization > 09:28:08.981338 [debug] [Thread-1 ]: Compiling model.airbyte_utils.email_events_browser_ab3 2022-06-21 09:28:52 normalization > 09:28:08.982122 [debug] [Thread-8 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:08.982615 [debug] [Thread-5 ]: Began running node model.airbyte_utils.email_events_obsoletedBy_ab3 2022-06-21 09:28:52 normalization > 09:28:09.059784 [debug] [Thread-3 ]: Began running node model.airbyte_utils.email_events_sentBy_ab3 2022-06-21 09:28:52 normalization > 09:28:09.085527 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.email_events_causedBy_ab3 2022-06-21 09:28:52 normalization > 09:28:09.106278 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_obsoletedBy_ab3" 2022-06-21 09:28:52 normalization > 09:28:09.114196 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.email_events_browser_ab3" 2022-06-21 09:28:52 normalization > 09:28:09.115809 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_sentBy_ab3" 2022-06-21 09:28:52 normalization > 09:28:09.118059 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.email_events_sentBy_ab3 2022-06-21 09:28:52 normalization > 09:28:09.117148 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.email_events_obsoletedBy_ab3 2022-06-21 09:28:52 normalization > 09:28:09.118576 [debug] [Thread-1 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:09.119053 [debug] [Thread-3 ]: Compiling model.airbyte_utils.email_events_sentBy_ab3 2022-06-21 09:28:52 normalization > 09:28:09.119424 [debug] [Thread-5 ]: Compiling model.airbyte_utils.email_events_obsoletedBy_ab3 2022-06-21 09:28:52 normalization > 09:28:09.120811 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.email_events_browser_ab3 2022-06-21 09:28:52 normalization > 09:28:09.131925 [debug] [Thread-6 ]: Began running node model.airbyte_utils.email_events_causedBy 2022-06-21 09:28:52 normalization > 09:28:09.206381 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.email_events_sentBy_ab3" 2022-06-21 09:28:52 normalization > 09:28:09.231442 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.email_events_obsoletedBy_ab3" 2022-06-21 09:28:52 normalization > 09:28:09.260404 [debug] [Thread-8 ]: Began running node model.airbyte_utils.email_events_browser 2022-06-21 09:28:52 normalization > 09:28:09.275865 [info ] [Thread-6 ]: 4 of 8 START incremental model hubspot_test_email.email_events_causedBy................................................. [RUN] 2022-06-21 09:28:52 normalization > 09:28:09.293681 [debug] [Thread-7 ]: Writing injected SQL for node "model.airbyte_utils.email_events_location_ab3" 2022-06-21 09:28:52 normalization > 09:28:09.294533 [debug] [Thread-3 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:09.295166 [info ] [Thread-8 ]: 5 of 8 START incremental model hubspot_test_email.email_events_browser.................................................. [RUN] 2022-06-21 09:28:52 normalization > 09:28:09.295808 [debug] [Thread-5 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:09.297623 [debug] [Thread-6 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_causedBy" 2022-06-21 09:28:52 normalization > 09:28:09.299510 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.email_events_sentBy_ab3 2022-06-21 09:28:52 normalization > 09:28:09.301443 [debug] [Thread-8 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_browser" 2022-06-21 09:28:52 normalization > 09:28:09.303208 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.email_events_obsoletedBy_ab3 2022-06-21 09:28:52 normalization > 09:28:09.303601 [debug] [Thread-7 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:09.303987 [debug] [Thread-6 ]: Began compiling node model.airbyte_utils.email_events_causedBy 2022-06-21 09:28:52 normalization > 09:28:09.304803 [debug] [Thread-8 ]: Began compiling node model.airbyte_utils.email_events_browser 2022-06-21 09:28:52 normalization > 09:28:09.305039 [debug] [Thread-1 ]: Began running node model.airbyte_utils.email_events_sentBy 2022-06-21 09:28:52 normalization > 09:28:09.306762 [debug] [Thread-3 ]: Began running node model.airbyte_utils.email_events_obsoletedBy 2022-06-21 09:28:52 normalization > 09:28:09.308109 [debug] [Thread-7 ]: Finished running node model.airbyte_utils.email_events_location_ab3 2022-06-21 09:28:52 normalization > 09:28:09.308653 [debug] [Thread-6 ]: Compiling model.airbyte_utils.email_events_causedBy 2022-06-21 09:28:52 normalization > 09:28:09.309073 [debug] [Thread-8 ]: Compiling model.airbyte_utils.email_events_browser 2022-06-21 09:28:52 normalization > 09:28:09.309627 [info ] [Thread-1 ]: 6 of 8 START incremental model hubspot_test_email.email_events_sentBy................................................... [RUN] 2022-06-21 09:28:52 normalization > 09:28:09.310612 [info ] [Thread-3 ]: 7 of 8 START incremental model hubspot_test_email.email_events_obsoletedBy.............................................. [RUN] 2022-06-21 09:28:52 normalization > 09:28:09.316852 [debug] [Thread-5 ]: Began running node model.airbyte_utils.email_events_location 2022-06-21 09:28:52 normalization > 09:28:09.342759 [debug] [Thread-6 ]: Opening a new connection, currently in state closed 2022-06-21 09:28:52 normalization > 09:28:09.368770 [debug] [Thread-1 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_sentBy" 2022-06-21 09:28:52 normalization > 09:28:09.391526 [debug] [Thread-1 ]: Began compiling node model.airbyte_utils.email_events_sentBy 2022-06-21 09:28:52 normalization > 09:28:09.392037 [debug] [Thread-1 ]: Compiling model.airbyte_utils.email_events_sentBy 2022-06-21 09:28:52 normalization > 09:28:09.389008 [info ] [Thread-5 ]: 8 of 8 START incremental model hubspot_test_email.email_events_location................................................. [RUN] 2022-06-21 09:28:52 normalization > 09:28:09.390706 [debug] [Thread-3 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_obsoletedBy" 2022-06-21 09:28:52 normalization > 09:28:09.382394 [debug] [Thread-8 ]: Writing injected SQL for node "model.airbyte_utils.email_events_browser" 2022-06-21 09:28:52 normalization > 09:28:09.387087 [debug] [Thread-2 ]: Writing injected SQL for node "model.airbyte_utils.email_events" 2022-06-21 09:28:52 normalization > 09:28:09.416009 [debug] [Thread-1 ]: Opening a new connection, currently in state closed 2022-06-21 09:28:52 normalization > 09:28:09.417165 [debug] [Thread-5 ]: Acquiring new bigquery connection "model.airbyte_utils.email_events_location" 2022-06-21 09:28:52 normalization > 09:28:09.419328 [debug] [Thread-3 ]: Began compiling node model.airbyte_utils.email_events_obsoletedBy 2022-06-21 09:28:52 normalization > 09:28:09.421358 [debug] [Thread-2 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:09.421987 [debug] [Thread-8 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:09.428217 [debug] [Thread-8 ]: Began executing node model.airbyte_utils.email_events_browser 2022-06-21 09:28:52 normalization > 09:28:09.423408 [debug] [Thread-3 ]: Compiling model.airbyte_utils.email_events_obsoletedBy 2022-06-21 09:28:52 normalization > 09:28:09.427575 [debug] [Thread-2 ]: Began executing node model.airbyte_utils.email_events 2022-06-21 09:28:52 normalization > 09:28:09.422832 [debug] [Thread-5 ]: Began compiling node model.airbyte_utils.email_events_location 2022-06-21 09:28:52 normalization > 09:28:09.448114 [debug] [Thread-8 ]: Opening a new connection, currently in state closed 2022-06-21 09:28:52 normalization > 09:28:09.466784 [debug] [Thread-3 ]: Opening a new connection, currently in state closed 2022-06-21 09:28:52 normalization > 09:28:09.469782 [debug] [Thread-5 ]: Compiling model.airbyte_utils.email_events_location 2022-06-21 09:28:52 normalization > 09:28:09.499563 [debug] [Thread-5 ]: Opening a new connection, currently in state closed 2022-06-21 09:28:52 normalization > 09:28:09.563555 [debug] [Thread-2 ]: On model.airbyte_utils.email_events: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.email_events"} */ 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > create or replace table `analytics-platform-201110`.hubspot_test_email.`email_events__dbt_tmp` 2022-06-21 09:28:52 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-06-21 09:28:52 normalization > cluster by _airbyte_unique_key, _airbyte_emitted_at 2022-06-21 09:28:52 normalization > OPTIONS( 2022-06-21 09:28:52 normalization > expiration_timestamp=TIMESTAMP_ADD(CURRENT_TIMESTAMP(), INTERVAL 12 hour) 2022-06-21 09:28:52 normalization > ) 2022-06-21 09:28:52 normalization > as ( 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > -- Final base SQL model 2022-06-21 09:28:52 normalization > -- depends_on: `analytics-platform-201110`.hubspot_test_email.`email_events_scd` 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > _airbyte_unique_key, 2022-06-21 09:28:52 normalization > id, 2022-06-21 09:28:52 normalization > url, 2022-06-21 09:28:52 normalization > `from`, 2022-06-21 09:28:52 normalization > hmid, 2022-06-21 09:28:52 normalization > type, 2022-06-21 09:28:52 normalization > appId, 2022-06-21 09:28:52 normalization > linkId, 2022-06-21 09:28:52 normalization > sentBy, 2022-06-21 09:28:52 normalization > smtpId, 2022-06-21 09:28:52 normalization > source, 2022-06-21 09:28:52 normalization > status, 2022-06-21 09:28:52 normalization > appName, 2022-06-21 09:28:52 normalization > attempt, 2022-06-21 09:28:52 normalization > bounced, 2022-06-21 09:28:52 normalization > browser, 2022-06-21 09:28:52 normalization > created, 2022-06-21 09:28:52 normalization > referer, 2022-06-21 09:28:52 normalization > replyTo, 2022-06-21 09:28:52 normalization > subject, 2022-06-21 09:28:52 normalization > category, 2022-06-21 09:28:52 normalization > causedBy, 2022-06-21 09:28:52 normalization > duration, 2022-06-21 09:28:52 normalization > location, 2022-06-21 09:28:52 normalization > portalId, 2022-06-21 09:28:52 normalization > response, 2022-06-21 09:28:52 normalization > sourceId, 2022-06-21 09:28:52 normalization > ipAddress, 2022-06-21 09:28:52 normalization > recipient, 2022-06-21 09:28:52 normalization > userAgent, 2022-06-21 09:28:52 normalization > deviceType, 2022-06-21 09:28:52 normalization > dropReason, 2022-06-21 09:28:52 normalization > dropMessage, 2022-06-21 09:28:52 normalization > obsoletedBy, 2022-06-21 09:28:52 normalization > requestedBy, 2022-06-21 09:28:52 normalization > filteredEvent, 2022-06-21 09:28:52 normalization > emailCampaignId, 2022-06-21 09:28:52 normalization > requestedByUserId, 2022-06-21 09:28:52 normalization > emailCampaignGroupId, 2022-06-21 09:28:52 normalization > portalSubscriptionStatus, 2022-06-21 09:28:52 normalization > _airbyte_ab_id, 2022-06-21 09:28:52 normalization > _airbyte_emitted_at, 2022-06-21 09:28:52 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-06-21 09:28:52 normalization > _airbyte_email_events_hashid 2022-06-21 09:28:52 normalization > from `analytics-platform-201110`.hubspot_test_email.`email_events_scd` 2022-06-21 09:28:52 normalization > -- email_events from `analytics-platform-201110`.hubspot_test_email._airbyte_raw_email_events 2022-06-21 09:28:52 normalization > where 1 = 1 2022-06-21 09:28:52 normalization > and _airbyte_active_row = 1 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > and coalesce( 2022-06-21 09:28:52 normalization > cast(_airbyte_emitted_at as 2022-06-21 09:28:52 normalization > timestamp 2022-06-21 09:28:52 normalization > ) >= (select max(cast(_airbyte_emitted_at as 2022-06-21 09:28:52 normalization > timestamp 2022-06-21 09:28:52 normalization > )) from `analytics-platform-201110`.hubspot_test_email.`email_events`), 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > true) 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > ); 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 09:28:09.803546 [debug] [Thread-6 ]: Writing injected SQL for node "model.airbyte_utils.email_events_causedBy" 2022-06-21 09:28:52 normalization > 09:28:09.804134 [debug] [Thread-6 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:09.804394 [debug] [Thread-6 ]: Began executing node model.airbyte_utils.email_events_causedBy 2022-06-21 09:28:52 normalization > 09:28:09.855686 [debug] [Thread-1 ]: Writing injected SQL for node "model.airbyte_utils.email_events_sentBy" 2022-06-21 09:28:52 normalization > 09:28:09.856517 [debug] [Thread-1 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:09.856907 [debug] [Thread-1 ]: Began executing node model.airbyte_utils.email_events_sentBy 2022-06-21 09:28:52 normalization > 09:28:09.878662 [debug] [Thread-8 ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/analytics-platform-201110/datasets/hubspot_test_email/tables/email_events_browser?prettyPrint=false: Not found: Table analytics-platform-201110:hubspot_test_email.email_events_browser 2022-06-21 09:28:52 normalization > 09:28:09.906712 [debug] [Thread-3 ]: Writing injected SQL for node "model.airbyte_utils.email_events_obsoletedBy" 2022-06-21 09:28:52 normalization > 09:28:09.928241 [debug] [Thread-5 ]: Writing injected SQL for node "model.airbyte_utils.email_events_location" 2022-06-21 09:28:52 normalization > 09:28:09.950756 [info ] [Thread-8 ]: 09:28:09 + `analytics-platform-201110`.hubspot_test_email.`email_events_browser`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh 2022-06-21 09:28:52 normalization > 09:28:09.951417 [debug] [Thread-3 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:09.957295 [debug] [Thread-3 ]: Began executing node model.airbyte_utils.email_events_obsoletedBy 2022-06-21 09:28:52 normalization > 09:28:09.956441 [debug] [Thread-8 ]: Writing runtime SQL for node "model.airbyte_utils.email_events_browser" 2022-06-21 09:28:52 normalization > 09:28:09.957737 [debug] [Thread-5 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:09.962722 [debug] [Thread-6 ]: On model.airbyte_utils.email_events_causedBy: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.email_events_causedBy"} */ 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > create or replace table `analytics-platform-201110`.hubspot_test_email.`email_events_causedBy__dbt_tmp` 2022-06-21 09:28:52 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-06-21 09:28:52 normalization > cluster by _airbyte_emitted_at 2022-06-21 09:28:52 normalization > OPTIONS( 2022-06-21 09:28:52 normalization > expiration_timestamp=TIMESTAMP_ADD(CURRENT_TIMESTAMP(), INTERVAL 12 hour) 2022-06-21 09:28:52 normalization > ) 2022-06-21 09:28:52 normalization > as ( 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > with __dbt__cte__email_events_causedBy_ab1 as ( 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-06-21 09:28:52 normalization > -- depends_on: `analytics-platform-201110`.hubspot_test_email.`email_events_scd` 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > _airbyte_email_events_hashid, 2022-06-21 09:28:52 normalization > json_extract_scalar(causedBy, "$['id']") as id, 2022-06-21 09:28:52 normalization > json_extract_scalar(causedBy, "$['created']") as created, 2022-06-21 09:28:52 normalization > _airbyte_ab_id, 2022-06-21 09:28:52 normalization > _airbyte_emitted_at, 2022-06-21 09:28:52 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-06-21 09:28:52 normalization > from `analytics-platform-201110`.hubspot_test_email.`email_events_scd` as table_alias 2022-06-21 09:28:52 normalization > -- causedBy at email_events/causedBy 2022-06-21 09:28:52 normalization > where 1 = 1 2022-06-21 09:28:52 normalization > and causedBy is not null 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > ), __dbt__cte__email_events_causedBy_ab2 as ( 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-06-21 09:28:52 normalization > -- depends_on: __dbt__cte__email_events_causedBy_ab1 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > _airbyte_email_events_hashid, 2022-06-21 09:28:52 normalization > cast(id as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as id, 2022-06-21 09:28:52 normalization > cast(created as 2022-06-21 09:28:52 normalization > int64 2022-06-21 09:28:52 normalization > ) as created, 2022-06-21 09:28:52 normalization > _airbyte_ab_id, 2022-06-21 09:28:52 normalization > _airbyte_emitted_at, 2022-06-21 09:28:52 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-06-21 09:28:52 normalization > from __dbt__cte__email_events_causedBy_ab1 2022-06-21 09:28:52 normalization > -- causedBy at email_events/causedBy 2022-06-21 09:28:52 normalization > where 1 = 1 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > ), __dbt__cte__email_events_causedBy_ab3 as ( 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > -- SQL model to build a hash column based on the values of this record 2022-06-21 09:28:52 normalization > -- depends_on: __dbt__cte__email_events_causedBy_ab2 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_email_events_hashid as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(id as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(created as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), '')) as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ))) as _airbyte_causedBy_hashid, 2022-06-21 09:28:52 normalization > tmp.* 2022-06-21 09:28:52 normalization > from __dbt__cte__email_events_causedBy_ab2 tmp 2022-06-21 09:28:52 normalization > -- causedBy at email_events/causedBy 2022-06-21 09:28:52 normalization > where 1 = 1 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > )-- Final base SQL model 2022-06-21 09:28:52 normalization > -- depends_on: __dbt__cte__email_events_causedBy_ab3 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > _airbyte_email_events_hashid, 2022-06-21 09:28:52 normalization > id, 2022-06-21 09:28:52 normalization > created, 2022-06-21 09:28:52 normalization > _airbyte_ab_id, 2022-06-21 09:28:52 normalization > _airbyte_emitted_at, 2022-06-21 09:28:52 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-06-21 09:28:52 normalization > _airbyte_causedBy_hashid 2022-06-21 09:28:52 normalization > from __dbt__cte__email_events_causedBy_ab3 2022-06-21 09:28:52 normalization > -- causedBy at email_events/causedBy from `analytics-platform-201110`.hubspot_test_email.`email_events_scd` 2022-06-21 09:28:52 normalization > where 1 = 1 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > and coalesce( 2022-06-21 09:28:52 normalization > cast(_airbyte_emitted_at as 2022-06-21 09:28:52 normalization > timestamp 2022-06-21 09:28:52 normalization > ) >= (select max(cast(_airbyte_emitted_at as 2022-06-21 09:28:52 normalization > timestamp 2022-06-21 09:28:52 normalization > )) from `analytics-platform-201110`.hubspot_test_email.`email_events_causedBy`), 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > true) 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > ); 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 09:28:09.980164 [debug] [Thread-5 ]: Began executing node model.airbyte_utils.email_events_location 2022-06-21 09:28:52 normalization > 09:28:09.980887 [debug] [Thread-8 ]: On model.airbyte_utils.email_events_browser: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.email_events_browser"} */ 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > create or replace table `analytics-platform-201110`.hubspot_test_email.`email_events_browser` 2022-06-21 09:28:52 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-06-21 09:28:52 normalization > cluster by _airbyte_emitted_at 2022-06-21 09:28:52 normalization > OPTIONS() 2022-06-21 09:28:52 normalization > as ( 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > with __dbt__cte__email_events_browser_ab1 as ( 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-06-21 09:28:52 normalization > -- depends_on: `analytics-platform-201110`.hubspot_test_email.`email_events_scd` 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > _airbyte_email_events_hashid, 2022-06-21 09:28:52 normalization > json_extract_scalar(browser, "$['url']") as url, 2022-06-21 09:28:52 normalization > json_extract_scalar(browser, "$['name']") as name, 2022-06-21 09:28:52 normalization > json_extract_scalar(browser, "$['type']") as type, 2022-06-21 09:28:52 normalization > json_extract_scalar(browser, "$['family']") as family, 2022-06-21 09:28:52 normalization > json_extract_string_array(browser, "$['version']") as version, 2022-06-21 09:28:52 normalization > json_extract_scalar(browser, "$['producer']") as producer, 2022-06-21 09:28:52 normalization > json_extract_scalar(browser, "$['producerUrl']") as producerUrl, 2022-06-21 09:28:52 normalization > _airbyte_ab_id, 2022-06-21 09:28:52 normalization > _airbyte_emitted_at, 2022-06-21 09:28:52 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-06-21 09:28:52 normalization > from `analytics-platform-201110`.hubspot_test_email.`email_events_scd` as table_alias 2022-06-21 09:28:52 normalization > -- browser at email_events/browser 2022-06-21 09:28:52 normalization > where 1 = 1 2022-06-21 09:28:52 normalization > and browser is not null 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > ), __dbt__cte__email_events_browser_ab2 as ( 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-06-21 09:28:52 normalization > -- depends_on: __dbt__cte__email_events_browser_ab1 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > _airbyte_email_events_hashid, 2022-06-21 09:28:52 normalization > cast(url as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as url, 2022-06-21 09:28:52 normalization > cast(name as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as name, 2022-06-21 09:28:52 normalization > cast(type as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as type, 2022-06-21 09:28:52 normalization > cast(family as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as family, 2022-06-21 09:28:52 normalization > version, 2022-06-21 09:28:52 normalization > cast(producer as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as producer, 2022-06-21 09:28:52 normalization > cast(producerUrl as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as producerUrl, 2022-06-21 09:28:52 normalization > _airbyte_ab_id, 2022-06-21 09:28:52 normalization > _airbyte_emitted_at, 2022-06-21 09:28:52 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-06-21 09:28:52 normalization > from __dbt__cte__email_events_browser_ab1 2022-06-21 09:28:52 normalization > -- browser at email_events/browser 2022-06-21 09:28:52 normalization > where 1 = 1 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > ), __dbt__cte__email_events_browser_ab3 as ( 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > -- SQL model to build a hash column based on the values of this record 2022-06-21 09:28:52 normalization > -- depends_on: __dbt__cte__email_events_browser_ab2 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_email_events_hashid as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(url as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(name as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(type as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(family as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(array_to_string(version, "|", "") as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(producer as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(producerUrl as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), '')) as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ))) as _airbyte_browser_hashid, 2022-06-21 09:28:52 normalization > tmp.* 2022-06-21 09:28:52 normalization > from __dbt__cte__email_events_browser_ab2 tmp 2022-06-21 09:28:52 normalization > -- browser at email_events/browser 2022-06-21 09:28:52 normalization > where 1 = 1 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > )-- Final base SQL model 2022-06-21 09:28:52 normalization > -- depends_on: __dbt__cte__email_events_browser_ab3 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > _airbyte_email_events_hashid, 2022-06-21 09:28:52 normalization > url, 2022-06-21 09:28:52 normalization > name, 2022-06-21 09:28:52 normalization > type, 2022-06-21 09:28:52 normalization > family, 2022-06-21 09:28:52 normalization > version, 2022-06-21 09:28:52 normalization > producer, 2022-06-21 09:28:52 normalization > producerUrl, 2022-06-21 09:28:52 normalization > _airbyte_ab_id, 2022-06-21 09:28:52 normalization > _airbyte_emitted_at, 2022-06-21 09:28:52 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-06-21 09:28:52 normalization > _airbyte_browser_hashid 2022-06-21 09:28:52 normalization > from __dbt__cte__email_events_browser_ab3 2022-06-21 09:28:52 normalization > -- browser at email_events/browser from `analytics-platform-201110`.hubspot_test_email.`email_events_scd` 2022-06-21 09:28:52 normalization > where 1 = 1 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > ); 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 09:28:09.999661 [debug] [Thread-1 ]: On model.airbyte_utils.email_events_sentBy: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.email_events_sentBy"} */ 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > create or replace table `analytics-platform-201110`.hubspot_test_email.`email_events_sentBy__dbt_tmp` 2022-06-21 09:28:52 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-06-21 09:28:52 normalization > cluster by _airbyte_emitted_at 2022-06-21 09:28:52 normalization > OPTIONS( 2022-06-21 09:28:52 normalization > expiration_timestamp=TIMESTAMP_ADD(CURRENT_TIMESTAMP(), INTERVAL 12 hour) 2022-06-21 09:28:52 normalization > ) 2022-06-21 09:28:52 normalization > as ( 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > with __dbt__cte__email_events_sentBy_ab1 as ( 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-06-21 09:28:52 normalization > -- depends_on: `analytics-platform-201110`.hubspot_test_email.`email_events_scd` 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > _airbyte_email_events_hashid, 2022-06-21 09:28:52 normalization > json_extract_scalar(sentBy, "$['id']") as id, 2022-06-21 09:28:52 normalization > json_extract_scalar(sentBy, "$['created']") as created, 2022-06-21 09:28:52 normalization > _airbyte_ab_id, 2022-06-21 09:28:52 normalization > _airbyte_emitted_at, 2022-06-21 09:28:52 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-06-21 09:28:52 normalization > from `analytics-platform-201110`.hubspot_test_email.`email_events_scd` as table_alias 2022-06-21 09:28:52 normalization > -- sentBy at email_events/sentBy 2022-06-21 09:28:52 normalization > where 1 = 1 2022-06-21 09:28:52 normalization > and sentBy is not null 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > ), __dbt__cte__email_events_sentBy_ab2 as ( 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-06-21 09:28:52 normalization > -- depends_on: __dbt__cte__email_events_sentBy_ab1 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > _airbyte_email_events_hashid, 2022-06-21 09:28:52 normalization > cast(id as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as id, 2022-06-21 09:28:52 normalization > cast(created as 2022-06-21 09:28:52 normalization > int64 2022-06-21 09:28:52 normalization > ) as created, 2022-06-21 09:28:52 normalization > _airbyte_ab_id, 2022-06-21 09:28:52 normalization > _airbyte_emitted_at, 2022-06-21 09:28:52 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-06-21 09:28:52 normalization > from __dbt__cte__email_events_sentBy_ab1 2022-06-21 09:28:52 normalization > -- sentBy at email_events/sentBy 2022-06-21 09:28:52 normalization > where 1 = 1 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > ), __dbt__cte__email_events_sentBy_ab3 as ( 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > -- SQL model to build a hash column based on the values of this record 2022-06-21 09:28:52 normalization > -- depends_on: __dbt__cte__email_events_sentBy_ab2 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_email_events_hashid as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(id as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(created as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), '')) as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ))) as _airbyte_sentBy_hashid, 2022-06-21 09:28:52 normalization > tmp.* 2022-06-21 09:28:52 normalization > from __dbt__cte__email_events_sentBy_ab2 tmp 2022-06-21 09:28:52 normalization > -- sentBy at email_events/sentBy 2022-06-21 09:28:52 normalization > where 1 = 1 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > )-- Final base SQL model 2022-06-21 09:28:52 normalization > -- depends_on: __dbt__cte__email_events_sentBy_ab3 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > _airbyte_email_events_hashid, 2022-06-21 09:28:52 normalization > id, 2022-06-21 09:28:52 normalization > created, 2022-06-21 09:28:52 normalization > _airbyte_ab_id, 2022-06-21 09:28:52 normalization > _airbyte_emitted_at, 2022-06-21 09:28:52 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-06-21 09:28:52 normalization > _airbyte_sentBy_hashid 2022-06-21 09:28:52 normalization > from __dbt__cte__email_events_sentBy_ab3 2022-06-21 09:28:52 normalization > -- sentBy at email_events/sentBy from `analytics-platform-201110`.hubspot_test_email.`email_events_scd` 2022-06-21 09:28:52 normalization > where 1 = 1 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > and coalesce( 2022-06-21 09:28:52 normalization > cast(_airbyte_emitted_at as 2022-06-21 09:28:52 normalization > timestamp 2022-06-21 09:28:52 normalization > ) >= (select max(cast(_airbyte_emitted_at as 2022-06-21 09:28:52 normalization > timestamp 2022-06-21 09:28:52 normalization > )) from `analytics-platform-201110`.hubspot_test_email.`email_events_sentBy`), 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > true) 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > ); 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 09:28:10.080866 [debug] [Thread-3 ]: On model.airbyte_utils.email_events_obsoletedBy: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.email_events_obsoletedBy"} */ 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > create or replace table `analytics-platform-201110`.hubspot_test_email.`email_events_obsoletedBy__dbt_tmp` 2022-06-21 09:28:52 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-06-21 09:28:52 normalization > cluster by _airbyte_emitted_at 2022-06-21 09:28:52 normalization > OPTIONS( 2022-06-21 09:28:52 normalization > expiration_timestamp=TIMESTAMP_ADD(CURRENT_TIMESTAMP(), INTERVAL 12 hour) 2022-06-21 09:28:52 normalization > ) 2022-06-21 09:28:52 normalization > as ( 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > with __dbt__cte__email_events_obsoletedBy_ab1 as ( 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-06-21 09:28:52 normalization > -- depends_on: `analytics-platform-201110`.hubspot_test_email.`email_events_scd` 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > _airbyte_email_events_hashid, 2022-06-21 09:28:52 normalization > json_extract_scalar(obsoletedBy, "$['id']") as id, 2022-06-21 09:28:52 normalization > json_extract_scalar(obsoletedBy, "$['created']") as created, 2022-06-21 09:28:52 normalization > _airbyte_ab_id, 2022-06-21 09:28:52 normalization > _airbyte_emitted_at, 2022-06-21 09:28:52 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-06-21 09:28:52 normalization > from `analytics-platform-201110`.hubspot_test_email.`email_events_scd` as table_alias 2022-06-21 09:28:52 normalization > -- obsoletedBy at email_events/obsoletedBy 2022-06-21 09:28:52 normalization > where 1 = 1 2022-06-21 09:28:52 normalization > and obsoletedBy is not null 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > ), __dbt__cte__email_events_obsoletedBy_ab2 as ( 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-06-21 09:28:52 normalization > -- depends_on: __dbt__cte__email_events_obsoletedBy_ab1 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > _airbyte_email_events_hashid, 2022-06-21 09:28:52 normalization > cast(id as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as id, 2022-06-21 09:28:52 normalization > cast(created as 2022-06-21 09:28:52 normalization > int64 2022-06-21 09:28:52 normalization > ) as created, 2022-06-21 09:28:52 normalization > _airbyte_ab_id, 2022-06-21 09:28:52 normalization > _airbyte_emitted_at, 2022-06-21 09:28:52 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-06-21 09:28:52 normalization > from __dbt__cte__email_events_obsoletedBy_ab1 2022-06-21 09:28:52 normalization > -- obsoletedBy at email_events/obsoletedBy 2022-06-21 09:28:52 normalization > where 1 = 1 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > ), __dbt__cte__email_events_obsoletedBy_ab3 as ( 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > -- SQL model to build a hash column based on the values of this record 2022-06-21 09:28:52 normalization > -- depends_on: __dbt__cte__email_events_obsoletedBy_ab2 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_email_events_hashid as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(id as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(created as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), '')) as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ))) as _airbyte_obsoletedBy_hashid, 2022-06-21 09:28:52 normalization > tmp.* 2022-06-21 09:28:52 normalization > from __dbt__cte__email_events_obsoletedBy_ab2 tmp 2022-06-21 09:28:52 normalization > -- obsoletedBy at email_events/obsoletedBy 2022-06-21 09:28:52 normalization > where 1 = 1 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > )-- Final base SQL model 2022-06-21 09:28:52 normalization > -- depends_on: __dbt__cte__email_events_obsoletedBy_ab3 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > _airbyte_email_events_hashid, 2022-06-21 09:28:52 normalization > id, 2022-06-21 09:28:52 normalization > created, 2022-06-21 09:28:52 normalization > _airbyte_ab_id, 2022-06-21 09:28:52 normalization > _airbyte_emitted_at, 2022-06-21 09:28:52 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-06-21 09:28:52 normalization > _airbyte_obsoletedBy_hashid 2022-06-21 09:28:52 normalization > from __dbt__cte__email_events_obsoletedBy_ab3 2022-06-21 09:28:52 normalization > -- obsoletedBy at email_events/obsoletedBy from `analytics-platform-201110`.hubspot_test_email.`email_events_scd` 2022-06-21 09:28:52 normalization > where 1 = 1 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > and coalesce( 2022-06-21 09:28:52 normalization > cast(_airbyte_emitted_at as 2022-06-21 09:28:52 normalization > timestamp 2022-06-21 09:28:52 normalization > ) >= (select max(cast(_airbyte_emitted_at as 2022-06-21 09:28:52 normalization > timestamp 2022-06-21 09:28:52 normalization > )) from `analytics-platform-201110`.hubspot_test_email.`email_events_obsoletedBy`), 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > true) 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > ); 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 09:28:10.132490 [debug] [Thread-5 ]: On model.airbyte_utils.email_events_location: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.email_events_location"} */ 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > create or replace table `analytics-platform-201110`.hubspot_test_email.`email_events_location__dbt_tmp` 2022-06-21 09:28:52 normalization > partition by timestamp_trunc(_airbyte_emitted_at, day) 2022-06-21 09:28:52 normalization > cluster by _airbyte_emitted_at 2022-06-21 09:28:52 normalization > OPTIONS( 2022-06-21 09:28:52 normalization > expiration_timestamp=TIMESTAMP_ADD(CURRENT_TIMESTAMP(), INTERVAL 12 hour) 2022-06-21 09:28:52 normalization > ) 2022-06-21 09:28:52 normalization > as ( 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > with __dbt__cte__email_events_location_ab1 as ( 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema 2022-06-21 09:28:52 normalization > -- depends_on: `analytics-platform-201110`.hubspot_test_email.`email_events_scd` 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > _airbyte_email_events_hashid, 2022-06-21 09:28:52 normalization > json_extract_scalar(location, "$['city']") as city, 2022-06-21 09:28:52 normalization > json_extract_scalar(location, "$['state']") as state, 2022-06-21 09:28:52 normalization > json_extract_scalar(location, "$['country']") as country, 2022-06-21 09:28:52 normalization > json_extract_scalar(location, "$['zipcode']") as zipcode, 2022-06-21 09:28:52 normalization > json_extract_scalar(location, "$['latitude']") as latitude, 2022-06-21 09:28:52 normalization > json_extract_scalar(location, "$['longitude']") as longitude, 2022-06-21 09:28:52 normalization > _airbyte_ab_id, 2022-06-21 09:28:52 normalization > _airbyte_emitted_at, 2022-06-21 09:28:52 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-06-21 09:28:52 normalization > from `analytics-platform-201110`.hubspot_test_email.`email_events_scd` as table_alias 2022-06-21 09:28:52 normalization > -- location at email_events/location 2022-06-21 09:28:52 normalization > where 1 = 1 2022-06-21 09:28:52 normalization > and location is not null 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > ), __dbt__cte__email_events_location_ab2 as ( 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type 2022-06-21 09:28:52 normalization > -- depends_on: __dbt__cte__email_events_location_ab1 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > _airbyte_email_events_hashid, 2022-06-21 09:28:52 normalization > cast(city as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as city, 2022-06-21 09:28:52 normalization > cast(state as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as state, 2022-06-21 09:28:52 normalization > cast(country as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as country, 2022-06-21 09:28:52 normalization > cast(zipcode as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ) as zipcode, 2022-06-21 09:28:52 normalization > cast(latitude as 2022-06-21 09:28:52 normalization > float64 2022-06-21 09:28:52 normalization > ) as latitude, 2022-06-21 09:28:52 normalization > cast(longitude as 2022-06-21 09:28:52 normalization > float64 2022-06-21 09:28:52 normalization > ) as longitude, 2022-06-21 09:28:52 normalization > _airbyte_ab_id, 2022-06-21 09:28:52 normalization > _airbyte_emitted_at, 2022-06-21 09:28:52 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at 2022-06-21 09:28:52 normalization > from __dbt__cte__email_events_location_ab1 2022-06-21 09:28:52 normalization > -- location at email_events/location 2022-06-21 09:28:52 normalization > where 1 = 1 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > ), __dbt__cte__email_events_location_ab3 as ( 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > -- SQL model to build a hash column based on the values of this record 2022-06-21 09:28:52 normalization > -- depends_on: __dbt__cte__email_events_location_ab2 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > to_hex(md5(cast(concat(coalesce(cast(_airbyte_email_events_hashid as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(city as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(state as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(country as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(zipcode as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(latitude as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), ''), '-', coalesce(cast(longitude as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ), '')) as 2022-06-21 09:28:52 normalization > string 2022-06-21 09:28:52 normalization > ))) as _airbyte_location_hashid, 2022-06-21 09:28:52 normalization > tmp.* 2022-06-21 09:28:52 normalization > from __dbt__cte__email_events_location_ab2 tmp 2022-06-21 09:28:52 normalization > -- location at email_events/location 2022-06-21 09:28:52 normalization > where 1 = 1 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > )-- Final base SQL model 2022-06-21 09:28:52 normalization > -- depends_on: __dbt__cte__email_events_location_ab3 2022-06-21 09:28:52 normalization > select 2022-06-21 09:28:52 normalization > _airbyte_email_events_hashid, 2022-06-21 09:28:52 normalization > city, 2022-06-21 09:28:52 normalization > state, 2022-06-21 09:28:52 normalization > country, 2022-06-21 09:28:52 normalization > zipcode, 2022-06-21 09:28:52 normalization > latitude, 2022-06-21 09:28:52 normalization > longitude, 2022-06-21 09:28:52 normalization > _airbyte_ab_id, 2022-06-21 09:28:52 normalization > _airbyte_emitted_at, 2022-06-21 09:28:52 normalization > CURRENT_TIMESTAMP() as _airbyte_normalized_at, 2022-06-21 09:28:52 normalization > _airbyte_location_hashid 2022-06-21 09:28:52 normalization > from __dbt__cte__email_events_location_ab3 2022-06-21 09:28:52 normalization > -- location at email_events/location from `analytics-platform-201110`.hubspot_test_email.`email_events_scd` 2022-06-21 09:28:52 normalization > where 1 = 1 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > and coalesce( 2022-06-21 09:28:52 normalization > cast(_airbyte_emitted_at as 2022-06-21 09:28:52 normalization > timestamp 2022-06-21 09:28:52 normalization > ) >= (select max(cast(_airbyte_emitted_at as 2022-06-21 09:28:52 normalization > timestamp 2022-06-21 09:28:52 normalization > )) from `analytics-platform-201110`.hubspot_test_email.`email_events_location`), 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > true) 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > ); 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 09:28:12.361785 [debug] [Thread-3 ]: 2022-06-21 09:28:52 normalization > In `analytics-platform-201110`.`hubspot_test_email`.`email_events_obsoletedBy`: 2022-06-21 09:28:52 normalization > Schema changed: False 2022-06-21 09:28:52 normalization > Source columns not in target: [] 2022-06-21 09:28:52 normalization > Target columns not in source: [] 2022-06-21 09:28:52 normalization > New column types: [] 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 09:28:12.366227 [debug] [Thread-3 ]: Writing runtime SQL for node "model.airbyte_utils.email_events_obsoletedBy" 2022-06-21 09:28:52 normalization > 09:28:12.367280 [debug] [Thread-3 ]: On model.airbyte_utils.email_events_obsoletedBy: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.email_events_obsoletedBy"} */ 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > merge into `analytics-platform-201110`.hubspot_test_email.`email_events_obsoletedBy` as DBT_INTERNAL_DEST 2022-06-21 09:28:52 normalization > using ( 2022-06-21 09:28:52 normalization > select * from `analytics-platform-201110`.hubspot_test_email.`email_events_obsoletedBy__dbt_tmp` 2022-06-21 09:28:52 normalization > ) as DBT_INTERNAL_SOURCE 2022-06-21 09:28:52 normalization > on FALSE 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > when not matched then insert 2022-06-21 09:28:52 normalization > (`_airbyte_email_events_hashid`, `id`, `created`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_obsoletedBy_hashid`) 2022-06-21 09:28:52 normalization > values 2022-06-21 09:28:52 normalization > (`_airbyte_email_events_hashid`, `id`, `created`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_obsoletedBy_hashid`) 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 09:28:12.862804 [debug] [Thread-6 ]: 2022-06-21 09:28:52 normalization > In `analytics-platform-201110`.`hubspot_test_email`.`email_events_causedBy`: 2022-06-21 09:28:52 normalization > Schema changed: False 2022-06-21 09:28:52 normalization > Source columns not in target: [] 2022-06-21 09:28:52 normalization > Target columns not in source: [] 2022-06-21 09:28:52 normalization > New column types: [] 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 09:28:12.867146 [debug] [Thread-6 ]: Writing runtime SQL for node "model.airbyte_utils.email_events_causedBy" 2022-06-21 09:28:52 normalization > 09:28:12.868167 [debug] [Thread-6 ]: On model.airbyte_utils.email_events_causedBy: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.email_events_causedBy"} */ 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > merge into `analytics-platform-201110`.hubspot_test_email.`email_events_causedBy` as DBT_INTERNAL_DEST 2022-06-21 09:28:52 normalization > using ( 2022-06-21 09:28:52 normalization > select * from `analytics-platform-201110`.hubspot_test_email.`email_events_causedBy__dbt_tmp` 2022-06-21 09:28:52 normalization > ) as DBT_INTERNAL_SOURCE 2022-06-21 09:28:52 normalization > on FALSE 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > when not matched then insert 2022-06-21 09:28:52 normalization > (`_airbyte_email_events_hashid`, `id`, `created`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_causedBy_hashid`) 2022-06-21 09:28:52 normalization > values 2022-06-21 09:28:52 normalization > (`_airbyte_email_events_hashid`, `id`, `created`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_causedBy_hashid`) 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 09:28:13.295200 [debug] [Thread-8 ]: BigQuery adapter: Retry attempt 1 of 3 after error: BadRequest('Array cannot have a null element; error in writing field version') 2022-06-21 09:28:52 normalization > 09:28:14.431534 [debug] [Thread-3 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:14.433868 [info ] [Thread-3 ]: 7 of 8 OK created incremental model hubspot_test_email.email_events_obsoletedBy......................................... [MERGE (202.0 rows, 33.1 KB processed) in 5.04s] 2022-06-21 09:28:52 normalization > 09:28:14.435167 [debug] [Thread-3 ]: Finished running node model.airbyte_utils.email_events_obsoletedBy 2022-06-21 09:28:52 normalization > 09:28:14.935237 [debug] [Thread-6 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:14.937055 [info ] [Thread-6 ]: 4 of 8 OK created incremental model hubspot_test_email.email_events_causedBy............................................ [MERGE (5.8k rows, 862.5 KB processed) in 5.64s] 2022-06-21 09:28:52 normalization > 09:28:14.938064 [debug] [Thread-6 ]: Finished running node model.airbyte_utils.email_events_causedBy 2022-06-21 09:28:52 normalization > 09:28:15.263052 [debug] [Thread-5 ]: 2022-06-21 09:28:52 normalization > In `analytics-platform-201110`.`hubspot_test_email`.`email_events_location`: 2022-06-21 09:28:52 normalization > Schema changed: False 2022-06-21 09:28:52 normalization > Source columns not in target: [] 2022-06-21 09:28:52 normalization > Target columns not in source: [] 2022-06-21 09:28:52 normalization > New column types: [] 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 09:28:15.267624 [debug] [Thread-5 ]: Writing runtime SQL for node "model.airbyte_utils.email_events_location" 2022-06-21 09:28:52 normalization > 09:28:15.268636 [debug] [Thread-5 ]: On model.airbyte_utils.email_events_location: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.email_events_location"} */ 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > merge into `analytics-platform-201110`.hubspot_test_email.`email_events_location` as DBT_INTERNAL_DEST 2022-06-21 09:28:52 normalization > using ( 2022-06-21 09:28:52 normalization > select * from `analytics-platform-201110`.hubspot_test_email.`email_events_location__dbt_tmp` 2022-06-21 09:28:52 normalization > ) as DBT_INTERNAL_SOURCE 2022-06-21 09:28:52 normalization > on FALSE 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > when not matched then insert 2022-06-21 09:28:52 normalization > (`_airbyte_email_events_hashid`, `city`, `state`, `country`, `zipcode`, `latitude`, `longitude`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_location_hashid`) 2022-06-21 09:28:52 normalization > values 2022-06-21 09:28:52 normalization > (`_airbyte_email_events_hashid`, `city`, `state`, `country`, `zipcode`, `latitude`, `longitude`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_location_hashid`) 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 09:28:17.726211 [debug] [Thread-8 ]: BigQuery adapter: Retry attempt 2 of 3 after error: BadRequest('Array cannot have a null element; error in writing field version') 2022-06-21 09:28:52 normalization > 09:28:17.802560 [debug] [Thread-1 ]: 2022-06-21 09:28:52 normalization > In `analytics-platform-201110`.`hubspot_test_email`.`email_events_sentBy`: 2022-06-21 09:28:52 normalization > Schema changed: False 2022-06-21 09:28:52 normalization > Source columns not in target: [] 2022-06-21 09:28:52 normalization > Target columns not in source: [] 2022-06-21 09:28:52 normalization > New column types: [] 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 09:28:17.805168 [debug] [Thread-1 ]: Writing runtime SQL for node "model.airbyte_utils.email_events_sentBy" 2022-06-21 09:28:52 normalization > 09:28:17.805979 [debug] [Thread-1 ]: On model.airbyte_utils.email_events_sentBy: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.email_events_sentBy"} */ 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > merge into `analytics-platform-201110`.hubspot_test_email.`email_events_sentBy` as DBT_INTERNAL_DEST 2022-06-21 09:28:52 normalization > using ( 2022-06-21 09:28:52 normalization > select * from `analytics-platform-201110`.hubspot_test_email.`email_events_sentBy__dbt_tmp` 2022-06-21 09:28:52 normalization > ) as DBT_INTERNAL_SOURCE 2022-06-21 09:28:52 normalization > on FALSE 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > when not matched then insert 2022-06-21 09:28:52 normalization > (`_airbyte_email_events_hashid`, `id`, `created`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_sentBy_hashid`) 2022-06-21 09:28:52 normalization > values 2022-06-21 09:28:52 normalization > (`_airbyte_email_events_hashid`, `id`, `created`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_sentBy_hashid`) 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 09:28:18.480003 [debug] [Thread-5 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:18.481613 [info ] [Thread-5 ]: 8 of 8 OK created incremental model hubspot_test_email.email_events_location............................................ [MERGE (120.1k rows, 17.8 MB processed) in 9.06s] 2022-06-21 09:28:52 normalization > 09:28:18.482955 [debug] [Thread-5 ]: Finished running node model.airbyte_utils.email_events_location 2022-06-21 09:28:52 normalization > 09:28:19.310928 [debug] [Thread-2 ]: 2022-06-21 09:28:52 normalization > In `analytics-platform-201110`.`hubspot_test_email`.`email_events`: 2022-06-21 09:28:52 normalization > Schema changed: False 2022-06-21 09:28:52 normalization > Source columns not in target: [] 2022-06-21 09:28:52 normalization > Target columns not in source: [] 2022-06-21 09:28:52 normalization > New column types: [] 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 09:28:19.320623 [debug] [Thread-2 ]: Writing runtime SQL for node "model.airbyte_utils.email_events" 2022-06-21 09:28:52 normalization > 09:28:19.321783 [debug] [Thread-2 ]: On model.airbyte_utils.email_events: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.email_events"} */ 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > merge into `analytics-platform-201110`.hubspot_test_email.`email_events` as DBT_INTERNAL_DEST 2022-06-21 09:28:52 normalization > using ( 2022-06-21 09:28:52 normalization > select * from `analytics-platform-201110`.hubspot_test_email.`email_events__dbt_tmp` 2022-06-21 09:28:52 normalization > ) as DBT_INTERNAL_SOURCE 2022-06-21 09:28:52 normalization > on 2022-06-21 09:28:52 normalization > DBT_INTERNAL_SOURCE._airbyte_unique_key = DBT_INTERNAL_DEST._airbyte_unique_key 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > when matched then update set 2022-06-21 09:28:52 normalization > `_airbyte_unique_key` = DBT_INTERNAL_SOURCE.`_airbyte_unique_key`,`id` = DBT_INTERNAL_SOURCE.`id`,`url` = DBT_INTERNAL_SOURCE.`url`,`from` = DBT_INTERNAL_SOURCE.`from`,`hmid` = DBT_INTERNAL_SOURCE.`hmid`,`type` = DBT_INTERNAL_SOURCE.`type`,`appId` = DBT_INTERNAL_SOURCE.`appId`,`linkId` = DBT_INTERNAL_SOURCE.`linkId`,`sentBy` = DBT_INTERNAL_SOURCE.`sentBy`,`smtpId` = DBT_INTERNAL_SOURCE.`smtpId`,`source` = DBT_INTERNAL_SOURCE.`source`,`status` = DBT_INTERNAL_SOURCE.`status`,`appName` = DBT_INTERNAL_SOURCE.`appName`,`attempt` = DBT_INTERNAL_SOURCE.`attempt`,`bounced` = DBT_INTERNAL_SOURCE.`bounced`,`browser` = DBT_INTERNAL_SOURCE.`browser`,`created` = DBT_INTERNAL_SOURCE.`created`,`referer` = DBT_INTERNAL_SOURCE.`referer`,`replyTo` = DBT_INTERNAL_SOURCE.`replyTo`,`subject` = DBT_INTERNAL_SOURCE.`subject`,`category` = DBT_INTERNAL_SOURCE.`category`,`causedBy` = DBT_INTERNAL_SOURCE.`causedBy`,`duration` = DBT_INTERNAL_SOURCE.`duration`,`location` = DBT_INTERNAL_SOURCE.`location`,`portalId` = DBT_INTERNAL_SOURCE.`portalId`,`response` = DBT_INTERNAL_SOURCE.`response`,`sourceId` = DBT_INTERNAL_SOURCE.`sourceId`,`ipAddress` = DBT_INTERNAL_SOURCE.`ipAddress`,`recipient` = DBT_INTERNAL_SOURCE.`recipient`,`userAgent` = DBT_INTERNAL_SOURCE.`userAgent`,`deviceType` = DBT_INTERNAL_SOURCE.`deviceType`,`dropReason` = DBT_INTERNAL_SOURCE.`dropReason`,`dropMessage` = DBT_INTERNAL_SOURCE.`dropMessage`,`obsoletedBy` = DBT_INTERNAL_SOURCE.`obsoletedBy`,`requestedBy` = DBT_INTERNAL_SOURCE.`requestedBy`,`filteredEvent` = DBT_INTERNAL_SOURCE.`filteredEvent`,`emailCampaignId` = DBT_INTERNAL_SOURCE.`emailCampaignId`,`requestedByUserId` = DBT_INTERNAL_SOURCE.`requestedByUserId`,`emailCampaignGroupId` = DBT_INTERNAL_SOURCE.`emailCampaignGroupId`,`portalSubscriptionStatus` = DBT_INTERNAL_SOURCE.`portalSubscriptionStatus`,`_airbyte_ab_id` = DBT_INTERNAL_SOURCE.`_airbyte_ab_id`,`_airbyte_emitted_at` = DBT_INTERNAL_SOURCE.`_airbyte_emitted_at`,`_airbyte_normalized_at` = DBT_INTERNAL_SOURCE.`_airbyte_normalized_at`,`_airbyte_email_events_hashid` = DBT_INTERNAL_SOURCE.`_airbyte_email_events_hashid` 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > when not matched then insert 2022-06-21 09:28:52 normalization > (`_airbyte_unique_key`, `id`, `url`, `from`, `hmid`, `type`, `appId`, `linkId`, `sentBy`, `smtpId`, `source`, `status`, `appName`, `attempt`, `bounced`, `browser`, `created`, `referer`, `replyTo`, `subject`, `category`, `causedBy`, `duration`, `location`, `portalId`, `response`, `sourceId`, `ipAddress`, `recipient`, `userAgent`, `deviceType`, `dropReason`, `dropMessage`, `obsoletedBy`, `requestedBy`, `filteredEvent`, `emailCampaignId`, `requestedByUserId`, `emailCampaignGroupId`, `portalSubscriptionStatus`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_email_events_hashid`) 2022-06-21 09:28:52 normalization > values 2022-06-21 09:28:52 normalization > (`_airbyte_unique_key`, `id`, `url`, `from`, `hmid`, `type`, `appId`, `linkId`, `sentBy`, `smtpId`, `source`, `status`, `appName`, `attempt`, `bounced`, `browser`, `created`, `referer`, `replyTo`, `subject`, `category`, `causedBy`, `duration`, `location`, `portalId`, `response`, `sourceId`, `ipAddress`, `recipient`, `userAgent`, `deviceType`, `dropReason`, `dropMessage`, `obsoletedBy`, `requestedBy`, `filteredEvent`, `emailCampaignId`, `requestedByUserId`, `emailCampaignGroupId`, `portalSubscriptionStatus`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_email_events_hashid`) 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 2022-06-21 09:28:52 normalization > 09:28:21.626964 [debug] [Thread-8 ]: BigQuery adapter: Retry attempt 3 of 3 after error: BadRequest('Array cannot have a null element; error in writing field version') 2022-06-21 09:28:52 normalization > 09:28:23.648504 [debug] [Thread-1 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:23.650131 [info ] [Thread-1 ]: 6 of 8 OK created incremental model hubspot_test_email.email_events_sentBy.............................................. [MERGE (375.8k rows, 60.2 MB processed) in 14.28s] 2022-06-21 09:28:52 normalization > 09:28:23.651248 [debug] [Thread-1 ]: Finished running node model.airbyte_utils.email_events_sentBy 2022-06-21 09:28:52 normalization > 09:28:26.159107 [debug] [Thread-8 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:26.161270 [debug] [Thread-8 ]: Database Error in model email_events_browser (models/generated/airbyte_incremental/hubspot_test_email/email_events_browser.sql) 2022-06-21 09:28:52 normalization > Array cannot have a null element; error in writing field version 2022-06-21 09:28:52 normalization > compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_incremental/hubspot_test_email/email_events_browser.sql 2022-06-21 09:28:52 normalization > 09:28:26.162474 [error] [Thread-8 ]: 5 of 8 ERROR creating incremental model hubspot_test_email.email_events_browser......................................... [ERROR in 16.86s] 2022-06-21 09:28:52 normalization > 09:28:26.164373 [debug] [Thread-8 ]: Finished running node model.airbyte_utils.email_events_browser 2022-06-21 09:28:52 normalization > 09:28:41.656615 [debug] [Thread-2 ]: finished collecting timing info 2022-06-21 09:28:52 normalization > 09:28:41.658967 [info ] [Thread-2 ]: 3 of 8 OK created incremental model hubspot_test_email.email_events..................................................... [MERGE (378.9k rows, 355.7 MB processed) in 33.27s] 2022-06-21 09:28:52 normalization > 09:28:41.660385 [debug] [Thread-2 ]: Finished running node model.airbyte_utils.email_events 2022-06-21 09:28:52 normalization > 09:28:41.664072 [debug] [MainThread]: Acquiring new bigquery connection "master" 2022-06-21 09:28:52 normalization > 09:28:41.665447 [info ] [MainThread]: 2022-06-21 09:28:52 normalization > 09:28:41.666115 [info ] [MainThread]: Finished running 1 view model, 7 incremental models in 175.61s. 2022-06-21 09:28:52 normalization > 09:28:41.666753 [debug] [MainThread]: Connection 'master' was properly closed. 2022-06-21 09:28:52 normalization > 09:28:41.667077 [debug] [MainThread]: Connection 'model.airbyte_utils.email_events_sentBy' was properly closed. 2022-06-21 09:28:52 normalization > 09:28:41.667331 [debug] [MainThread]: Connection 'model.airbyte_utils.email_events' was properly closed. 2022-06-21 09:28:52 normalization > 09:28:41.667579 [debug] [MainThread]: Connection 'model.airbyte_utils.email_events_obsoletedBy' was properly closed. 2022-06-21 09:28:52 normalization > 09:28:41.667823 [debug] [MainThread]: Connection 'model.airbyte_utils.email_events_location' was properly closed. 2022-06-21 09:28:52 normalization > 09:28:41.668062 [debug] [MainThread]: Connection 'model.airbyte_utils.email_events_location_ab3' was properly closed. 2022-06-21 09:28:52 normalization > 09:28:41.668302 [debug] [MainThread]: Connection 'model.airbyte_utils.email_events_browser_ab2' was properly closed. 2022-06-21 09:28:52 normalization > 09:28:41.668542 [debug] [MainThread]: Connection 'model.airbyte_utils.email_events_causedBy' was properly closed. 2022-06-21 09:28:52 normalization > 09:28:41.668834 [debug] [MainThread]: Connection 'model.airbyte_utils.email_events_browser' was properly closed. 2022-06-21 09:28:52 normalization > 09:28:41.702102 [info ] [MainThread]: 2022-06-21 09:28:52 normalization > 09:28:41.702739 [info ] [MainThread]: Completed with 1 error and 0 warnings: 2022-06-21 09:28:52 normalization > 09:28:41.703880 [info ] [MainThread]: 2022-06-21 09:28:52 normalization > 09:28:41.704709 [error] [MainThread]: Database Error in model email_events_browser (models/generated/airbyte_incremental/hubspot_test_email/email_events_browser.sql) 2022-06-21 09:28:52 normalization > 09:28:41.705611 [error] [MainThread]: Array cannot have a null element; error in writing field version 2022-06-21 09:28:52 normalization > 09:28:41.706372 [error] [MainThread]: compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_incremental/hubspot_test_email/email_events_browser.sql 2022-06-21 09:28:52 normalization > 09:28:41.707057 [info ] [MainThread]: 2022-06-21 09:28:52 normalization > 09:28:41.707624 [info ] [MainThread]: Done. PASS=7 WARN=0 ERROR=1 SKIP=0 TOTAL=8 2022-06-21 09:28:52 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):161 - Completing future exceptionally... io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:63) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:60) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] ... 3 more Suppressed: io.airbyte.workers.exception.WorkerException: Normalization process wasn't successful at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:162) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:48) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] 2022-06-21 09:28:52 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-06-21 09:28:52 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):237 - Stopping temporal heartbeating... 2022-06-21 09:28:52 WARN i.t.i.a.POJOActivityTaskHandler(activityFailureToResult):307 - Activity failure. ActivityId=e77a2593-d3b5-3871-8850-64939d12c22d, activityType=Normalize, attempt=1 java.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:235) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.normalize(NormalizationActivityImpl.java:75) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at jdk.internal.reflect.GeneratedMethodAccessor429.invoke(Unknown Source) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:214) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:180) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:120) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:204) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:164) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.8.1.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.temporal.serviceclient.CheckedExceptionWrapper.wrap(CheckedExceptionWrapper.java:56) ~[temporal-serviceclient-1.8.1.jar:?] at io.temporal.internal.sync.WorkflowInternal.wrap(WorkflowInternal.java:448) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.activity.Activity.wrap(Activity.java:51) ~[temporal-sdk-1.8.1.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:138) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:103) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:230) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] ... 13 more Caused by: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed. at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:132) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:103) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:230) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] ... 13 more Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:63) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:60) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] ... 1 more Suppressed: io.airbyte.workers.exception.WorkerException: Normalization process wasn't successful at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:162) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:48) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.20-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] 2022-06-21 09:28:53 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.client_id: is missing but it is required, $.client_secret: is missing but it is required, $.refresh_token: is missing but it is required, $.credentials_title: must be a constant value OAuth Credentials 2022-06-21 09:28:53 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.api_key: object found, string expected 2022-06-21 09:28:53 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/34/2/logs.log 2022-06-21 09:28:53 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.20-alpha 2022-06-21 09:28:53 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-hubspot:0.1.70 exists... 2022-06-21 09:28:53 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-hubspot:0.1.70 was found locally. 2022-06-21 09:28:53 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 34 2022-06-21 09:28:53 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/34/2 --log-driver none --name source-hubspot-check-34-2-pacfp --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_JOB_ATTEMPT=2 -e WORKER_CONNECTOR_IMAGE=airbyte/source-hubspot:0.1.70 -e AIRBYTE_VERSION=0.39.20-alpha -e WORKER_JOB_ID=34 airbyte/source-hubspot:0.1.70 check --config source_config.json 2022-06-21 09:28:58 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):97 - Check succeeded 2022-06-21 09:28:58 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-06-21 09:28:58 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/34/2/logs.log 2022-06-21 09:28:58 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.20-alpha 2022-06-21 09:28:58 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:1.1.8 exists... 2022-06-21 09:28:58 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:1.1.8 was found locally. 2022-06-21 09:28:58 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 34 2022-06-21 09:28:58 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/34/2 --log-driver none --name destination-bigquery-check-34-2-xlnre --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_JOB_ATTEMPT=2 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.1.8 -e AIRBYTE_VERSION=0.39.20-alpha -e WORKER_JOB_ID=34 airbyte/destination-bigquery:1.1.8 check --config source_config.json 2022-06-21 09:29:00 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Class path contains multiple SLF4J bindings. 2022-06-21 09:29:00 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-06-21 09:29:00 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-06-21 09:29:00 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-06-21 09:29:00 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-06-21 09:29:00 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-06-21 09:29:03 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-21 09:29:03 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2022-06-21 09:29:03 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-21 09:29:03 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-06-21 09:29:03 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-21 09:29:03 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK 2022-06-21 09:29:03 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-21 09:29:03 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-06-21 09:29:03 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-21 09:29:03 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-06-21 09:29:03 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-21 09:29:03 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-06-21 09:29:03 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-21 09:29:03 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-06-21 09:29:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-21 09:29:04 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):306 - Selected loading method is set to: STANDARD 2022-06-21 09:29:08 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-06-21 09:29:08 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/34/2/logs.log 2022-06-21 09:29:08 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.20-alpha 2022-06-21 09:29:08 INFO i.a.w.g.DefaultReplicationWorker(run):115 - start sync worker. job id: 34 attempt id: 2 2022-06-21 09:29:08 INFO i.a.w.g.DefaultReplicationWorker(run):127 - configured sync modes: {null.email_events=incremental - append_dedup} 2022-06-21 09:29:08 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination... 2022-06-21 09:29:08 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:1.1.8 exists... 2022-06-21 09:29:09 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:1.1.8 was found locally. 2022-06-21 09:29:09 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 34 2022-06-21 09:29:09 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/34/2 --log-driver none --name destination-bigquery-write-34-2-mvmlh --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_JOB_ATTEMPT=2 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.1.8 -e AIRBYTE_VERSION=0.39.20-alpha -e WORKER_JOB_ID=34 airbyte/destination-bigquery:1.1.8 write --config destination_config.json --catalog destination_catalog.json 2022-06-21 09:29:09 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-hubspot:0.1.70 exists... 2022-06-21 09:29:09 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-hubspot:0.1.70 was found locally. 2022-06-21 09:29:09 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 34 2022-06-21 09:29:09 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/34/2 --log-driver none --name source-hubspot-read-34-2-hmcdf --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_JOB_ATTEMPT=2 -e WORKER_CONNECTOR_IMAGE=airbyte/source-hubspot:0.1.70 -e AIRBYTE_VERSION=0.39.20-alpha -e WORKER_JOB_ID=34 airbyte/source-hubspot:0.1.70 read --config source_config.json --catalog source_catalog.json 2022-06-21 09:29:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):395 - Destination output thread started. 2022-06-21 09:29:09 INFO i.a.w.g.DefaultReplicationWorker(run):169 - Waiting for source and destination threads to complete. 2022-06-21 09:29:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):298 - Replication thread started. 2022-06-21 09:29:11 destination > SLF4J: Class path contains multiple SLF4J bindings. 2022-06-21 09:29:11 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-06-21 09:29:11 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-06-21 09:29:11 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-06-21 09:29:11 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-06-21 09:29:12 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-06-21 09:29:14 source > Starting syncing SourceHubspot 2022-06-21 09:29:14 source > No scopes to grant when authenticating with API key. 2022-06-21 09:29:14 source > Syncing stream: email_events 2022-06-21 09:29:15 destination > 2022-06-21 09:29:15 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-06-21 09:29:15 destination > 2022-06-21 09:29:15 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-06-21 09:29:15 destination > 2022-06-21 09:29:15 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: WRITE 2022-06-21 09:29:15 destination > 2022-06-21 09:29:15 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-06-21 09:29:15 destination > 2022-06-21 09:29:15 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-06-21 09:29:15 destination > 2022-06-21 09:29:15 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-06-21 09:29:15 destination > 2022-06-21 09:29:15 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-06-21 09:29:15 destination > 2022-06-21 09:29:15 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):306 - Selected loading method is set to: STANDARD 2022-06-21 09:29:15 destination > 2022-06-21 09:29:15 WARN i.a.i.d.b.BigQueryDestination(getConsumer):197 - The "standard" upload mode is not performant, and is not recommended for production. Please use the GCS upload mode if you are syncing a large amount of data. 2022-06-21 09:29:16 destination > 2022-06-21 09:29:16 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):306 - Selected loading method is set to: STANDARD 2022-06-21 09:29:19 destination > 2022-06-21 09:29:19 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=hubspot_test_email, tableId=_airbyte_tmp_jkl_email_events}} 2022-06-21 09:29:24 source > Advancing bookmark for email_events stream from 2017-01-25T00:00:00+00:00 to 2019-07-22T23:00:17.728000+00:00 2022-06-21 09:29:25 source > Advancing bookmark for email_events stream from 2019-07-22T23:00:17.728000+00:00 to 2019-09-11T23:39:14.504000+00:00 2022-06-21 09:29:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 1000 (467 KB) 2022-06-21 09:29:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 2000 (968 KB) 2022-06-21 09:29:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 3000 (1 MB) 2022-06-21 09:29:33 source > Advancing bookmark for email_events stream from 2019-09-11T23:39:14.504000+00:00 to 2019-10-11T09:15:51.192000+00:00 2022-06-21 09:29:34 source > Advancing bookmark for email_events stream from 2019-10-11T09:15:51.192000+00:00 to 2019-11-08T02:14:41.600000+00:00 2022-06-21 09:29:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 4000 (1 MB) 2022-06-21 09:29:35 source > Advancing bookmark for email_events stream from 2019-11-08T02:14:41.600000+00:00 to 2019-12-10T04:04:46.135000+00:00 2022-06-21 09:29:36 source > Advancing bookmark for email_events stream from 2019-12-10T04:04:46.135000+00:00 to 2019-12-27T06:35:55.220000+00:00 2022-06-21 09:29:36 source > Advancing bookmark for email_events stream from 2019-12-27T06:35:55.220000+00:00 to 2020-02-08T11:42:51.286000+00:00 2022-06-21 09:29:37 source > Advancing bookmark for email_events stream from 2020-02-08T11:42:51.286000+00:00 to 2020-02-27T00:10:16.164000+00:00 2022-06-21 09:29:37 source > Advancing bookmark for email_events stream from 2020-02-27T00:10:16.164000+00:00 to 2020-03-31T07:43:59.762000+00:00 2022-06-21 09:29:38 source > Advancing bookmark for email_events stream from 2020-03-31T07:43:59.762000+00:00 to 2020-05-02T02:40:35.965000+00:00 2022-06-21 09:29:38 source > Advancing bookmark for email_events stream from 2020-05-02T02:40:35.965000+00:00 to 2020-06-06T23:53:26.866000+00:00 2022-06-21 09:29:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 5000 (2 MB) 2022-06-21 09:29:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 6000 (2 MB) 2022-06-21 09:29:41 source > Advancing bookmark for email_events stream from 2020-06-06T23:53:26.866000+00:00 to 2020-07-07T07:25:05.289000+00:00 2022-06-21 09:29:42 source > Advancing bookmark for email_events stream from 2020-07-07T07:25:05.289000+00:00 to 2020-08-06T12:52:08.518000+00:00 2022-06-21 09:29:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 7000 (3 MB) 2022-06-21 09:29:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 8000 (4 MB) 2022-06-21 09:29:46 source > Advancing bookmark for email_events stream from 2020-08-06T12:52:08.518000+00:00 to 2020-09-05T22:51:07.628000+00:00 2022-06-21 09:29:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 9000 (4 MB) 2022-06-21 09:29:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 10000 (5 MB) 2022-06-21 09:29:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 11000 (5 MB) 2022-06-21 09:29:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 12000 (6 MB) 2022-06-21 09:29:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 13000 (6 MB) 2022-06-21 09:29:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 14000 (7 MB) 2022-06-21 09:29:58 source > Advancing bookmark for email_events stream from 2020-09-05T22:51:07.628000+00:00 to 2020-10-05T14:23:34.722000+00:00 2022-06-21 09:29:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 15000 (8 MB) 2022-06-21 09:30:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 16000 (8 MB) 2022-06-21 09:30:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 17000 (9 MB) 2022-06-21 09:30:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 18000 (9 MB) 2022-06-21 09:30:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 19000 (10 MB) 2022-06-21 09:30:10 source > Advancing bookmark for email_events stream from 2020-10-05T14:23:34.722000+00:00 to 2020-11-04T23:44:38.787000+00:00 2022-06-21 09:30:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 20000 (10 MB) 2022-06-21 09:30:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 21000 (11 MB) 2022-06-21 09:30:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 22000 (11 MB) 2022-06-21 09:30:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 23000 (12 MB) 2022-06-21 09:30:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 24000 (13 MB) 2022-06-21 09:30:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 25000 (13 MB) 2022-06-21 09:30:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 26000 (14 MB) 2022-06-21 09:30:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 27000 (14 MB) 2022-06-21 09:30:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 28000 (15 MB) 2022-06-21 09:30:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 29000 (15 MB) 2022-06-21 09:30:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 30000 (16 MB) 2022-06-21 09:30:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):344 - Records read: 31000 (16 MB)