2023-03-18 18:20:01 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to get state 2023-03-18 18:20:01 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to set attempt sync config 2023-03-18 18:20:01 INFO i.a.v.j.JsonSchemaValidator(test):129 - JSON schema validation failed. errors: $.auth_type: must be a constant value OAuth2.0, $.auth_type: does not have a value in the enumeration [OAuth2.0], $.access_token: is missing but it is required, $.refresh_token: is missing but it is required 2023-03-18 18:20:01 INFO i.a.v.j.JsonSchemaValidator(test):129 - JSON schema validation failed. errors: $.auth_type: must be a constant value Key Pair Authentication, $.auth_type: does not have a value in the enumeration [Key Pair Authentication], $.private_key: is missing but it is required 2023-03-18 18:20:01 INFO i.a.v.j.JsonSchemaValidator(test):129 - JSON schema validation failed. errors: $.password: object found, string expected 2023-03-18 18:20:01 INFO i.a.v.j.JsonSchemaValidator(test):129 - JSON schema validation failed. errors: $.method: does not have a value in the enumeration [Standard] 2023-03-18 18:20:02 INFO i.a.w.t.TemporalAttemptExecution(get):142 - Docker volume job log path: /tmp/workspace/12/0/logs.log 2023-03-18 18:20:02 INFO i.a.w.t.TemporalAttemptExecution(get):147 - Executing worker wrapper. Airbyte version: 0.42.0 2023-03-18 18:20:02 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to save workflow id for cancellation 2023-03-18 18:20:02 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable METRIC_CLIENT: '' 2023-03-18 18:20:02 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2023-03-18 18:20:02 INFO i.a.w.g.DefaultReplicationWorker(run):164 - start sync worker. job id: 12 attempt id: 0 2023-03-18 18:20:02 INFO i.a.w.g.DefaultReplicationWorker(run):166 - Committing states from persistState activity 2023-03-18 18:20:02 INFO i.a.w.g.DefaultReplicationWorker(run):182 - configured sync modes: {null.events=incremental - append_dedup} 2023-03-18 18:20:02 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 18:20:02 INFO i.a.w.i.DefaultAirbyteDestination(start):87 - Running destination... 2023-03-18 18:20:02 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START REPLICATION ----- 2023-03-18 18:20:02 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 18:20:02 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-03-18 18:20:02 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-03-18 18:20:02 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-03-18 18:20:02 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-03-18 18:20:02 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-03-18 18:20:02 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-03-18 18:20:02 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/destination-snowflake:0.4.52 exists... 2023-03-18 18:20:02 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/destination-snowflake:0.4.52 was found locally. 2023-03-18 18:20:02 INFO i.a.w.p.DockerProcessFactory(create):130 - Creating docker container = destination-snowflake-write-12-0-jshdm with resources io.airbyte.config.ResourceRequirements@764e4b9b[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] and allowedHosts null 2023-03-18 18:20:02 INFO i.a.w.p.DockerProcessFactory(create):175 - Preparing command: docker run --rm --init -i -w /data/12/0 --log-driver none --name destination-snowflake-write-12-0-jshdm --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e STRICT_COMPARISON_NORMALIZATION_WORKSPACES= -e WORKER_CONNECTOR_IMAGE=airbyte/destination-snowflake:0.4.52 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e STRICT_COMPARISON_NORMALIZATION_TAG=strict_comparison2 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=0 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.42.0 -e WORKER_JOB_ID=12 airbyte/destination-snowflake:0.4.52 write --config destination_config.json --catalog destination_catalog.json 2023-03-18 18:20:02 INFO i.a.w.i.VersionedAirbyteMessageBufferedWriterFactory(createWriter):41 - Writing messages to protocol version 0.2.0 2023-03-18 18:20:02 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):107 - Reading messages from protocol version 0.2.0 2023-03-18 18:20:02 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-03-18 18:20:02 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-03-18 18:20:02 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-03-18 18:20:02 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-03-18 18:20:02 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-03-18 18:20:02 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-03-18 18:20:02 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/source-posthog:0.1.8 exists... 2023-03-18 18:20:02 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/source-posthog:0.1.8 was found locally. 2023-03-18 18:20:02 INFO i.a.w.p.DockerProcessFactory(create):130 - Creating docker container = source-posthog-read-12-0-kbgeg with resources io.airbyte.config.ResourceRequirements@5d76468c[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] and allowedHosts io.airbyte.config.AllowedHosts@4285f02f[hosts=[https://app.posthog.com, app.posthog.com, *.datadoghq.com, *.datadoghq.eu, *.sentry.io],additionalProperties={}] 2023-03-18 18:20:02 INFO i.a.w.p.DockerProcessFactory(create):175 - Preparing command: docker run --rm --init -i -w /data/12/0 --log-driver none --name source-posthog-read-12-0-kbgeg --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e STRICT_COMPARISON_NORMALIZATION_WORKSPACES= -e WORKER_CONNECTOR_IMAGE=airbyte/source-posthog:0.1.8 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e STRICT_COMPARISON_NORMALIZATION_TAG=strict_comparison2 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=0 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.42.0 -e WORKER_JOB_ID=12 airbyte/source-posthog:0.1.8 read --config source_config.json --catalog source_catalog.json --state input_state.json 2023-03-18 18:20:02 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):107 - Reading messages from protocol version 0.2.0 2023-03-18 18:20:02 INFO i.a.w.g.DefaultReplicationWorker(replicate):268 - Waiting for source and destination threads to complete. 2023-03-18 18:20:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):377 - Replication thread started. 2023-03-18 18:20:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromDstRunnable$4):312 - Destination output thread started. 2023-03-18 18:20:04 destination > INFO i.a.i.b.a.AdaptiveDestinationRunner$Runner(getDestination):74 Running destination under deployment mode: OSS 2023-03-18 18:20:04 destination > INFO i.a.i.b.a.AdaptiveDestinationRunner$Runner(run):86 Starting destination: io.airbyte.integrations.destination.snowflake.SnowflakeDestination 2023-03-18 18:20:04 destination > INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2023-03-18 18:20:04 destination > INFO i.a.i.b.IntegrationRunner(runInternal):105 Running integration: io.airbyte.integrations.destination.snowflake.SnowflakeDestination 2023-03-18 18:20:04 destination > INFO i.a.i.b.IntegrationRunner(runInternal):106 Command: WRITE 2023-03-18 18:20:04 destination > INFO i.a.i.b.IntegrationRunner(runInternal):107 Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2023-03-18 18:20:04 source > Starting syncing SourcePosthog 2023-03-18 18:20:04 source > Syncing stream: events 2023-03-18 18:20:04 source > Setting state of events stream to {'13967': {'timestamp': '2022-09-26T23:59:58.151000+00:00'}} 2023-03-18 18:20:04 destination > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-03-18 18:20:04 destination > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-03-18 18:20:04 destination > INFO i.a.i.d.j.c.SwitchingDestination(getConsumer):65 Using destination type: INTERNAL_STAGING 2023-03-18 18:20:05 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$toWriteConfig$0):121 Write config: WriteConfig{streamName=events, namespace=null, outputSchemaName=POSTHOG_PROD_SCHEMA, tmpTableName=_airbyte_tmp_xbz_events, outputTableName=_airbyte_raw_events, syncMode=append_dedup} 2023-03-18 18:20:05 destination > INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):146 class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2023-03-18 18:20:05 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$onStartFunction$1):139 Preparing raw tables in destination started for 1 streams 2023-03-18 18:20:05 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$onStartFunction$1):148 Preparing staging area in destination started for schema POSTHOG_PROD_SCHEMA stream events: target table: _airbyte_raw_events, stage: 2023/03/18/18/67D68349-1084-4BBD-A198-A223D57CAB28/ 2023-03-18 18:20:05 destination > INFO c.z.h.HikariDataSource(getConnection):110 HikariPool-1 - Starting... 2023-03-18 18:20:07 destination > INFO c.z.h.p.HikariPool(checkFailFast):565 HikariPool-1 - Added connection net.snowflake.client.jdbc.SnowflakeConnectionV1@3ddeaa5f 2023-03-18 18:20:07 destination > INFO c.z.h.HikariDataSource(getConnection):123 HikariPool-1 - Start completed. 2023-03-18 18:20:07 destination > INFO i.a.d.j.DefaultJdbcDatabase(lambda$unsafeQuery$1):115 closing connection 2023-03-18 18:20:08 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$onStartFunction$1):165 Preparing staging area in destination completed for schema POSTHOG_PROD_SCHEMA stream events 2023-03-18 18:20:08 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$onStartFunction$1):167 Executing finalization of tables. 2023-03-18 18:20:12 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$addRecord$0):76 Starting a new buffer for stream events (current state: 0 bytes in 0 buffers) 2023-03-18 18:20:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 1000 (6 MB) 2023-03-18 18:20:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 2000 (13 MB) 2023-03-18 18:20:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 3000 (20 MB) 2023-03-18 18:21:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 4000 (26 MB) 2023-03-18 18:21:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 5000 (32 MB) 2023-03-18 18:21:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 6000 (38 MB) 2023-03-18 18:21:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 7000 (45 MB) 2023-03-18 18:21:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 8000 (50 MB) 2023-03-18 18:22:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 9000 (56 MB) 2023-03-18 18:22:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 10000 (61 MB) 2023-03-18 18:22:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 11000 (67 MB) 2023-03-18 18:22:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 12000 (73 MB) 2023-03-18 18:23:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 13000 (79 MB) 2023-03-18 18:23:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 14000 (85 MB) 2023-03-18 18:23:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 15000 (91 MB) 2023-03-18 18:23:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 16000 (97 MB) 2023-03-18 18:24:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 17000 (104 MB) 2023-03-18 18:24:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 18000 (110 MB) 2023-03-18 18:24:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 19000 (116 MB) 2023-03-18 18:24:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 20000 (123 MB) 2023-03-18 18:25:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 21000 (129 MB) 2023-03-18 18:25:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 22000 (136 MB) 2023-03-18 18:25:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 23000 (142 MB) 2023-03-18 18:25:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 24000 (149 MB) 2023-03-18 18:25:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 25000 (154 MB) 2023-03-18 18:26:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 26000 (161 MB) 2023-03-18 18:26:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 27000 (167 MB) 2023-03-18 18:26:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 28000 (173 MB) 2023-03-18 18:27:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 29000 (179 MB) 2023-03-18 18:27:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 30000 (185 MB) 2023-03-18 18:27:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 31000 (191 MB) 2023-03-18 18:28:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 32000 (197 MB) 2023-03-18 18:28:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 33000 (204 MB) 2023-03-18 18:28:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 34000 (209 MB) 2023-03-18 18:28:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 35000 (215 MB) 2023-03-18 18:29:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 36000 (221 MB) 2023-03-18 18:29:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 37000 (227 MB) 2023-03-18 18:29:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 38000 (233 MB) 2023-03-18 18:29:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 39000 (239 MB) 2023-03-18 18:29:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 40000 (245 MB) 2023-03-18 18:30:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 41000 (252 MB) 2023-03-18 18:30:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 42000 (259 MB) 2023-03-18 18:30:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 43000 (265 MB) 2023-03-18 18:30:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 44000 (271 MB) 2023-03-18 18:31:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 45000 (277 MB) 2023-03-18 18:31:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 46000 (282 MB) 2023-03-18 18:31:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 47000 (288 MB) 2023-03-18 18:31:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 48000 (294 MB) 2023-03-18 18:31:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 49000 (301 MB) 2023-03-18 18:32:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 50000 (306 MB) 2023-03-18 18:32:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 51000 (313 MB) 2023-03-18 18:33:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 52000 (319 MB) 2023-03-18 18:33:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 53000 (325 MB) 2023-03-18 18:33:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 54000 (331 MB) 2023-03-18 18:33:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 55000 (338 MB) 2023-03-18 18:34:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 56000 (344 MB) 2023-03-18 18:34:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 57000 (351 MB) 2023-03-18 18:34:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 58000 (357 MB) 2023-03-18 18:34:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 59000 (363 MB) 2023-03-18 18:34:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 60000 (369 MB) 2023-03-18 18:35:05 destination > INFO i.a.i.d.b.BufferedStreamConsumer(periodicBufferFlush):220 Periodic buffer flush started 2023-03-18 18:35:05 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(flushAll):130 Flushing all 1 current buffers (26 MB in total) 2023-03-18 18:35:05 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(flushAll):132 Flushing buffer of stream events (26 MB) 2023-03-18 18:35:05 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$flushBufferFunction$3):211 Flushing buffer for stream events (26 MB) to staging 2023-03-18 18:35:05 destination > INFO i.a.i.d.r.BaseSerializedBuffer(flush):131 Wrapping up compression and write GZIP trailer data. 2023-03-18 18:35:05 destination > INFO i.a.i.d.r.BaseSerializedBuffer(flush):138 Finished writing data to 6b69c43f-c34c-485e-bb5e-4c99a634735215838481245951059348.csv.gz (26 MB) 2023-03-18 18:35:16 destination > INFO i.a.d.j.DefaultJdbcDatabase(lambda$unsafeQuery$1):115 closing connection 2023-03-18 18:35:16 destination > INFO i.a.i.d.s.SnowflakeInternalStagingSqlOperations(uploadRecordsToStage):87 Successfully loaded records to stage 2023/03/18/18/67D68349-1084-4BBD-A198-A223D57CAB28/ with 0 re-attempt(s) 2023-03-18 18:35:39 destination > INFO i.a.i.d.r.FileBuffer(deleteFile):109 Deleting tempFile data 6b69c43f-c34c-485e-bb5e-4c99a634735215838481245951059348.csv.gz 2023-03-18 18:35:39 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(flushAll):134 Flushing completed for events 2023-03-18 18:35:39 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(close):152 Closing buffer for stream events 2023-03-18 18:35:39 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$addRecord$0):76 Starting a new buffer for stream events (current state: 0 bytes in 0 buffers) 2023-03-18 18:35:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 61000 (376 MB) 2023-03-18 18:35:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 62000 (382 MB) 2023-03-18 18:36:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 63000 (389 MB) 2023-03-18 18:36:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 64000 (395 MB) 2023-03-18 18:36:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 65000 (401 MB) 2023-03-18 18:36:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 66000 (407 MB) 2023-03-18 18:37:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 67000 (413 MB) 2023-03-18 18:37:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 68000 (419 MB) 2023-03-18 18:37:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 69000 (426 MB) 2023-03-18 18:37:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 70000 (432 MB) 2023-03-18 18:37:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 71000 (438 MB) 2023-03-18 18:38:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 72000 (444 MB) 2023-03-18 18:38:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 73000 (450 MB) 2023-03-18 18:38:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 74000 (456 MB) 2023-03-18 18:38:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 75000 (462 MB) 2023-03-18 18:39:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 76000 (468 MB) 2023-03-18 18:39:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 77000 (473 MB) 2023-03-18 18:39:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 78000 (480 MB) 2023-03-18 18:39:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 79000 (486 MB) 2023-03-18 18:39:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 80000 (491 MB) 2023-03-18 18:40:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 81000 (498 MB) 2023-03-18 18:40:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 82000 (503 MB) 2023-03-18 18:40:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 83000 (509 MB) 2023-03-18 18:40:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 84000 (514 MB) 2023-03-18 18:40:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 85000 (521 MB) 2023-03-18 18:41:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 86000 (527 MB) 2023-03-18 18:41:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 87000 (533 MB) 2023-03-18 18:41:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 88000 (539 MB) 2023-03-18 18:41:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 89000 (545 MB) 2023-03-18 18:41:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 90000 (551 MB) 2023-03-18 18:42:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 91000 (557 MB) 2023-03-18 18:42:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 92000 (563 MB) 2023-03-18 18:42:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 93000 (570 MB) 2023-03-18 18:42:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 94000 (575 MB) 2023-03-18 18:43:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 95000 (581 MB) 2023-03-18 18:43:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 96000 (588 MB) 2023-03-18 18:43:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 97000 (594 MB) 2023-03-18 18:43:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 98000 (601 MB) 2023-03-18 18:43:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 99000 (607 MB) 2023-03-18 18:44:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 100000 (613 MB) 2023-03-18 18:44:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 101000 (620 MB) 2023-03-18 18:44:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 102000 (626 MB) 2023-03-18 18:44:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 103000 (633 MB) 2023-03-18 18:45:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 104000 (640 MB) 2023-03-18 18:45:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 105000 (646 MB) 2023-03-18 18:45:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 106000 (653 MB) 2023-03-18 18:45:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 107000 (659 MB) 2023-03-18 18:45:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 108000 (665 MB) 2023-03-18 18:46:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 109000 (671 MB) 2023-03-18 18:46:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 110000 (678 MB) 2023-03-18 18:46:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 111000 (684 MB) 2023-03-18 18:46:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 112000 (690 MB) 2023-03-18 18:46:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 113000 (697 MB) 2023-03-18 18:47:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 114000 (703 MB) 2023-03-18 18:47:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 115000 (710 MB) 2023-03-18 18:47:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 116000 (716 MB) 2023-03-18 18:47:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 117000 (723 MB) 2023-03-18 18:47:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 118000 (729 MB) 2023-03-18 18:48:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 119000 (735 MB) 2023-03-18 18:48:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):430 - Records read: 120000 (742 MB) 2023-03-18 18:48:22 source > Backing off _send(...) for 0.0s (airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-23T05%3A25%3A27.938000%2B00%3A00&limit=100, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 1905 seconds.","attr":null}) 2023-03-18 18:48:22 source > Retrying. Sleeping for 10 seconds 2023-03-18 18:48:33 source > Backing off _send(...) for 0.0s (airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-23T05%3A25%3A27.938000%2B00%3A00&limit=100, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 1893 seconds.","attr":null}) 2023-03-18 18:48:33 source > Retrying. Sleeping for 20 seconds 2023-03-18 18:48:55 source > Backing off _send(...) for 0.0s (airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-23T05%3A25%3A27.938000%2B00%3A00&limit=100, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 1872 seconds.","attr":null}) 2023-03-18 18:48:55 source > Retrying. Sleeping for 40 seconds 2023-03-18 18:49:36 source > Backing off _send(...) for 0.0s (airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-23T05%3A25%3A27.938000%2B00%3A00&limit=100, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 1831 seconds.","attr":null}) 2023-03-18 18:49:36 source > Retrying. Sleeping for 80 seconds 2023-03-18 18:50:57 source > Backing off _send(...) for 0.0s (airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-23T05%3A25%3A27.938000%2B00%3A00&limit=100, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 1749 seconds.","attr":null}) 2023-03-18 18:50:57 source > Retrying. Sleeping for 160 seconds 2023-03-18 18:53:39 source > Giving up _send(...) after 6 tries (airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-23T05%3A25%3A27.938000%2B00%3A00&limit=100, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 1588 seconds.","attr":null}) 2023-03-18 18:53:39 source > Max retry limit reached. Request: , Response: 2023-03-18 18:53:39 source > Encountered an exception while reading stream events Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 111, in read yield from self._read_stream( File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 180, in _read_stream for record in record_iterator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 243, in _read_incremental for message_counter, record_data_or_message in enumerate(records, start=1): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/declarative_stream.py", line 115, in read_records for record in self.retriever.read_records(sync_mode, cursor_field, stream_slice, stream_state): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/retrievers/simple_retriever.py", line 374, in read_records for record in records_generator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 429, in _read_pages request, response = self._fetch_next_page(stream_slice, stream_state, next_page_token) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 452, in _fetch_next_page response = self._send_request(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 354, in _send_request return backoff_handler(user_backoff_handler)(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 310, in _send raise UserDefinedBackoffException( airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-23T05%3A25%3A27.938000%2B00%3A00&limit=100, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 1588 seconds.","attr":null} 2023-03-18 18:53:39 source > Finished syncing events 2023-03-18 18:53:39 source > SourcePosthog runtimes: Syncing stream events 0:33:34.535708 2023-03-18 18:53:39 source > Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-23T05%3A25%3A27.938000%2B00%3A00&limit=100, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 1588 seconds.","attr":null} Traceback (most recent call last): File "/airbyte/integration_code/main.py", line 13, in launch(source, sys.argv[1:]) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 131, in launch for message in source_entrypoint.run(parsed_args): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 122, in run for message in generator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/manifest_declarative_source.py", line 112, in read yield from super().read(logger, config, catalog, state) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 125, in read raise e File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 111, in read yield from self._read_stream( File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 180, in _read_stream for record in record_iterator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 243, in _read_incremental for message_counter, record_data_or_message in enumerate(records, start=1): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/declarative_stream.py", line 115, in read_records for record in self.retriever.read_records(sync_mode, cursor_field, stream_slice, stream_state): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/retrievers/simple_retriever.py", line 374, in read_records for record in records_generator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 429, in _read_pages request, response = self._fetch_next_page(stream_slice, stream_state, next_page_token) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 452, in _fetch_next_page response = self._send_request(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 354, in _send_request return backoff_handler(user_backoff_handler)(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 310, in _send raise UserDefinedBackoffException( airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-23T05%3A25%3A27.938000%2B00%3A00&limit=100, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 1588 seconds.","attr":null} 2023-03-18 18:53:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):433 - Source has no more messages, closing connection. 2023-03-18 18:53:39 destination > INFO i.a.i.d.b.BufferedStreamConsumer(periodicBufferFlush):220 Periodic buffer flush started 2023-03-18 18:53:39 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(flushAll):130 Flushing all 1 current buffers (25 MB in total) 2023-03-18 18:53:39 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(flushAll):132 Flushing buffer of stream events (25 MB) 2023-03-18 18:53:39 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$flushBufferFunction$3):211 Flushing buffer for stream events (25 MB) to staging 2023-03-18 18:53:39 destination > INFO i.a.i.d.r.BaseSerializedBuffer(flush):131 Wrapping up compression and write GZIP trailer data. 2023-03-18 18:53:39 destination > INFO i.a.i.d.r.BaseSerializedBuffer(flush):138 Finished writing data to 81bfb697-ec08-45c5-b839-7e2f5a740ad81113055324917303090.csv.gz (25 MB) 2023-03-18 18:53:48 destination > INFO i.a.d.j.DefaultJdbcDatabase(lambda$unsafeQuery$1):115 closing connection 2023-03-18 18:53:48 destination > INFO i.a.i.d.s.SnowflakeInternalStagingSqlOperations(uploadRecordsToStage):87 Successfully loaded records to stage 2023/03/18/18/67D68349-1084-4BBD-A198-A223D57CAB28/ with 0 re-attempt(s) 2023-03-18 18:54:11 destination > INFO i.a.i.d.r.FileBuffer(deleteFile):109 Deleting tempFile data 81bfb697-ec08-45c5-b839-7e2f5a740ad81113055324917303090.csv.gz 2023-03-18 18:54:12 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(flushAll):134 Flushing completed for events 2023-03-18 18:54:12 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(close):152 Closing buffer for stream events 2023-03-18 18:54:12 destination > WARN i.a.i.b.IntegrationRunner(watchForOrphanThreads):245 The main thread is exiting while children non-daemon threads from a connector are still active. Ideally, this situation should not happen... Please check with maintainers if the connector or library code should safely clean up its threads before quitting instead. The main thread is: main (RUNNABLE) Thread stacktrace: java.base/java.lang.Thread.getStackTrace(Thread.java:1610) at io.airbyte.integrations.base.IntegrationRunner.dumpThread(IntegrationRunner.java:302) at io.airbyte.integrations.base.IntegrationRunner.watchForOrphanThreads(IntegrationRunner.java:249) at io.airbyte.integrations.base.IntegrationRunner.runConsumer(IntegrationRunner.java:207) at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:148) at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:98) at io.airbyte.integrations.base.adaptive.AdaptiveDestinationRunner$Runner.run(AdaptiveDestinationRunner.java:87) at io.airbyte.integrations.destination.snowflake.SnowflakeDestinationRunner.main(SnowflakeDestinationRunner.java:17) 2023-03-18 18:54:12 destination > WARN i.a.i.b.IntegrationRunner(watchForOrphanThreads):257 Active non-daemon thread: pool-5-thread-8 (RUNNABLE) Thread stacktrace: java.base@17.0.4.1/sun.nio.ch.Net.poll(Native Method) at java.base@17.0.4.1/sun.nio.ch.NioSocketImpl.park(NioSocketImpl.java:181) at java.base@17.0.4.1/sun.nio.ch.NioSocketImpl.timedRead(NioSocketImpl.java:285) at java.base@17.0.4.1/sun.nio.ch.NioSocketImpl.implRead(NioSocketImpl.java:309) at java.base@17.0.4.1/sun.nio.ch.NioSocketImpl.read(NioSocketImpl.java:350) at java.base@17.0.4.1/sun.nio.ch.NioSocketImpl$1.read(NioSocketImpl.java:803) at java.base@17.0.4.1/java.net.Socket$SocketInputStream.read(Socket.java:966) at java.base@17.0.4.1/sun.security.ssl.SSLSocketInputRecord.read(SSLSocketInputRecord.java:478) at java.base@17.0.4.1/sun.security.ssl.SSLSocketInputRecord.readHeader(SSLSocketInputRecord.java:472) at java.base@17.0.4.1/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(SSLSocketInputRecord.java:70) at java.base@17.0.4.1/sun.security.ssl.SSLSocketImpl.readApplicationRecord(SSLSocketImpl.java:1460) at java.base@17.0.4.1/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:1064) at app//net.snowflake.client.jdbc.internal.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137) at app//net.snowflake.client.jdbc.internal.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153) at app//net.snowflake.client.jdbc.internal.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:280) at app//net.snowflake.client.jdbc.internal.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at app//net.snowflake.client.jdbc.internal.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at app//net.snowflake.client.jdbc.internal.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259) at app//net.snowflake.client.jdbc.internal.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163) at app//net.snowflake.client.jdbc.internal.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:157) at app//net.snowflake.client.jdbc.internal.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273) at app//net.snowflake.client.jdbc.internal.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125) at app//net.snowflake.client.jdbc.internal.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at app//net.snowflake.client.jdbc.internal.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) at app//net.snowflake.client.jdbc.internal.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at app//net.snowflake.client.jdbc.internal.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) at app//net.snowflake.client.jdbc.internal.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at app//net.snowflake.client.jdbc.internal.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at app//net.snowflake.client.jdbc.internal.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:108) at app//net.snowflake.client.jdbc.RestRequest.execute(RestRequest.java:174) at app//net.snowflake.client.core.HttpUtil.executeRequestInternal(HttpUtil.java:737) at app//net.snowflake.client.core.HttpUtil.executeRequest(HttpUtil.java:672) at app//net.snowflake.client.core.HttpUtil.executeGeneralRequest(HttpUtil.java:594) at app//net.snowflake.client.jdbc.telemetry.TelemetryClient.sendBatch(TelemetryClient.java:336) at app//net.snowflake.client.jdbc.telemetry.TelemetryClient.lambda$sendBatchAsync$0(TelemetryClient.java:267) at app//net.snowflake.client.jdbc.telemetry.TelemetryClient$$Lambda$284/0x0000000801024e00.call(Unknown Source) at java.base@17.0.4.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base@17.0.4.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base@17.0.4.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base@17.0.4.1/java.lang.Thread.run(Thread.java:833) 2023-03-18 18:54:12 destination > INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):80 Airbyte message consumer: succeeded. 2023-03-18 18:54:12 destination > INFO i.a.i.d.b.BufferedStreamConsumer(close):256 executing on success close procedure. 2023-03-18 18:54:12 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(flushAll):130 Flushing all 0 current buffers (0 bytes in total) 2023-03-18 18:54:12 destination > INFO i.a.i.d.j.SqlOperations(onDestinationCloseOperations):154 No onDestinationCloseOperations required for this destination. 2023-03-18 18:54:12 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$onCloseFunction$4):272 Finalizing tables in destination completed. 2023-03-18 18:54:12 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$onCloseFunction$4):276 Cleaning up destination started for 1 streams 2023-03-18 18:54:12 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$onCloseFunction$4):281 Cleaning stage in destination started for stream events. schema POSTHOG_PROD_SCHEMA, stage: POSTHOG_PROD_SCHEMA_EVENTS 2023-03-18 18:54:12 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$onCloseFunction$4):286 Cleaning up destination completed. 2023-03-18 18:54:12 destination > INFO i.a.i.b.IntegrationRunner(runInternal):182 Completed integration: io.airbyte.integrations.destination.snowflake.SnowflakeDestination 2023-03-18 18:54:12 destination > INFO i.a.i.b.a.AdaptiveDestinationRunner$Runner(run):88 Completed destination: io.airbyte.integrations.destination.snowflake.SnowflakeDestination 2023-03-18 18:54:13 ERROR i.a.w.g.DefaultReplicationWorker(replicate):280 - Sync worker failed. java.util.concurrent.ExecutionException: io.airbyte.workers.internal.exception.SourceException: Source didn't exit properly - check the logs! at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.general.DefaultReplicationWorker.replicate(DefaultReplicationWorker.java:272) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:190) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:94) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$6(TemporalAttemptExecution.java:202) ~[io.airbyte-airbyte-workers-0.42.0.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Suppressed: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:158) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.replicate(DefaultReplicationWorker.java:215) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:190) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:94) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$6(TemporalAttemptExecution.java:202) ~[io.airbyte-airbyte-workers-0.42.0.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Caused by: io.airbyte.workers.internal.exception.SourceException: Source didn't exit properly - check the logs! at io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$7(DefaultReplicationWorker.java:437) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:158) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$7(DefaultReplicationWorker.java:435) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?] ... 1 more 2023-03-18 18:54:13 INFO i.a.w.g.DefaultReplicationWorker(prepStateForLaterSaving):607 - Source did not output any state messages 2023-03-18 18:54:13 WARN i.a.w.g.DefaultReplicationWorker(prepStateForLaterSaving):615 - State capture: No new state, falling back on input state: io.airbyte.config.State@4b55c97[state=[{"type":"STREAM","stream":{"stream_descriptor":{"name":"events"},"stream_state":{"13967":{"timestamp":"2022-09-26T23:59:58.151000+00:00"}}}}]] 2023-03-18 18:54:13 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):538 - sync summary: { "status" : "failed", "recordsSynced" : 120000, "bytesSynced" : 778166377, "startTime" : 1679163602197, "endTime" : 1679165653915, "totalStats" : { "bytesEmitted" : 778166377, "destinationStateMessagesEmitted" : 0, "destinationWriteEndTime" : 1679165653914, "destinationWriteStartTime" : 1679163602347, "meanSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBetweenStateMessageEmittedandCommitted" : 0, "meanSecondsBetweenStateMessageEmittedandCommitted" : 0, "recordsEmitted" : 120000, "recordsCommitted" : 0, "replicationEndTime" : 1679165653915, "replicationStartTime" : 1679163602197, "sourceReadEndTime" : 0, "sourceReadStartTime" : 1679163602271, "sourceStateMessagesEmitted" : 0 }, "streamStats" : [ { "streamName" : "events", "stats" : { "bytesEmitted" : 778166377, "recordsEmitted" : 120000 } } ] } 2023-03-18 18:54:13 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):539 - failures: [ { "failureOrigin" : "source", "failureType" : "system_error", "internalMessage" : "Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-23T05%3A25%3A27.938000%2B00%3A00&limit=100, Response Code: 429, Response Text: {\"type\":\"throttled_error\",\"code\":\"throttled\",\"detail\":\"Request was throttled. Expected available in 1588 seconds.\",\"attr\":null}", "externalMessage" : "Something went wrong in the connector. See the logs for more details.", "metadata" : { "attemptNumber" : 0, "jobId" : 12, "from_trace_message" : true, "connector_command" : "read" }, "stacktrace" : "Traceback (most recent call last):\n File \"/airbyte/integration_code/main.py\", line 13, in \n launch(source, sys.argv[1:])\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py\", line 131, in launch\n for message in source_entrypoint.run(parsed_args):\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py\", line 122, in run\n for message in generator:\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/manifest_declarative_source.py\", line 112, in read\n yield from super().read(logger, config, catalog, state)\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py\", line 125, in read\n raise e\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py\", line 111, in read\n yield from self._read_stream(\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py\", line 180, in _read_stream\n for record in record_iterator:\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py\", line 243, in _read_incremental\n for message_counter, record_data_or_message in enumerate(records, start=1):\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/declarative_stream.py\", line 115, in read_records\n for record in self.retriever.read_records(sync_mode, cursor_field, stream_slice, stream_state):\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/retrievers/simple_retriever.py\", line 374, in read_records\n for record in records_generator:\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 429, in _read_pages\n request, response = self._fetch_next_page(stream_slice, stream_state, next_page_token)\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 452, in _fetch_next_page\n response = self._send_request(request, request_kwargs)\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 354, in _send_request\n return backoff_handler(user_backoff_handler)(request, request_kwargs)\n File \"/usr/local/lib/python3.9/site-packages/backoff/_sync.py\", line 105, in retry\n ret = target(*args, **kwargs)\n File \"/usr/local/lib/python3.9/site-packages/backoff/_sync.py\", line 105, in retry\n ret = target(*args, **kwargs)\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 310, in _send\n raise UserDefinedBackoffException(\nairbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-23T05%3A25%3A27.938000%2B00%3A00&limit=100, Response Code: 429, Response Text: {\"type\":\"throttled_error\",\"code\":\"throttled\",\"detail\":\"Request was throttled. Expected available in 1588 seconds.\",\"attr\":null}\n", "timestamp" : 1679165619455 }, { "failureOrigin" : "source", "internalMessage" : "Source didn't exit properly - check the logs!", "externalMessage" : "Something went wrong within the source connector", "metadata" : { "attemptNumber" : 0, "jobId" : 12, "connector_command" : "read" }, "stacktrace" : "io.airbyte.workers.internal.exception.SourceException: Source didn't exit properly - check the logs!\n\tat io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$7(DefaultReplicationWorker.java:437)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)\n\tat java.base/java.lang.Thread.run(Thread.java:1589)\nCaused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled.\n\tat io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:158)\n\tat io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$7(DefaultReplicationWorker.java:435)\n\t... 4 more\n", "timestamp" : 1679165619664 } ] 2023-03-18 18:54:13 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 18:54:13 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END REPLICATION ----- 2023-03-18 18:54:13 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 18:54:13 INFO i.a.w.t.TemporalAttemptExecution(get):169 - Stopping cancellation check scheduling... 2023-03-18 18:54:13 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$4):259 - sync summary: io.airbyte.config.StandardSyncOutput@54291377[standardSyncSummary=io.airbyte.config.StandardSyncSummary@1446b7e[status=failed,recordsSynced=120000,bytesSynced=778166377,startTime=1679163602197,endTime=1679165653915,totalStats=io.airbyte.config.SyncStats@177b7092[bytesEmitted=778166377,destinationStateMessagesEmitted=0,destinationWriteEndTime=1679165653914,destinationWriteStartTime=1679163602347,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,recordsEmitted=120000,recordsCommitted=0,replicationEndTime=1679165653915,replicationStartTime=1679163602197,sourceReadEndTime=0,sourceReadStartTime=1679163602271,sourceStateMessagesEmitted=0,additionalProperties={}],streamStats=[io.airbyte.config.StreamSyncStats@2089ec34[streamName=events,streamNamespace=,stats=io.airbyte.config.SyncStats@3ca7f1f9[bytesEmitted=778166377,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=120000,recordsCommitted=,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}]]]],normalizationSummary=,webhookOperationSummary=,state=io.airbyte.config.State@4b55c97[state=[{"type":"STREAM","stream":{"stream_descriptor":{"name":"events"},"stream_state":{"13967":{"timestamp":"2022-09-26T23:59:58.151000+00:00"}}}}]],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@1e1a6288[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@52a97e39[stream=io.airbyte.protocol.models.AirbyteStream@3d2ed014[name=events,jsonSchema={"type":"object","properties":{"person":{"type":"object","properties":{"is_identified":{"type":"boolean"},"properties":{"type":"object"},"distinct_ids":{"type":"array","items":{"type":"string"}}}},"distinct_id":{"type":"string"},"elements":{"type":"array","items":{"type":["string","object"]}},"id":{"type":"string"},"event":{"type":["string","object"]},"elements_chain":{"type":"string"},"properties":{"type":"object"},"timestamp":{"format":"date-time","type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[timestamp],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=incremental,cursorField=[timestamp],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[io.airbyte.config.FailureReason@3e85c671[failureOrigin=source,failureType=system_error,internalMessage=Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-23T05%3A25%3A27.938000%2B00%3A00&limit=100, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 1588 seconds.","attr":null},externalMessage=Something went wrong in the connector. See the logs for more details.,metadata=io.airbyte.config.Metadata@7346fd0b[additionalProperties={attemptNumber=0, jobId=12, from_trace_message=true, connector_command=read}],stacktrace=Traceback (most recent call last): File "/airbyte/integration_code/main.py", line 13, in launch(source, sys.argv[1:]) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 131, in launch for message in source_entrypoint.run(parsed_args): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 122, in run for message in generator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/manifest_declarative_source.py", line 112, in read yield from super().read(logger, config, catalog, state) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 125, in read raise e File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 111, in read yield from self._read_stream( File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 180, in _read_stream for record in record_iterator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 243, in _read_incremental for message_counter, record_data_or_message in enumerate(records, start=1): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/declarative_stream.py", line 115, in read_records for record in self.retriever.read_records(sync_mode, cursor_field, stream_slice, stream_state): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/retrievers/simple_retriever.py", line 374, in read_records for record in records_generator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 429, in _read_pages request, response = self._fetch_next_page(stream_slice, stream_state, next_page_token) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 452, in _fetch_next_page response = self._send_request(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 354, in _send_request return backoff_handler(user_backoff_handler)(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 310, in _send raise UserDefinedBackoffException( airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-23T05%3A25%3A27.938000%2B00%3A00&limit=100, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 1588 seconds.","attr":null} ,retryable=,timestamp=1679165619455], io.airbyte.config.FailureReason@6a071dec[failureOrigin=source,failureType=,internalMessage=Source didn't exit properly - check the logs!,externalMessage=Something went wrong within the source connector,metadata=io.airbyte.config.Metadata@21e2cec8[additionalProperties={attemptNumber=0, jobId=12, connector_command=read}],stacktrace=io.airbyte.workers.internal.exception.SourceException: Source didn't exit properly - check the logs! at io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$7(DefaultReplicationWorker.java:437) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) at java.base/java.lang.Thread.run(Thread.java:1589) Caused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:158) at io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$7(DefaultReplicationWorker.java:435) ... 4 more ,retryable=,timestamp=1679165619664]],commitStateAsap=false] 2023-03-18 18:54:13 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$4):264 - Sync summary length: 7928 2023-03-18 18:54:13 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating... 2023-03-18 18:54:13 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to get state 2023-03-18 18:54:13 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to create or update state 2023-03-18 18:54:14 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to get normalization statuses 2023-03-18 18:54:14 INFO i.a.w.t.s.NormalizationActivityImpl(lambda$normalize$3):146 - Using protocol v0 2023-03-18 18:54:14 INFO i.a.w.t.s.NormalizationActivityImpl(lambda$normalize$3):166 - Using normalization: airbyte/normalization-snowflake:0.2.26 2023-03-18 18:54:14 INFO i.a.w.t.TemporalAttemptExecution(get):142 - Docker volume job log path: /tmp/workspace/12/0/logs.log 2023-03-18 18:54:14 INFO i.a.w.t.TemporalAttemptExecution(get):147 - Executing worker wrapper. Airbyte version: 0.42.0 2023-03-18 18:54:14 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to save workflow id for cancellation 2023-03-18 18:54:14 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 18:54:14 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):129 - Running with normalization version: airbyte/normalization-snowflake:0.2.26 2023-03-18 18:54:14 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START DEFAULT NORMALIZATION ----- 2023-03-18 18:54:14 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 18:54:14 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/normalization-snowflake:0.2.26 exists... 2023-03-18 18:54:14 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/normalization-snowflake:0.2.26 was found locally. 2023-03-18 18:54:14 INFO i.a.w.p.DockerProcessFactory(create):130 - Creating docker container = normalization-snowflake-normalize-12-0-vhglo with resources io.airbyte.config.ResourceRequirements@7bbd87d6[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] and allowedHosts null 2023-03-18 18:54:14 INFO i.a.w.p.DockerProcessFactory(create):175 - Preparing command: docker run --rm --init -i -w /data/12/0/normalize --log-driver none --name normalization-snowflake-normalize-12-0-vhglo --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.42.0 airbyte/normalization-snowflake:0.2.26 run --integration-type snowflake --config destination_config.json --catalog destination_catalog.json 2023-03-18 18:54:14 normalization > Running: transform-config --config destination_config.json --integration-type snowflake --out /data/12/0/normalize 2023-03-18 18:54:14 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/12/0/normalize') 2023-03-18 18:54:14 normalization > transform_snowflake 2023-03-18 18:54:14 normalization > Running: transform-catalog --integration-type snowflake --profile-config-dir /data/12/0/normalize --catalog destination_catalog.json --out /data/12/0/normalize/models/generated/ --json-column _airbyte_data 2023-03-18 18:54:15 normalization > Processing destination_catalog.json... 2023-03-18 18:54:15 normalization > Generating airbyte_ctes/POSTHOG_PROD_SCHEMA/EVENTS_AB1.sql from events 2023-03-18 18:54:15 normalization > Generating airbyte_ctes/POSTHOG_PROD_SCHEMA/EVENTS_AB2.sql from events 2023-03-18 18:54:15 normalization > Generating airbyte_views/POSTHOG_PROD_SCHEMA/EVENTS_STG.sql from events 2023-03-18 18:54:15 normalization > Generating airbyte_incremental/scd/POSTHOG_PROD_SCHEMA/EVENTS_SCD.sql from events 2023-03-18 18:54:15 normalization > Generating airbyte_incremental/POSTHOG_PROD_SCHEMA/EVENTS.sql from events 2023-03-18 18:54:15 normalization > Generating airbyte_ctes/POSTHOG_PROD_SCHEMA/EVENTS_PERSON_AB1.sql from events/person 2023-03-18 18:54:15 normalization > Generating airbyte_ctes/POSTHOG_PROD_SCHEMA/EVENTS_PERSON_AB2.sql from events/person 2023-03-18 18:54:15 normalization > Generating airbyte_ctes/POSTHOG_PROD_SCHEMA/EVENTS_PERSON_AB3.sql from events/person 2023-03-18 18:54:15 normalization > Generating airbyte_incremental/POSTHOG_PROD_SCHEMA/EVENTS_PERSON.sql from events/person 2023-03-18 18:54:15 normalization > Ignoring stream 'elements' from events/elements because properties list is empty 2023-03-18 18:54:15 normalization > Ignoring stream 'event' from events/event because properties list is empty 2023-03-18 18:54:15 normalization > Ignoring stream 'distinct_ids' from events/person/distinct_ids because properties list is empty 2023-03-18 18:54:15 normalization > detected no config file for ssh, assuming ssh is off. 2023-03-18 18:54:17 normalization > [--event-buffer-size EVENT_BUFFER_SIZE] 2023-03-18 18:54:17 normalization > --event-buffer-size EVENT_BUFFER_SIZE 2023-03-18 18:54:17 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2023-03-18 18:54:17 normalization > DBT >=1.0.0 detected; using 10K event buffer size 2023-03-18 18:54:17 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2023-03-18 18:54:20 normalization > Running with dbt=1.0.0 2023-03-18 18:54:20 normalization > Partial parse save file not found. Starting full parse. 2023-03-18 18:54:21 normalization > [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. There are 1 unused configuration paths: - models.airbyte_utils.generated.airbyte_tables 2023-03-18 18:54:21 normalization > Found 9 models, 0 tests, 0 snapshots, 0 analyses, 615 macros, 0 operations, 0 seed files, 1 source, 0 exposures, 0 metrics 2023-03-18 18:54:26 normalization > Concurrency: 5 threads (target='prod') 2023-03-18 18:54:26 normalization > 1 of 4 START view model _AIRBYTE_POSTHOG_PROD_SCHEMA.EVENTS_STG......................................................... [RUN] 2023-03-18 18:54:29 normalization > 1 of 4 OK created view model _AIRBYTE_POSTHOG_PROD_SCHEMA.EVENTS_STG.................................................... [SUCCESS 1 in 2.39s] 2023-03-18 18:54:29 normalization > 2 of 4 START incremental model POSTHOG_PROD_SCHEMA.EVENTS_SCD........................................................... [RUN] 2023-03-18 18:55:21 normalization > 2 of 4 OK created incremental model POSTHOG_PROD_SCHEMA.EVENTS_SCD...................................................... [SUCCESS 1 in 52.40s] 2023-03-18 18:55:21 normalization > 3 of 4 START incremental model POSTHOG_PROD_SCHEMA.EVENTS............................................................... [RUN] 2023-03-18 18:55:21 normalization > 4 of 4 START incremental model POSTHOG_PROD_SCHEMA.EVENTS_PERSON........................................................ [RUN] 2023-03-18 18:55:28 normalization > 4 of 4 OK created incremental model POSTHOG_PROD_SCHEMA.EVENTS_PERSON................................................... [SUCCESS 1 in 7.07s] 2023-03-18 18:55:45 normalization > 3 of 4 OK created incremental model POSTHOG_PROD_SCHEMA.EVENTS.......................................................... [SUCCESS 1 in 23.66s] 2023-03-18 18:55:45 normalization > Finished running 1 view model, 3 incremental models in 83.33s. 2023-03-18 18:55:45 normalization > Completed successfully 2023-03-18 18:55:45 normalization > Done. PASS=4 WARN=0 ERROR=0 SKIP=0 TOTAL=4 2023-03-18 18:55:45 INFO i.a.w.n.DefaultNormalizationRunner(close):194 - Terminating normalization process... 2023-03-18 18:55:45 INFO i.a.w.n.DefaultNormalizationRunner(close):207 - Normalization process successfully terminated. 2023-03-18 18:55:45 INFO i.a.w.g.DefaultNormalizationWorker(run):97 - Normalization executed in 1 minute 31 seconds for job 12. 2023-03-18 18:55:45 INFO i.a.w.g.DefaultNormalizationWorker(run):109 - Normalization summary: io.airbyte.config.NormalizationSummary@79665660[startTime=1679165654112,endTime=1679165745587,failures=[]] 2023-03-18 18:55:45 INFO i.a.w.t.TemporalAttemptExecution(get):169 - Stopping cancellation check scheduling... 2023-03-18 18:55:45 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 18:55:45 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END DEFAULT NORMALIZATION ----- 2023-03-18 18:55:45 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating... 2023-03-18 18:55:45 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 18:55:56 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to Get a connection by connection Id 2023-03-18 18:55:56 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to get the most recent source actor catalog 2023-03-18 18:55:56 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to Get a connection by connection Id 2023-03-18 18:55:45 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to get state 2023-03-18 18:55:46 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to set attempt sync config 2023-03-18 18:55:46 INFO i.a.v.j.JsonSchemaValidator(test):129 - JSON schema validation failed. errors: $.auth_type: must be a constant value OAuth2.0, $.auth_type: does not have a value in the enumeration [OAuth2.0], $.access_token: is missing but it is required, $.refresh_token: is missing but it is required 2023-03-18 18:55:46 INFO i.a.v.j.JsonSchemaValidator(test):129 - JSON schema validation failed. errors: $.auth_type: must be a constant value Key Pair Authentication, $.auth_type: does not have a value in the enumeration [Key Pair Authentication], $.private_key: is missing but it is required 2023-03-18 18:55:46 INFO i.a.v.j.JsonSchemaValidator(test):129 - JSON schema validation failed. errors: $.password: object found, string expected 2023-03-18 18:55:46 INFO i.a.v.j.JsonSchemaValidator(test):129 - JSON schema validation failed. errors: $.method: does not have a value in the enumeration [Standard] 2023-03-18 18:55:46 INFO i.a.w.t.TemporalAttemptExecution(get):142 - Docker volume job log path: /tmp/workspace/12/1/logs.log 2023-03-18 18:55:46 INFO i.a.w.t.TemporalAttemptExecution(get):147 - Executing worker wrapper. Airbyte version: 0.42.0 2023-03-18 18:55:46 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to save workflow id for cancellation 2023-03-18 18:55:46 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 18:55:46 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-03-18 18:55:46 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START CHECK ----- 2023-03-18 18:55:46 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-03-18 18:55:46 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 18:55:46 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-03-18 18:55:46 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-03-18 18:55:46 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-03-18 18:55:46 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-03-18 18:55:46 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/source-posthog:0.1.8 exists... 2023-03-18 18:55:46 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/source-posthog:0.1.8 was found locally. 2023-03-18 18:55:46 INFO i.a.w.p.DockerProcessFactory(create):130 - Creating docker container = source-posthog-check-12-1-gstwz with resources io.airbyte.config.ResourceRequirements@6f61d75f[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] and allowedHosts io.airbyte.config.AllowedHosts@3146f617[hosts=[https://app.posthog.com, app.posthog.com, *.datadoghq.com, *.datadoghq.eu, *.sentry.io],additionalProperties={}] 2023-03-18 18:55:46 INFO i.a.w.p.DockerProcessFactory(create):175 - Preparing command: docker run --rm --init -i -w /data/12/1 --log-driver none --name source-posthog-check-12-1-gstwz --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e STRICT_COMPARISON_NORMALIZATION_WORKSPACES= -e WORKER_CONNECTOR_IMAGE=airbyte/source-posthog:0.1.8 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e STRICT_COMPARISON_NORMALIZATION_TAG=strict_comparison2 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=1 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.42.0 -e WORKER_JOB_ID=12 airbyte/source-posthog:0.1.8 check --config source_config.json 2023-03-18 18:55:46 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):107 - Reading messages from protocol version 0.2.0 2023-03-18 18:55:47 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - Check succeeded 2023-03-18 18:55:48 INFO i.a.w.g.DefaultCheckConnectionWorker(run):120 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@52536b4e[status=succeeded,message=] 2023-03-18 18:55:48 INFO i.a.w.t.TemporalAttemptExecution(get):169 - Stopping cancellation check scheduling... 2023-03-18 18:55:48 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 18:55:48 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END CHECK ----- 2023-03-18 18:55:48 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 18:55:48 INFO i.a.w.t.TemporalAttemptExecution(get):142 - Docker volume job log path: /tmp/workspace/12/1/logs.log 2023-03-18 18:55:48 INFO i.a.w.t.TemporalAttemptExecution(get):147 - Executing worker wrapper. Airbyte version: 0.42.0 2023-03-18 18:55:48 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to save workflow id for cancellation 2023-03-18 18:55:48 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-03-18 18:55:48 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 18:55:48 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-03-18 18:55:48 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START CHECK ----- 2023-03-18 18:55:48 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-03-18 18:55:48 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 18:55:48 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-03-18 18:55:48 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-03-18 18:55:48 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-03-18 18:55:48 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/destination-snowflake:0.4.52 exists... 2023-03-18 18:55:48 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/destination-snowflake:0.4.52 was found locally. 2023-03-18 18:55:48 INFO i.a.w.p.DockerProcessFactory(create):130 - Creating docker container = destination-snowflake-check-12-1-gjlmw with resources io.airbyte.config.ResourceRequirements@6f61d75f[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] and allowedHosts null 2023-03-18 18:55:48 INFO i.a.w.p.DockerProcessFactory(create):175 - Preparing command: docker run --rm --init -i -w /data/12/1 --log-driver none --name destination-snowflake-check-12-1-gjlmw --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e STRICT_COMPARISON_NORMALIZATION_WORKSPACES= -e WORKER_CONNECTOR_IMAGE=airbyte/destination-snowflake:0.4.52 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e STRICT_COMPARISON_NORMALIZATION_TAG=strict_comparison2 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=1 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.42.0 -e WORKER_JOB_ID=12 airbyte/destination-snowflake:0.4.52 check --config source_config.json 2023-03-18 18:55:48 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):107 - Reading messages from protocol version 0.2.0 2023-03-18 18:55:49 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO i.a.i.b.a.AdaptiveDestinationRunner$Runner(getDestination):74 Running destination under deployment mode: OSS 2023-03-18 18:55:49 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO i.a.i.b.a.AdaptiveDestinationRunner$Runner(run):86 Starting destination: io.airbyte.integrations.destination.snowflake.SnowflakeDestination 2023-03-18 18:55:49 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {check=null, config=source_config.json} 2023-03-18 18:55:49 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO i.a.i.b.IntegrationRunner(runInternal):105 Running integration: io.airbyte.integrations.destination.snowflake.SnowflakeDestination 2023-03-18 18:55:49 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO i.a.i.b.IntegrationRunner(runInternal):106 Command: CHECK 2023-03-18 18:55:49 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO i.a.i.b.IntegrationRunner(runInternal):107 Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2023-03-18 18:55:49 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):165 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-03-18 18:55:49 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):165 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-03-18 18:55:49 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO i.a.i.d.j.c.SwitchingDestination(check):55 Using destination type: INTERNAL_STAGING 2023-03-18 18:55:50 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO c.z.h.HikariDataSource(getConnection):110 HikariPool-1 - Starting... 2023-03-18 18:55:52 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO c.z.h.p.HikariPool(checkFailFast):565 HikariPool-1 - Added connection net.snowflake.client.jdbc.SnowflakeConnectionV1@5922d3e9 2023-03-18 18:55:52 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO c.z.h.HikariDataSource(getConnection):123 HikariPool-1 - Start completed. 2023-03-18 18:55:53 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO i.a.d.j.DefaultJdbcDatabase(lambda$unsafeQuery$1):115 closing connection 2023-03-18 18:55:53 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO i.a.i.d.s.SnowflakeSqlOperations(insertRecordsInternal):60 actual size of batch: 1 2023-03-18 18:55:54 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO c.z.h.HikariDataSource(close):350 HikariPool-1 - Shutdown initiated... 2023-03-18 18:55:56 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO c.z.h.HikariDataSource(close):352 HikariPool-1 - Shutdown completed. 2023-03-18 18:55:56 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO i.a.i.b.IntegrationRunner(runInternal):182 Completed integration: io.airbyte.integrations.destination.snowflake.SnowflakeDestination 2023-03-18 18:55:56 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO i.a.i.b.a.AdaptiveDestinationRunner$Runner(run):88 Completed destination: io.airbyte.integrations.destination.snowflake.SnowflakeDestination 2023-03-18 18:55:56 INFO i.a.w.g.DefaultCheckConnectionWorker(run):120 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@3efd723d[status=succeeded,message=] 2023-03-18 18:55:56 INFO i.a.w.t.TemporalAttemptExecution(get):169 - Stopping cancellation check scheduling... 2023-03-18 18:55:56 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 18:55:56 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END CHECK ----- 2023-03-18 18:55:56 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 18:55:57 INFO i.a.w.t.TemporalAttemptExecution(get):142 - Docker volume job log path: /tmp/workspace/12/1/logs.log 2023-03-18 18:55:57 INFO i.a.w.t.TemporalAttemptExecution(get):147 - Executing worker wrapper. Airbyte version: 0.42.0 2023-03-18 18:55:57 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to save workflow id for cancellation 2023-03-18 18:55:57 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable METRIC_CLIENT: '' 2023-03-18 18:55:57 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2023-03-18 18:55:57 INFO i.a.w.g.DefaultReplicationWorker(run):164 - start sync worker. job id: 12 attempt id: 1 2023-03-18 18:55:57 INFO i.a.w.g.DefaultReplicationWorker(run):166 - Committing states from persistState activity 2023-03-18 18:55:57 INFO i.a.w.g.DefaultReplicationWorker(run):182 - configured sync modes: {null.events=incremental - append_dedup} 2023-03-18 18:55:57 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 18:55:57 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START REPLICATION ----- 2023-03-18 18:55:57 INFO i.a.w.i.DefaultAirbyteDestination(start):87 - Running destination... 2023-03-18 18:55:57 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 18:55:57 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-03-18 18:55:57 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-03-18 18:55:57 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-03-18 18:55:57 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-03-18 18:55:57 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-03-18 18:55:57 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-03-18 18:55:57 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/destination-snowflake:0.4.52 exists... 2023-03-18 18:55:57 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/destination-snowflake:0.4.52 was found locally. 2023-03-18 18:55:57 INFO i.a.w.p.DockerProcessFactory(create):130 - Creating docker container = destination-snowflake-write-12-1-shqem with resources io.airbyte.config.ResourceRequirements@750132c1[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] and allowedHosts null 2023-03-18 18:55:57 INFO i.a.w.p.DockerProcessFactory(create):175 - Preparing command: docker run --rm --init -i -w /data/12/1 --log-driver none --name destination-snowflake-write-12-1-shqem --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e STRICT_COMPARISON_NORMALIZATION_WORKSPACES= -e WORKER_CONNECTOR_IMAGE=airbyte/destination-snowflake:0.4.52 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e STRICT_COMPARISON_NORMALIZATION_TAG=strict_comparison2 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=1 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.42.0 -e WORKER_JOB_ID=12 airbyte/destination-snowflake:0.4.52 write --config destination_config.json --catalog destination_catalog.json 2023-03-18 18:55:57 INFO i.a.w.i.VersionedAirbyteMessageBufferedWriterFactory(createWriter):41 - Writing messages to protocol version 0.2.0 2023-03-18 18:55:57 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):107 - Reading messages from protocol version 0.2.0 2023-03-18 18:55:57 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-03-18 18:55:57 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-03-18 18:55:57 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-03-18 18:55:57 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-03-18 18:55:57 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-03-18 18:55:57 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-03-18 18:55:57 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/source-posthog:0.1.8 exists... 2023-03-18 18:55:57 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/source-posthog:0.1.8 was found locally. 2023-03-18 18:55:57 INFO i.a.w.p.DockerProcessFactory(create):130 - Creating docker container = source-posthog-read-12-1-dmihx with resources io.airbyte.config.ResourceRequirements@43b101e7[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] and allowedHosts io.airbyte.config.AllowedHosts@24830765[hosts=[https://app.posthog.com, app.posthog.com, *.datadoghq.com, *.datadoghq.eu, *.sentry.io],additionalProperties={}] 2023-03-18 18:55:57 INFO i.a.w.p.DockerProcessFactory(create):175 - Preparing command: docker run --rm --init -i -w /data/12/1 --log-driver none --name source-posthog-read-12-1-dmihx --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e STRICT_COMPARISON_NORMALIZATION_WORKSPACES= -e WORKER_CONNECTOR_IMAGE=airbyte/source-posthog:0.1.8 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e STRICT_COMPARISON_NORMALIZATION_TAG=strict_comparison2 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=1 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.42.0 -e WORKER_JOB_ID=12 airbyte/source-posthog:0.1.8 read --config source_config.json --catalog source_catalog.json --state input_state.json 2023-03-18 18:55:57 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):107 - Reading messages from protocol version 0.2.0 2023-03-18 18:55:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromDstRunnable$4):312 - Destination output thread started. 2023-03-18 18:55:57 INFO i.a.w.g.DefaultReplicationWorker(replicate):268 - Waiting for source and destination threads to complete. 2023-03-18 18:55:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):377 - Replication thread started. 2023-03-18 18:55:58 destination > INFO i.a.i.b.a.AdaptiveDestinationRunner$Runner(getDestination):74 Running destination under deployment mode: OSS 2023-03-18 18:55:58 destination > INFO i.a.i.b.a.AdaptiveDestinationRunner$Runner(run):86 Starting destination: io.airbyte.integrations.destination.snowflake.SnowflakeDestination 2023-03-18 18:55:58 destination > INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2023-03-18 18:55:58 destination > INFO i.a.i.b.IntegrationRunner(runInternal):105 Running integration: io.airbyte.integrations.destination.snowflake.SnowflakeDestination 2023-03-18 18:55:58 destination > INFO i.a.i.b.IntegrationRunner(runInternal):106 Command: WRITE 2023-03-18 18:55:58 destination > INFO i.a.i.b.IntegrationRunner(runInternal):107 Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2023-03-18 18:55:58 destination > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-03-18 18:55:58 destination > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-03-18 18:55:58 destination > INFO i.a.i.d.j.c.SwitchingDestination(getConsumer):65 Using destination type: INTERNAL_STAGING 2023-03-18 18:55:58 source > Starting syncing SourcePosthog 2023-03-18 18:55:59 source > Syncing stream: events 2023-03-18 18:55:59 source > Setting state of events stream to {'13967': {'timestamp': '2022-09-26T23:59:58.151000+00:00'}} 2023-03-18 18:55:59 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$toWriteConfig$0):121 Write config: WriteConfig{streamName=events, namespace=null, outputSchemaName=POSTHOG_PROD_SCHEMA, tmpTableName=_airbyte_tmp_lsk_events, outputTableName=_airbyte_raw_events, syncMode=append_dedup} 2023-03-18 18:55:59 destination > INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):146 class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2023-03-18 18:55:59 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$onStartFunction$1):139 Preparing raw tables in destination started for 1 streams 2023-03-18 18:55:59 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$onStartFunction$1):148 Preparing staging area in destination started for schema POSTHOG_PROD_SCHEMA stream events: target table: _airbyte_raw_events, stage: 2023/03/18/18/09BD62AE-ED1B-4F4B-91B1-DA43AE6B32A5/ 2023-03-18 18:55:59 destination > INFO c.z.h.HikariDataSource(getConnection):110 HikariPool-1 - Starting... 2023-03-18 18:55:59 source > Backing off _send(...) for 0.0s (airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-26T23%3A59%3A58.151000%2B0000, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 1447 seconds.","attr":null}) 2023-03-18 18:55:59 source > Retrying. Sleeping for 10 seconds 2023-03-18 18:56:01 destination > INFO c.z.h.p.HikariPool(checkFailFast):565 HikariPool-1 - Added connection net.snowflake.client.jdbc.SnowflakeConnectionV1@3ddeaa5f 2023-03-18 18:56:01 destination > INFO c.z.h.HikariDataSource(getConnection):123 HikariPool-1 - Start completed. 2023-03-18 18:56:01 destination > INFO i.a.d.j.DefaultJdbcDatabase(lambda$unsafeQuery$1):115 closing connection 2023-03-18 18:56:02 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$onStartFunction$1):165 Preparing staging area in destination completed for schema POSTHOG_PROD_SCHEMA stream events 2023-03-18 18:56:02 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$onStartFunction$1):167 Executing finalization of tables. 2023-03-18 18:56:11 source > Backing off _send(...) for 0.0s (airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-26T23%3A59%3A58.151000%2B0000, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 1436 seconds.","attr":null}) 2023-03-18 18:56:11 source > Retrying. Sleeping for 20 seconds 2023-03-18 18:56:32 source > Backing off _send(...) for 0.0s (airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-26T23%3A59%3A58.151000%2B0000, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 1415 seconds.","attr":null}) 2023-03-18 18:56:32 source > Retrying. Sleeping for 40 seconds 2023-03-18 18:57:13 source > Backing off _send(...) for 0.0s (airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-26T23%3A59%3A58.151000%2B0000, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 1374 seconds.","attr":null}) 2023-03-18 18:57:13 source > Retrying. Sleeping for 80 seconds 2023-03-18 18:58:35 source > Backing off _send(...) for 0.0s (airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-26T23%3A59%3A58.151000%2B0000, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 1292 seconds.","attr":null}) 2023-03-18 18:58:35 source > Retrying. Sleeping for 160 seconds 2023-03-18 19:01:16 source > Giving up _send(...) after 6 tries (airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-26T23%3A59%3A58.151000%2B0000, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 1131 seconds.","attr":null}) 2023-03-18 19:01:16 source > Max retry limit reached. Request: , Response: 2023-03-18 19:01:16 source > Encountered an exception while reading stream events Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 111, in read yield from self._read_stream( File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 180, in _read_stream for record in record_iterator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 243, in _read_incremental for message_counter, record_data_or_message in enumerate(records, start=1): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/declarative_stream.py", line 115, in read_records for record in self.retriever.read_records(sync_mode, cursor_field, stream_slice, stream_state): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/retrievers/simple_retriever.py", line 374, in read_records for record in records_generator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 429, in _read_pages request, response = self._fetch_next_page(stream_slice, stream_state, next_page_token) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 452, in _fetch_next_page response = self._send_request(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 354, in _send_request return backoff_handler(user_backoff_handler)(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 310, in _send raise UserDefinedBackoffException( airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-26T23%3A59%3A58.151000%2B0000, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 1131 seconds.","attr":null} 2023-03-18 19:01:16 source > Finished syncing events 2023-03-18 19:01:16 source > SourcePosthog runtimes: Syncing stream events 0:05:17.548156 2023-03-18 19:01:16 source > Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-26T23%3A59%3A58.151000%2B0000, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 1131 seconds.","attr":null} Traceback (most recent call last): File "/airbyte/integration_code/main.py", line 13, in launch(source, sys.argv[1:]) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 131, in launch for message in source_entrypoint.run(parsed_args): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 122, in run for message in generator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/manifest_declarative_source.py", line 112, in read yield from super().read(logger, config, catalog, state) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 125, in read raise e File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 111, in read yield from self._read_stream( File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 180, in _read_stream for record in record_iterator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 243, in _read_incremental for message_counter, record_data_or_message in enumerate(records, start=1): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/declarative_stream.py", line 115, in read_records for record in self.retriever.read_records(sync_mode, cursor_field, stream_slice, stream_state): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/retrievers/simple_retriever.py", line 374, in read_records for record in records_generator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 429, in _read_pages request, response = self._fetch_next_page(stream_slice, stream_state, next_page_token) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 452, in _fetch_next_page response = self._send_request(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 354, in _send_request return backoff_handler(user_backoff_handler)(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 310, in _send raise UserDefinedBackoffException( airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-26T23%3A59%3A58.151000%2B0000, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 1131 seconds.","attr":null} 2023-03-18 19:01:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):433 - Source has no more messages, closing connection. 2023-03-18 19:01:16 destination > INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):80 Airbyte message consumer: succeeded. 2023-03-18 19:01:16 destination > INFO i.a.i.d.b.BufferedStreamConsumer(close):256 executing on success close procedure. 2023-03-18 19:01:16 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(flushAll):130 Flushing all 0 current buffers (0 bytes in total) 2023-03-18 19:01:16 destination > INFO i.a.i.d.j.SqlOperations(onDestinationCloseOperations):154 No onDestinationCloseOperations required for this destination. 2023-03-18 19:01:16 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$onCloseFunction$4):272 Finalizing tables in destination completed. 2023-03-18 19:01:16 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$onCloseFunction$4):276 Cleaning up destination started for 1 streams 2023-03-18 19:01:16 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$onCloseFunction$4):281 Cleaning stage in destination started for stream events. schema POSTHOG_PROD_SCHEMA, stage: POSTHOG_PROD_SCHEMA_EVENTS 2023-03-18 19:01:17 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$onCloseFunction$4):286 Cleaning up destination completed. 2023-03-18 19:01:17 destination > INFO i.a.i.b.IntegrationRunner(runInternal):182 Completed integration: io.airbyte.integrations.destination.snowflake.SnowflakeDestination 2023-03-18 19:01:17 destination > INFO i.a.i.b.a.AdaptiveDestinationRunner$Runner(run):88 Completed destination: io.airbyte.integrations.destination.snowflake.SnowflakeDestination 2023-03-18 19:01:19 ERROR i.a.w.g.DefaultReplicationWorker(replicate):280 - Sync worker failed. java.util.concurrent.ExecutionException: io.airbyte.workers.internal.exception.SourceException: Source didn't exit properly - check the logs! at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.general.DefaultReplicationWorker.replicate(DefaultReplicationWorker.java:272) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:190) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:94) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$6(TemporalAttemptExecution.java:202) ~[io.airbyte-airbyte-workers-0.42.0.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Suppressed: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:158) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.replicate(DefaultReplicationWorker.java:215) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:190) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:94) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$6(TemporalAttemptExecution.java:202) ~[io.airbyte-airbyte-workers-0.42.0.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Caused by: io.airbyte.workers.internal.exception.SourceException: Source didn't exit properly - check the logs! at io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$7(DefaultReplicationWorker.java:437) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:158) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$7(DefaultReplicationWorker.java:435) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?] ... 1 more 2023-03-18 19:01:19 INFO i.a.w.g.DefaultReplicationWorker(prepStateForLaterSaving):607 - Source did not output any state messages 2023-03-18 19:01:19 WARN i.a.w.g.DefaultReplicationWorker(prepStateForLaterSaving):615 - State capture: No new state, falling back on input state: io.airbyte.config.State@64ad7e6e[state=[{"type":"STREAM","stream":{"stream_descriptor":{"name":"events"},"stream_state":{"13967":{"timestamp":"2022-09-26T23:59:58.151000+00:00"}}}}]] 2023-03-18 19:01:19 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):538 - sync summary: { "status" : "failed", "recordsSynced" : 0, "bytesSynced" : 0, "startTime" : 1679165757066, "endTime" : 1679166079512, "totalStats" : { "bytesEmitted" : 0, "destinationStateMessagesEmitted" : 0, "destinationWriteEndTime" : 1679166079512, "destinationWriteStartTime" : 1679165757149, "meanSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBetweenStateMessageEmittedandCommitted" : 0, "meanSecondsBetweenStateMessageEmittedandCommitted" : 0, "recordsEmitted" : 0, "recordsCommitted" : 0, "replicationEndTime" : 1679166079512, "replicationStartTime" : 1679165757066, "sourceReadEndTime" : 0, "sourceReadStartTime" : 1679165757104, "sourceStateMessagesEmitted" : 0 }, "streamStats" : [ ] } 2023-03-18 19:01:19 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):539 - failures: [ { "failureOrigin" : "source", "failureType" : "system_error", "internalMessage" : "Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-26T23%3A59%3A58.151000%2B0000, Response Code: 429, Response Text: {\"type\":\"throttled_error\",\"code\":\"throttled\",\"detail\":\"Request was throttled. Expected available in 1131 seconds.\",\"attr\":null}", "externalMessage" : "Something went wrong in the connector. See the logs for more details.", "metadata" : { "attemptNumber" : 1, "jobId" : 12, "from_trace_message" : true, "connector_command" : "read" }, "stacktrace" : "Traceback (most recent call last):\n File \"/airbyte/integration_code/main.py\", line 13, in \n launch(source, sys.argv[1:])\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py\", line 131, in launch\n for message in source_entrypoint.run(parsed_args):\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py\", line 122, in run\n for message in generator:\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/manifest_declarative_source.py\", line 112, in read\n yield from super().read(logger, config, catalog, state)\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py\", line 125, in read\n raise e\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py\", line 111, in read\n yield from self._read_stream(\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py\", line 180, in _read_stream\n for record in record_iterator:\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py\", line 243, in _read_incremental\n for message_counter, record_data_or_message in enumerate(records, start=1):\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/declarative_stream.py\", line 115, in read_records\n for record in self.retriever.read_records(sync_mode, cursor_field, stream_slice, stream_state):\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/retrievers/simple_retriever.py\", line 374, in read_records\n for record in records_generator:\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 429, in _read_pages\n request, response = self._fetch_next_page(stream_slice, stream_state, next_page_token)\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 452, in _fetch_next_page\n response = self._send_request(request, request_kwargs)\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 354, in _send_request\n return backoff_handler(user_backoff_handler)(request, request_kwargs)\n File \"/usr/local/lib/python3.9/site-packages/backoff/_sync.py\", line 105, in retry\n ret = target(*args, **kwargs)\n File \"/usr/local/lib/python3.9/site-packages/backoff/_sync.py\", line 105, in retry\n ret = target(*args, **kwargs)\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 310, in _send\n raise UserDefinedBackoffException(\nairbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-26T23%3A59%3A58.151000%2B0000, Response Code: 429, Response Text: {\"type\":\"throttled_error\",\"code\":\"throttled\",\"detail\":\"Request was throttled. Expected available in 1131 seconds.\",\"attr\":null}\n", "timestamp" : 1679166076661 }, { "failureOrigin" : "source", "internalMessage" : "Source didn't exit properly - check the logs!", "externalMessage" : "Something went wrong within the source connector", "metadata" : { "attemptNumber" : 1, "jobId" : 12, "connector_command" : "read" }, "stacktrace" : "io.airbyte.workers.internal.exception.SourceException: Source didn't exit properly - check the logs!\n\tat io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$7(DefaultReplicationWorker.java:437)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)\n\tat java.base/java.lang.Thread.run(Thread.java:1589)\nCaused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled.\n\tat io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:158)\n\tat io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$7(DefaultReplicationWorker.java:435)\n\t... 4 more\n", "timestamp" : 1679166076862 } ] 2023-03-18 19:01:19 INFO i.a.w.t.TemporalAttemptExecution(get):169 - Stopping cancellation check scheduling... 2023-03-18 19:01:19 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 19:01:19 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END REPLICATION ----- 2023-03-18 19:01:19 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 19:01:19 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$4):259 - sync summary: io.airbyte.config.StandardSyncOutput@3d33ccaf[standardSyncSummary=io.airbyte.config.StandardSyncSummary@194bbf76[status=failed,recordsSynced=0,bytesSynced=0,startTime=1679165757066,endTime=1679166079512,totalStats=io.airbyte.config.SyncStats@df59316[bytesEmitted=0,destinationStateMessagesEmitted=0,destinationWriteEndTime=1679166079512,destinationWriteStartTime=1679165757149,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,recordsEmitted=0,recordsCommitted=0,replicationEndTime=1679166079512,replicationStartTime=1679165757066,sourceReadEndTime=0,sourceReadStartTime=1679165757104,sourceStateMessagesEmitted=0,additionalProperties={}],streamStats=[]],normalizationSummary=,webhookOperationSummary=,state=io.airbyte.config.State@64ad7e6e[state=[{"type":"STREAM","stream":{"stream_descriptor":{"name":"events"},"stream_state":{"13967":{"timestamp":"2022-09-26T23:59:58.151000+00:00"}}}}]],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@1fc39e2e[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@3cb67fcd[stream=io.airbyte.protocol.models.AirbyteStream@78c2c722[name=events,jsonSchema={"type":"object","properties":{"person":{"type":"object","properties":{"is_identified":{"type":"boolean"},"properties":{"type":"object"},"distinct_ids":{"type":"array","items":{"type":"string"}}}},"distinct_id":{"type":"string"},"elements":{"type":"array","items":{"type":["string","object"]}},"id":{"type":"string"},"event":{"type":["string","object"]},"elements_chain":{"type":"string"},"properties":{"type":"object"},"timestamp":{"format":"date-time","type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[timestamp],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=incremental,cursorField=[timestamp],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[io.airbyte.config.FailureReason@598e960f[failureOrigin=source,failureType=system_error,internalMessage=Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-26T23%3A59%3A58.151000%2B0000, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 1131 seconds.","attr":null},externalMessage=Something went wrong in the connector. See the logs for more details.,metadata=io.airbyte.config.Metadata@5abf51fe[additionalProperties={attemptNumber=1, jobId=12, from_trace_message=true, connector_command=read}],stacktrace=Traceback (most recent call last): File "/airbyte/integration_code/main.py", line 13, in launch(source, sys.argv[1:]) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 131, in launch for message in source_entrypoint.run(parsed_args): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 122, in run for message in generator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/manifest_declarative_source.py", line 112, in read yield from super().read(logger, config, catalog, state) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 125, in read raise e File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 111, in read yield from self._read_stream( File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 180, in _read_stream for record in record_iterator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 243, in _read_incremental for message_counter, record_data_or_message in enumerate(records, start=1): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/declarative_stream.py", line 115, in read_records for record in self.retriever.read_records(sync_mode, cursor_field, stream_slice, stream_state): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/retrievers/simple_retriever.py", line 374, in read_records for record in records_generator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 429, in _read_pages request, response = self._fetch_next_page(stream_slice, stream_state, next_page_token) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 452, in _fetch_next_page response = self._send_request(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 354, in _send_request return backoff_handler(user_backoff_handler)(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 310, in _send raise UserDefinedBackoffException( airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-26T23%3A59%3A58.151000%2B0000, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 1131 seconds.","attr":null} ,retryable=,timestamp=1679166076661], io.airbyte.config.FailureReason@55781573[failureOrigin=source,failureType=,internalMessage=Source didn't exit properly - check the logs!,externalMessage=Something went wrong within the source connector,metadata=io.airbyte.config.Metadata@3b6d3329[additionalProperties={attemptNumber=1, jobId=12, connector_command=read}],stacktrace=io.airbyte.workers.internal.exception.SourceException: Source didn't exit properly - check the logs! at io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$7(DefaultReplicationWorker.java:437) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) at java.base/java.lang.Thread.run(Thread.java:1589) Caused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:158) at io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$7(DefaultReplicationWorker.java:435) ... 4 more ,retryable=,timestamp=1679166076862]],commitStateAsap=false] 2023-03-18 19:01:19 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$4):264 - Sync summary length: 7155 2023-03-18 19:01:19 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating... 2023-03-18 19:01:19 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to get state 2023-03-18 19:01:19 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to create or update state 2023-03-18 19:01:19 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to get normalization statuses 2023-03-18 19:01:19 INFO i.a.w.t.s.NormalizationActivityImpl(lambda$normalize$3):146 - Using protocol v0 2023-03-18 19:01:19 INFO i.a.w.t.s.NormalizationActivityImpl(lambda$normalize$3):166 - Using normalization: airbyte/normalization-snowflake:0.2.26 2023-03-18 19:01:19 INFO i.a.w.t.TemporalAttemptExecution(get):142 - Docker volume job log path: /tmp/workspace/12/1/logs.log 2023-03-18 19:01:19 INFO i.a.w.t.TemporalAttemptExecution(get):147 - Executing worker wrapper. Airbyte version: 0.42.0 2023-03-18 19:01:19 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to save workflow id for cancellation 2023-03-18 19:01:19 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 19:01:19 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):129 - Running with normalization version: airbyte/normalization-snowflake:0.2.26 2023-03-18 19:01:19 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START DEFAULT NORMALIZATION ----- 2023-03-18 19:01:19 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 19:01:19 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/normalization-snowflake:0.2.26 exists... 2023-03-18 19:01:19 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/normalization-snowflake:0.2.26 was found locally. 2023-03-18 19:01:19 INFO i.a.w.p.DockerProcessFactory(create):130 - Creating docker container = normalization-snowflake-normalize-12-1-qnfuo with resources io.airbyte.config.ResourceRequirements@7b6c96ee[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] and allowedHosts null 2023-03-18 19:01:19 INFO i.a.w.p.DockerProcessFactory(create):175 - Preparing command: docker run --rm --init -i -w /data/12/1/normalize --log-driver none --name normalization-snowflake-normalize-12-1-qnfuo --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.42.0 airbyte/normalization-snowflake:0.2.26 run --integration-type snowflake --config destination_config.json --catalog destination_catalog.json 2023-03-18 19:01:19 normalization > Running: transform-config --config destination_config.json --integration-type snowflake --out /data/12/1/normalize 2023-03-18 19:01:20 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/12/1/normalize') 2023-03-18 19:01:20 normalization > transform_snowflake 2023-03-18 19:01:20 normalization > Running: transform-catalog --integration-type snowflake --profile-config-dir /data/12/1/normalize --catalog destination_catalog.json --out /data/12/1/normalize/models/generated/ --json-column _airbyte_data 2023-03-18 19:01:21 normalization > Processing destination_catalog.json... 2023-03-18 19:01:21 normalization > Generating airbyte_ctes/POSTHOG_PROD_SCHEMA/EVENTS_AB1.sql from events 2023-03-18 19:01:21 normalization > Generating airbyte_ctes/POSTHOG_PROD_SCHEMA/EVENTS_AB2.sql from events 2023-03-18 19:01:21 normalization > Generating airbyte_views/POSTHOG_PROD_SCHEMA/EVENTS_STG.sql from events 2023-03-18 19:01:21 normalization > Generating airbyte_incremental/scd/POSTHOG_PROD_SCHEMA/EVENTS_SCD.sql from events 2023-03-18 19:01:21 normalization > Generating airbyte_incremental/POSTHOG_PROD_SCHEMA/EVENTS.sql from events 2023-03-18 19:01:21 normalization > Generating airbyte_ctes/POSTHOG_PROD_SCHEMA/EVENTS_PERSON_AB1.sql from events/person 2023-03-18 19:01:21 normalization > Generating airbyte_ctes/POSTHOG_PROD_SCHEMA/EVENTS_PERSON_AB2.sql from events/person 2023-03-18 19:01:21 normalization > Generating airbyte_ctes/POSTHOG_PROD_SCHEMA/EVENTS_PERSON_AB3.sql from events/person 2023-03-18 19:01:21 normalization > Generating airbyte_incremental/POSTHOG_PROD_SCHEMA/EVENTS_PERSON.sql from events/person 2023-03-18 19:01:21 normalization > Ignoring stream 'elements' from events/elements because properties list is empty 2023-03-18 19:01:21 normalization > Ignoring stream 'event' from events/event because properties list is empty 2023-03-18 19:01:21 normalization > Ignoring stream 'distinct_ids' from events/person/distinct_ids because properties list is empty 2023-03-18 19:01:21 normalization > detected no config file for ssh, assuming ssh is off. 2023-03-18 19:01:23 normalization > [--event-buffer-size EVENT_BUFFER_SIZE] 2023-03-18 19:01:23 normalization > --event-buffer-size EVENT_BUFFER_SIZE 2023-03-18 19:01:23 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2023-03-18 19:01:23 normalization > DBT >=1.0.0 detected; using 10K event buffer size 2023-03-18 19:01:23 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2023-03-18 19:01:26 normalization > Running with dbt=1.0.0 2023-03-18 19:01:26 normalization > Partial parse save file not found. Starting full parse. 2023-03-18 19:01:27 normalization > [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. There are 1 unused configuration paths: - models.airbyte_utils.generated.airbyte_tables 2023-03-18 19:01:27 normalization > Found 9 models, 0 tests, 0 snapshots, 0 analyses, 615 macros, 0 operations, 0 seed files, 1 source, 0 exposures, 0 metrics 2023-03-18 19:01:32 normalization > Concurrency: 5 threads (target='prod') 2023-03-18 19:01:32 normalization > 1 of 4 START view model _AIRBYTE_POSTHOG_PROD_SCHEMA.EVENTS_STG......................................................... [RUN] 2023-03-18 19:01:34 normalization > 1 of 4 OK created view model _AIRBYTE_POSTHOG_PROD_SCHEMA.EVENTS_STG.................................................... [SUCCESS 1 in 2.02s] 2023-03-18 19:01:34 normalization > 2 of 4 START incremental model POSTHOG_PROD_SCHEMA.EVENTS_SCD........................................................... [RUN] 2023-03-18 19:01:55 normalization > 2 of 4 OK created incremental model POSTHOG_PROD_SCHEMA.EVENTS_SCD...................................................... [SUCCESS 1 in 20.69s] 2023-03-18 19:01:55 normalization > 3 of 4 START incremental model POSTHOG_PROD_SCHEMA.EVENTS............................................................... [RUN] 2023-03-18 19:01:55 normalization > 4 of 4 START incremental model POSTHOG_PROD_SCHEMA.EVENTS_PERSON........................................................ [RUN] 2023-03-18 19:02:02 normalization > 4 of 4 OK created incremental model POSTHOG_PROD_SCHEMA.EVENTS_PERSON................................................... [SUCCESS 1 in 6.69s] 2023-03-18 19:02:07 normalization > 3 of 4 OK created incremental model POSTHOG_PROD_SCHEMA.EVENTS.......................................................... [SUCCESS 1 in 12.22s] 2023-03-18 19:02:07 normalization > Finished running 1 view model, 3 incremental models in 40.06s. 2023-03-18 19:02:07 normalization > Completed successfully 2023-03-18 19:02:07 normalization > Done. PASS=4 WARN=0 ERROR=0 SKIP=0 TOTAL=4 2023-03-18 19:02:08 INFO i.a.w.n.DefaultNormalizationRunner(close):194 - Terminating normalization process... 2023-03-18 19:02:08 INFO i.a.w.n.DefaultNormalizationRunner(close):207 - Normalization process successfully terminated. 2023-03-18 19:02:08 INFO i.a.w.g.DefaultNormalizationWorker(run):97 - Normalization executed in 48 seconds for job 12. 2023-03-18 19:02:08 INFO i.a.w.g.DefaultNormalizationWorker(run):109 - Normalization summary: io.airbyte.config.NormalizationSummary@731a442d[startTime=1679166079661,endTime=1679166128192,failures=[]] 2023-03-18 19:02:08 INFO i.a.w.t.TemporalAttemptExecution(get):169 - Stopping cancellation check scheduling... 2023-03-18 19:02:08 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 19:02:08 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating... 2023-03-18 19:02:08 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END DEFAULT NORMALIZATION ----- 2023-03-18 19:02:08 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 19:02:19 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to Get a connection by connection Id 2023-03-18 19:02:19 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to get the most recent source actor catalog 2023-03-18 19:02:19 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to Get a connection by connection Id 2023-03-18 19:02:08 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to get state 2023-03-18 19:02:08 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to set attempt sync config 2023-03-18 19:02:08 INFO i.a.v.j.JsonSchemaValidator(test):129 - JSON schema validation failed. errors: $.auth_type: must be a constant value OAuth2.0, $.auth_type: does not have a value in the enumeration [OAuth2.0], $.access_token: is missing but it is required, $.refresh_token: is missing but it is required 2023-03-18 19:02:08 INFO i.a.v.j.JsonSchemaValidator(test):129 - JSON schema validation failed. errors: $.auth_type: must be a constant value Key Pair Authentication, $.auth_type: does not have a value in the enumeration [Key Pair Authentication], $.private_key: is missing but it is required 2023-03-18 19:02:08 INFO i.a.v.j.JsonSchemaValidator(test):129 - JSON schema validation failed. errors: $.password: object found, string expected 2023-03-18 19:02:08 INFO i.a.v.j.JsonSchemaValidator(test):129 - JSON schema validation failed. errors: $.method: does not have a value in the enumeration [Standard] 2023-03-18 19:02:08 INFO i.a.w.t.TemporalAttemptExecution(get):142 - Docker volume job log path: /tmp/workspace/12/2/logs.log 2023-03-18 19:02:08 INFO i.a.w.t.TemporalAttemptExecution(get):147 - Executing worker wrapper. Airbyte version: 0.42.0 2023-03-18 19:02:08 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to save workflow id for cancellation 2023-03-18 19:02:08 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 19:02:08 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-03-18 19:02:08 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START CHECK ----- 2023-03-18 19:02:08 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-03-18 19:02:08 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 19:02:08 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-03-18 19:02:08 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-03-18 19:02:08 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-03-18 19:02:08 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-03-18 19:02:08 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/source-posthog:0.1.8 exists... 2023-03-18 19:02:08 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/source-posthog:0.1.8 was found locally. 2023-03-18 19:02:08 INFO i.a.w.p.DockerProcessFactory(create):130 - Creating docker container = source-posthog-check-12-2-wzbaa with resources io.airbyte.config.ResourceRequirements@6f61d75f[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] and allowedHosts io.airbyte.config.AllowedHosts@1d8d285a[hosts=[https://app.posthog.com, app.posthog.com, *.datadoghq.com, *.datadoghq.eu, *.sentry.io],additionalProperties={}] 2023-03-18 19:02:08 INFO i.a.w.p.DockerProcessFactory(create):175 - Preparing command: docker run --rm --init -i -w /data/12/2 --log-driver none --name source-posthog-check-12-2-wzbaa --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e STRICT_COMPARISON_NORMALIZATION_WORKSPACES= -e WORKER_CONNECTOR_IMAGE=airbyte/source-posthog:0.1.8 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e STRICT_COMPARISON_NORMALIZATION_TAG=strict_comparison2 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=2 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.42.0 -e WORKER_JOB_ID=12 airbyte/source-posthog:0.1.8 check --config source_config.json 2023-03-18 19:02:08 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):107 - Reading messages from protocol version 0.2.0 2023-03-18 19:02:10 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - Check succeeded 2023-03-18 19:02:10 INFO i.a.w.g.DefaultCheckConnectionWorker(run):120 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@630e9ac5[status=succeeded,message=] 2023-03-18 19:02:10 INFO i.a.w.t.TemporalAttemptExecution(get):169 - Stopping cancellation check scheduling... 2023-03-18 19:02:10 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 19:02:10 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END CHECK ----- 2023-03-18 19:02:10 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 19:02:10 INFO i.a.w.t.TemporalAttemptExecution(get):142 - Docker volume job log path: /tmp/workspace/12/2/logs.log 2023-03-18 19:02:10 INFO i.a.w.t.TemporalAttemptExecution(get):147 - Executing worker wrapper. Airbyte version: 0.42.0 2023-03-18 19:02:10 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to save workflow id for cancellation 2023-03-18 19:02:10 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-03-18 19:02:10 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 19:02:10 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-03-18 19:02:10 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-03-18 19:02:10 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START CHECK ----- 2023-03-18 19:02:10 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-03-18 19:02:10 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 19:02:10 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-03-18 19:02:10 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-03-18 19:02:10 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/destination-snowflake:0.4.52 exists... 2023-03-18 19:02:10 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/destination-snowflake:0.4.52 was found locally. 2023-03-18 19:02:10 INFO i.a.w.p.DockerProcessFactory(create):130 - Creating docker container = destination-snowflake-check-12-2-vpsom with resources io.airbyte.config.ResourceRequirements@6f61d75f[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] and allowedHosts null 2023-03-18 19:02:10 INFO i.a.w.p.DockerProcessFactory(create):175 - Preparing command: docker run --rm --init -i -w /data/12/2 --log-driver none --name destination-snowflake-check-12-2-vpsom --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e STRICT_COMPARISON_NORMALIZATION_WORKSPACES= -e WORKER_CONNECTOR_IMAGE=airbyte/destination-snowflake:0.4.52 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e STRICT_COMPARISON_NORMALIZATION_TAG=strict_comparison2 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=2 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.42.0 -e WORKER_JOB_ID=12 airbyte/destination-snowflake:0.4.52 check --config source_config.json 2023-03-18 19:02:10 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):107 - Reading messages from protocol version 0.2.0 2023-03-18 19:02:11 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO i.a.i.b.a.AdaptiveDestinationRunner$Runner(getDestination):74 Running destination under deployment mode: OSS 2023-03-18 19:02:11 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO i.a.i.b.a.AdaptiveDestinationRunner$Runner(run):86 Starting destination: io.airbyte.integrations.destination.snowflake.SnowflakeDestination 2023-03-18 19:02:12 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {check=null, config=source_config.json} 2023-03-18 19:02:12 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO i.a.i.b.IntegrationRunner(runInternal):105 Running integration: io.airbyte.integrations.destination.snowflake.SnowflakeDestination 2023-03-18 19:02:12 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO i.a.i.b.IntegrationRunner(runInternal):106 Command: CHECK 2023-03-18 19:02:12 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO i.a.i.b.IntegrationRunner(runInternal):107 Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2023-03-18 19:02:12 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):165 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-03-18 19:02:12 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):165 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-03-18 19:02:12 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO i.a.i.d.j.c.SwitchingDestination(check):55 Using destination type: INTERNAL_STAGING 2023-03-18 19:02:12 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO c.z.h.HikariDataSource(getConnection):110 HikariPool-1 - Starting... 2023-03-18 19:02:14 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO c.z.h.p.HikariPool(checkFailFast):565 HikariPool-1 - Added connection net.snowflake.client.jdbc.SnowflakeConnectionV1@5922d3e9 2023-03-18 19:02:14 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO c.z.h.HikariDataSource(getConnection):123 HikariPool-1 - Start completed. 2023-03-18 19:02:15 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO i.a.d.j.DefaultJdbcDatabase(lambda$unsafeQuery$1):115 closing connection 2023-03-18 19:02:15 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO i.a.i.d.s.SnowflakeSqlOperations(insertRecordsInternal):60 actual size of batch: 1 2023-03-18 19:02:17 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO c.z.h.HikariDataSource(close):350 HikariPool-1 - Shutdown initiated... 2023-03-18 19:02:18 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO c.z.h.HikariDataSource(close):352 HikariPool-1 - Shutdown completed. 2023-03-18 19:02:18 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO i.a.i.b.IntegrationRunner(runInternal):182 Completed integration: io.airbyte.integrations.destination.snowflake.SnowflakeDestination 2023-03-18 19:02:18 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):168 - INFO i.a.i.b.a.AdaptiveDestinationRunner$Runner(run):88 Completed destination: io.airbyte.integrations.destination.snowflake.SnowflakeDestination 2023-03-18 19:02:19 INFO i.a.w.g.DefaultCheckConnectionWorker(run):120 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@3b626170[status=succeeded,message=] 2023-03-18 19:02:19 INFO i.a.w.t.TemporalAttemptExecution(get):169 - Stopping cancellation check scheduling... 2023-03-18 19:02:19 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 19:02:19 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END CHECK ----- 2023-03-18 19:02:19 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 19:02:19 INFO i.a.w.t.TemporalAttemptExecution(get):142 - Docker volume job log path: /tmp/workspace/12/2/logs.log 2023-03-18 19:02:19 INFO i.a.w.t.TemporalAttemptExecution(get):147 - Executing worker wrapper. Airbyte version: 0.42.0 2023-03-18 19:02:19 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to save workflow id for cancellation 2023-03-18 19:02:19 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable METRIC_CLIENT: '' 2023-03-18 19:02:19 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2023-03-18 19:02:19 INFO i.a.w.g.DefaultReplicationWorker(run):164 - start sync worker. job id: 12 attempt id: 2 2023-03-18 19:02:19 INFO i.a.w.g.DefaultReplicationWorker(run):166 - Committing states from persistState activity 2023-03-18 19:02:19 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 19:02:19 INFO i.a.w.g.DefaultReplicationWorker(run):182 - configured sync modes: {null.events=incremental - append_dedup} 2023-03-18 19:02:19 INFO i.a.w.i.DefaultAirbyteDestination(start):87 - Running destination... 2023-03-18 19:02:19 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START REPLICATION ----- 2023-03-18 19:02:19 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 19:02:19 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-03-18 19:02:19 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-03-18 19:02:19 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-03-18 19:02:19 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-03-18 19:02:19 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-03-18 19:02:19 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-03-18 19:02:19 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/destination-snowflake:0.4.52 exists... 2023-03-18 19:02:19 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/destination-snowflake:0.4.52 was found locally. 2023-03-18 19:02:19 INFO i.a.w.p.DockerProcessFactory(create):130 - Creating docker container = destination-snowflake-write-12-2-kmnqn with resources io.airbyte.config.ResourceRequirements@5e80d88e[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] and allowedHosts null 2023-03-18 19:02:19 INFO i.a.w.p.DockerProcessFactory(create):175 - Preparing command: docker run --rm --init -i -w /data/12/2 --log-driver none --name destination-snowflake-write-12-2-kmnqn --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e STRICT_COMPARISON_NORMALIZATION_WORKSPACES= -e WORKER_CONNECTOR_IMAGE=airbyte/destination-snowflake:0.4.52 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e STRICT_COMPARISON_NORMALIZATION_TAG=strict_comparison2 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=2 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.42.0 -e WORKER_JOB_ID=12 airbyte/destination-snowflake:0.4.52 write --config destination_config.json --catalog destination_catalog.json 2023-03-18 19:02:19 INFO i.a.w.i.VersionedAirbyteMessageBufferedWriterFactory(createWriter):41 - Writing messages to protocol version 0.2.0 2023-03-18 19:02:19 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):107 - Reading messages from protocol version 0.2.0 2023-03-18 19:02:19 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-03-18 19:02:19 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-03-18 19:02:19 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-03-18 19:02:19 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-03-18 19:02:19 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-03-18 19:02:19 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-03-18 19:02:19 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/source-posthog:0.1.8 exists... 2023-03-18 19:02:19 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/source-posthog:0.1.8 was found locally. 2023-03-18 19:02:19 INFO i.a.w.p.DockerProcessFactory(create):130 - Creating docker container = source-posthog-read-12-2-wcoyh with resources io.airbyte.config.ResourceRequirements@7fefd9cb[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] and allowedHosts io.airbyte.config.AllowedHosts@39055c92[hosts=[https://app.posthog.com, app.posthog.com, *.datadoghq.com, *.datadoghq.eu, *.sentry.io],additionalProperties={}] 2023-03-18 19:02:19 INFO i.a.w.p.DockerProcessFactory(create):175 - Preparing command: docker run --rm --init -i -w /data/12/2 --log-driver none --name source-posthog-read-12-2-wcoyh --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e STRICT_COMPARISON_NORMALIZATION_WORKSPACES= -e WORKER_CONNECTOR_IMAGE=airbyte/source-posthog:0.1.8 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e STRICT_COMPARISON_NORMALIZATION_TAG=strict_comparison2 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=2 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.42.0 -e WORKER_JOB_ID=12 airbyte/source-posthog:0.1.8 read --config source_config.json --catalog source_catalog.json --state input_state.json 2023-03-18 19:02:19 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):107 - Reading messages from protocol version 0.2.0 2023-03-18 19:02:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromDstRunnable$4):312 - Destination output thread started. 2023-03-18 19:02:19 INFO i.a.w.g.DefaultReplicationWorker(replicate):268 - Waiting for source and destination threads to complete. 2023-03-18 19:02:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):377 - Replication thread started. 2023-03-18 19:02:20 destination > INFO i.a.i.b.a.AdaptiveDestinationRunner$Runner(getDestination):74 Running destination under deployment mode: OSS 2023-03-18 19:02:21 destination > INFO i.a.i.b.a.AdaptiveDestinationRunner$Runner(run):86 Starting destination: io.airbyte.integrations.destination.snowflake.SnowflakeDestination 2023-03-18 19:02:21 destination > INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2023-03-18 19:02:21 destination > INFO i.a.i.b.IntegrationRunner(runInternal):105 Running integration: io.airbyte.integrations.destination.snowflake.SnowflakeDestination 2023-03-18 19:02:21 destination > INFO i.a.i.b.IntegrationRunner(runInternal):106 Command: WRITE 2023-03-18 19:02:21 destination > INFO i.a.i.b.IntegrationRunner(runInternal):107 Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2023-03-18 19:02:21 destination > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-03-18 19:02:21 destination > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-03-18 19:02:21 source > Starting syncing SourcePosthog 2023-03-18 19:02:21 destination > INFO i.a.i.d.j.c.SwitchingDestination(getConsumer):65 Using destination type: INTERNAL_STAGING 2023-03-18 19:02:21 source > Syncing stream: events 2023-03-18 19:02:21 source > Setting state of events stream to {'13967': {'timestamp': '2022-09-26T23:59:58.151000+00:00'}} 2023-03-18 19:02:21 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$toWriteConfig$0):121 Write config: WriteConfig{streamName=events, namespace=null, outputSchemaName=POSTHOG_PROD_SCHEMA, tmpTableName=_airbyte_tmp_xuc_events, outputTableName=_airbyte_raw_events, syncMode=append_dedup} 2023-03-18 19:02:21 destination > INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):146 class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2023-03-18 19:02:21 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$onStartFunction$1):139 Preparing raw tables in destination started for 1 streams 2023-03-18 19:02:21 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$onStartFunction$1):148 Preparing staging area in destination started for schema POSTHOG_PROD_SCHEMA stream events: target table: _airbyte_raw_events, stage: 2023/03/18/19/7A6F9642-6613-41DB-AEA0-D8E50D64D6A5/ 2023-03-18 19:02:21 destination > INFO c.z.h.HikariDataSource(getConnection):110 HikariPool-1 - Starting... 2023-03-18 19:02:22 source > Backing off _send(...) for 0.0s (airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-26T23%3A59%3A58.151000%2B0000, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 1065 seconds.","attr":null}) 2023-03-18 19:02:22 source > Retrying. Sleeping for 10 seconds 2023-03-18 19:02:23 destination > INFO c.z.h.p.HikariPool(checkFailFast):565 HikariPool-1 - Added connection net.snowflake.client.jdbc.SnowflakeConnectionV1@3ddeaa5f 2023-03-18 19:02:23 destination > INFO c.z.h.HikariDataSource(getConnection):123 HikariPool-1 - Start completed. 2023-03-18 19:02:23 destination > INFO i.a.d.j.DefaultJdbcDatabase(lambda$unsafeQuery$1):115 closing connection 2023-03-18 19:02:24 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$onStartFunction$1):165 Preparing staging area in destination completed for schema POSTHOG_PROD_SCHEMA stream events 2023-03-18 19:02:24 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$onStartFunction$1):167 Executing finalization of tables. 2023-03-18 19:02:33 source > Backing off _send(...) for 0.0s (airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-26T23%3A59%3A58.151000%2B0000, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 1054 seconds.","attr":null}) 2023-03-18 19:02:33 source > Retrying. Sleeping for 20 seconds 2023-03-18 19:02:54 source > Backing off _send(...) for 0.0s (airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-26T23%3A59%3A58.151000%2B0000, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 1033 seconds.","attr":null}) 2023-03-18 19:02:54 source > Retrying. Sleeping for 40 seconds 2023-03-18 19:03:36 source > Backing off _send(...) for 0.0s (airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-26T23%3A59%3A58.151000%2B0000, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 991 seconds.","attr":null}) 2023-03-18 19:03:36 source > Retrying. Sleeping for 80 seconds 2023-03-18 19:04:57 source > Backing off _send(...) for 0.0s (airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-26T23%3A59%3A58.151000%2B0000, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 910 seconds.","attr":null}) 2023-03-18 19:04:57 source > Retrying. Sleeping for 160 seconds 2023-03-18 19:07:38 source > Giving up _send(...) after 6 tries (airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-26T23%3A59%3A58.151000%2B0000, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 748 seconds.","attr":null}) 2023-03-18 19:07:38 source > Max retry limit reached. Request: , Response: 2023-03-18 19:07:38 source > Encountered an exception while reading stream events Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 111, in read yield from self._read_stream( File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 180, in _read_stream for record in record_iterator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 243, in _read_incremental for message_counter, record_data_or_message in enumerate(records, start=1): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/declarative_stream.py", line 115, in read_records for record in self.retriever.read_records(sync_mode, cursor_field, stream_slice, stream_state): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/retrievers/simple_retriever.py", line 374, in read_records for record in records_generator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 429, in _read_pages request, response = self._fetch_next_page(stream_slice, stream_state, next_page_token) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 452, in _fetch_next_page response = self._send_request(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 354, in _send_request return backoff_handler(user_backoff_handler)(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 310, in _send raise UserDefinedBackoffException( airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-26T23%3A59%3A58.151000%2B0000, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 748 seconds.","attr":null} 2023-03-18 19:07:38 source > Finished syncing events 2023-03-18 19:07:38 source > SourcePosthog runtimes: Syncing stream events 0:05:17.431498 2023-03-18 19:07:38 source > Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-26T23%3A59%3A58.151000%2B0000, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 748 seconds.","attr":null} Traceback (most recent call last): File "/airbyte/integration_code/main.py", line 13, in launch(source, sys.argv[1:]) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 131, in launch for message in source_entrypoint.run(parsed_args): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 122, in run for message in generator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/manifest_declarative_source.py", line 112, in read yield from super().read(logger, config, catalog, state) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 125, in read raise e File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 111, in read yield from self._read_stream( File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 180, in _read_stream for record in record_iterator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 243, in _read_incremental for message_counter, record_data_or_message in enumerate(records, start=1): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/declarative_stream.py", line 115, in read_records for record in self.retriever.read_records(sync_mode, cursor_field, stream_slice, stream_state): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/retrievers/simple_retriever.py", line 374, in read_records for record in records_generator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 429, in _read_pages request, response = self._fetch_next_page(stream_slice, stream_state, next_page_token) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 452, in _fetch_next_page response = self._send_request(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 354, in _send_request return backoff_handler(user_backoff_handler)(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 310, in _send raise UserDefinedBackoffException( airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-26T23%3A59%3A58.151000%2B0000, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 748 seconds.","attr":null} 2023-03-18 19:07:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$7):433 - Source has no more messages, closing connection. 2023-03-18 19:07:39 destination > INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):80 Airbyte message consumer: succeeded. 2023-03-18 19:07:39 destination > INFO i.a.i.d.b.BufferedStreamConsumer(close):256 executing on success close procedure. 2023-03-18 19:07:39 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(flushAll):130 Flushing all 0 current buffers (0 bytes in total) 2023-03-18 19:07:39 destination > INFO i.a.i.d.j.SqlOperations(onDestinationCloseOperations):154 No onDestinationCloseOperations required for this destination. 2023-03-18 19:07:39 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$onCloseFunction$4):272 Finalizing tables in destination completed. 2023-03-18 19:07:39 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$onCloseFunction$4):276 Cleaning up destination started for 1 streams 2023-03-18 19:07:39 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$onCloseFunction$4):281 Cleaning stage in destination started for stream events. schema POSTHOG_PROD_SCHEMA, stage: POSTHOG_PROD_SCHEMA_EVENTS 2023-03-18 19:07:40 destination > INFO i.a.i.d.s.StagingConsumerFactory(lambda$onCloseFunction$4):286 Cleaning up destination completed. 2023-03-18 19:07:40 destination > INFO i.a.i.b.IntegrationRunner(runInternal):182 Completed integration: io.airbyte.integrations.destination.snowflake.SnowflakeDestination 2023-03-18 19:07:40 destination > INFO i.a.i.b.a.AdaptiveDestinationRunner$Runner(run):88 Completed destination: io.airbyte.integrations.destination.snowflake.SnowflakeDestination 2023-03-18 19:07:41 ERROR i.a.w.g.DefaultReplicationWorker(replicate):280 - Sync worker failed. java.util.concurrent.ExecutionException: io.airbyte.workers.internal.exception.SourceException: Source didn't exit properly - check the logs! at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.general.DefaultReplicationWorker.replicate(DefaultReplicationWorker.java:272) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:190) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:94) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$6(TemporalAttemptExecution.java:202) ~[io.airbyte-airbyte-workers-0.42.0.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Suppressed: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:158) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.replicate(DefaultReplicationWorker.java:215) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:190) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:94) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$6(TemporalAttemptExecution.java:202) ~[io.airbyte-airbyte-workers-0.42.0.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Caused by: io.airbyte.workers.internal.exception.SourceException: Source didn't exit properly - check the logs! at io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$7(DefaultReplicationWorker.java:437) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:158) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$7(DefaultReplicationWorker.java:435) ~[io.airbyte-airbyte-commons-worker-0.42.0.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?] ... 1 more 2023-03-18 19:07:41 INFO i.a.w.g.DefaultReplicationWorker(prepStateForLaterSaving):607 - Source did not output any state messages 2023-03-18 19:07:41 WARN i.a.w.g.DefaultReplicationWorker(prepStateForLaterSaving):615 - State capture: No new state, falling back on input state: io.airbyte.config.State@5b5f3e69[state=[{"type":"STREAM","stream":{"stream_descriptor":{"name":"events"},"stream_state":{"13967":{"timestamp":"2022-09-26T23:59:58.151000+00:00"}}}}]] 2023-03-18 19:07:41 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):538 - sync summary: { "status" : "failed", "recordsSynced" : 0, "bytesSynced" : 0, "startTime" : 1679166139451, "endTime" : 1679166461789, "totalStats" : { "bytesEmitted" : 0, "destinationStateMessagesEmitted" : 0, "destinationWriteEndTime" : 1679166461788, "destinationWriteStartTime" : 1679166139534, "meanSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBetweenStateMessageEmittedandCommitted" : 0, "meanSecondsBetweenStateMessageEmittedandCommitted" : 0, "recordsEmitted" : 0, "recordsCommitted" : 0, "replicationEndTime" : 1679166461789, "replicationStartTime" : 1679166139451, "sourceReadEndTime" : 0, "sourceReadStartTime" : 1679166139487, "sourceStateMessagesEmitted" : 0 }, "streamStats" : [ ] } 2023-03-18 19:07:41 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):539 - failures: [ { "failureOrigin" : "source", "failureType" : "system_error", "internalMessage" : "Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-26T23%3A59%3A58.151000%2B0000, Response Code: 429, Response Text: {\"type\":\"throttled_error\",\"code\":\"throttled\",\"detail\":\"Request was throttled. Expected available in 748 seconds.\",\"attr\":null}", "externalMessage" : "Something went wrong in the connector. See the logs for more details.", "metadata" : { "attemptNumber" : 2, "jobId" : 12, "from_trace_message" : true, "connector_command" : "read" }, "stacktrace" : "Traceback (most recent call last):\n File \"/airbyte/integration_code/main.py\", line 13, in \n launch(source, sys.argv[1:])\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py\", line 131, in launch\n for message in source_entrypoint.run(parsed_args):\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py\", line 122, in run\n for message in generator:\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/manifest_declarative_source.py\", line 112, in read\n yield from super().read(logger, config, catalog, state)\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py\", line 125, in read\n raise e\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py\", line 111, in read\n yield from self._read_stream(\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py\", line 180, in _read_stream\n for record in record_iterator:\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py\", line 243, in _read_incremental\n for message_counter, record_data_or_message in enumerate(records, start=1):\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/declarative_stream.py\", line 115, in read_records\n for record in self.retriever.read_records(sync_mode, cursor_field, stream_slice, stream_state):\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/retrievers/simple_retriever.py\", line 374, in read_records\n for record in records_generator:\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 429, in _read_pages\n request, response = self._fetch_next_page(stream_slice, stream_state, next_page_token)\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 452, in _fetch_next_page\n response = self._send_request(request, request_kwargs)\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 354, in _send_request\n return backoff_handler(user_backoff_handler)(request, request_kwargs)\n File \"/usr/local/lib/python3.9/site-packages/backoff/_sync.py\", line 105, in retry\n ret = target(*args, **kwargs)\n File \"/usr/local/lib/python3.9/site-packages/backoff/_sync.py\", line 105, in retry\n ret = target(*args, **kwargs)\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 310, in _send\n raise UserDefinedBackoffException(\nairbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-26T23%3A59%3A58.151000%2B0000, Response Code: 429, Response Text: {\"type\":\"throttled_error\",\"code\":\"throttled\",\"detail\":\"Request was throttled. Expected available in 748 seconds.\",\"attr\":null}\n", "timestamp" : 1679166458945 }, { "failureOrigin" : "source", "internalMessage" : "Source didn't exit properly - check the logs!", "externalMessage" : "Something went wrong within the source connector", "metadata" : { "attemptNumber" : 2, "jobId" : 12, "connector_command" : "read" }, "stacktrace" : "io.airbyte.workers.internal.exception.SourceException: Source didn't exit properly - check the logs!\n\tat io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$7(DefaultReplicationWorker.java:437)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)\n\tat java.base/java.lang.Thread.run(Thread.java:1589)\nCaused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled.\n\tat io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:158)\n\tat io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$7(DefaultReplicationWorker.java:435)\n\t... 4 more\n", "timestamp" : 1679166459139 } ] 2023-03-18 19:07:41 INFO i.a.w.t.TemporalAttemptExecution(get):169 - Stopping cancellation check scheduling... 2023-03-18 19:07:41 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 19:07:41 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END REPLICATION ----- 2023-03-18 19:07:41 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 19:07:41 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$4):259 - sync summary: io.airbyte.config.StandardSyncOutput@5418ebcc[standardSyncSummary=io.airbyte.config.StandardSyncSummary@4ccb0885[status=failed,recordsSynced=0,bytesSynced=0,startTime=1679166139451,endTime=1679166461789,totalStats=io.airbyte.config.SyncStats@35903b20[bytesEmitted=0,destinationStateMessagesEmitted=0,destinationWriteEndTime=1679166461788,destinationWriteStartTime=1679166139534,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,recordsEmitted=0,recordsCommitted=0,replicationEndTime=1679166461789,replicationStartTime=1679166139451,sourceReadEndTime=0,sourceReadStartTime=1679166139487,sourceStateMessagesEmitted=0,additionalProperties={}],streamStats=[]],normalizationSummary=,webhookOperationSummary=,state=io.airbyte.config.State@5b5f3e69[state=[{"type":"STREAM","stream":{"stream_descriptor":{"name":"events"},"stream_state":{"13967":{"timestamp":"2022-09-26T23:59:58.151000+00:00"}}}}]],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@ab0a7e[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@13fed72c[stream=io.airbyte.protocol.models.AirbyteStream@7656af6[name=events,jsonSchema={"type":"object","properties":{"person":{"type":"object","properties":{"is_identified":{"type":"boolean"},"properties":{"type":"object"},"distinct_ids":{"type":"array","items":{"type":"string"}}}},"distinct_id":{"type":"string"},"elements":{"type":"array","items":{"type":["string","object"]}},"id":{"type":"string"},"event":{"type":["string","object"]},"elements_chain":{"type":"string"},"properties":{"type":"object"},"timestamp":{"format":"date-time","type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[timestamp],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=incremental,cursorField=[timestamp],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[io.airbyte.config.FailureReason@33980801[failureOrigin=source,failureType=system_error,internalMessage=Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-26T23%3A59%3A58.151000%2B0000, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 748 seconds.","attr":null},externalMessage=Something went wrong in the connector. See the logs for more details.,metadata=io.airbyte.config.Metadata@6bb80cf6[additionalProperties={attemptNumber=2, jobId=12, from_trace_message=true, connector_command=read}],stacktrace=Traceback (most recent call last): File "/airbyte/integration_code/main.py", line 13, in launch(source, sys.argv[1:]) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 131, in launch for message in source_entrypoint.run(parsed_args): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 122, in run for message in generator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/manifest_declarative_source.py", line 112, in read yield from super().read(logger, config, catalog, state) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 125, in read raise e File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 111, in read yield from self._read_stream( File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 180, in _read_stream for record in record_iterator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 243, in _read_incremental for message_counter, record_data_or_message in enumerate(records, start=1): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/declarative_stream.py", line 115, in read_records for record in self.retriever.read_records(sync_mode, cursor_field, stream_slice, stream_state): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/retrievers/simple_retriever.py", line 374, in read_records for record in records_generator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 429, in _read_pages request, response = self._fetch_next_page(stream_slice, stream_state, next_page_token) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 452, in _fetch_next_page response = self._send_request(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 354, in _send_request return backoff_handler(user_backoff_handler)(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 310, in _send raise UserDefinedBackoffException( airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://app.posthog.com/api/projects/13967/events?limit=100&after=2022-09-26T23%3A59%3A58.151000%2B00%3A00&before=2022-10-26T23%3A59%3A58.151000%2B0000, Response Code: 429, Response Text: {"type":"throttled_error","code":"throttled","detail":"Request was throttled. Expected available in 748 seconds.","attr":null} ,retryable=,timestamp=1679166458945], io.airbyte.config.FailureReason@e9ae11a[failureOrigin=source,failureType=,internalMessage=Source didn't exit properly - check the logs!,externalMessage=Something went wrong within the source connector,metadata=io.airbyte.config.Metadata@220418e5[additionalProperties={attemptNumber=2, jobId=12, connector_command=read}],stacktrace=io.airbyte.workers.internal.exception.SourceException: Source didn't exit properly - check the logs! at io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$7(DefaultReplicationWorker.java:437) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) at java.base/java.lang.Thread.run(Thread.java:1589) Caused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:158) at io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$7(DefaultReplicationWorker.java:435) ... 4 more ,retryable=,timestamp=1679166459139]],commitStateAsap=false] 2023-03-18 19:07:41 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$4):264 - Sync summary length: 7150 2023-03-18 19:07:41 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating... 2023-03-18 19:07:41 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to get state 2023-03-18 19:07:41 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to create or update state 2023-03-18 19:07:41 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to get normalization statuses 2023-03-18 19:07:41 INFO i.a.w.t.s.NormalizationActivityImpl(lambda$normalize$3):146 - Using protocol v0 2023-03-18 19:07:41 INFO i.a.w.t.s.NormalizationActivityImpl(lambda$normalize$3):166 - Using normalization: airbyte/normalization-snowflake:0.2.26 2023-03-18 19:07:41 INFO i.a.w.t.TemporalAttemptExecution(get):142 - Docker volume job log path: /tmp/workspace/12/2/logs.log 2023-03-18 19:07:41 INFO i.a.w.t.TemporalAttemptExecution(get):147 - Executing worker wrapper. Airbyte version: 0.42.0 2023-03-18 19:07:41 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to save workflow id for cancellation 2023-03-18 19:07:41 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):129 - Running with normalization version: airbyte/normalization-snowflake:0.2.26 2023-03-18 19:07:41 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 19:07:41 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START DEFAULT NORMALIZATION ----- 2023-03-18 19:07:41 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 19:07:41 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/normalization-snowflake:0.2.26 exists... 2023-03-18 19:07:41 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/normalization-snowflake:0.2.26 was found locally. 2023-03-18 19:07:41 INFO i.a.w.p.DockerProcessFactory(create):130 - Creating docker container = normalization-snowflake-normalize-12-2-isbaj with resources io.airbyte.config.ResourceRequirements@76555cc7[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] and allowedHosts null 2023-03-18 19:07:41 INFO i.a.w.p.DockerProcessFactory(create):175 - Preparing command: docker run --rm --init -i -w /data/12/2/normalize --log-driver none --name normalization-snowflake-normalize-12-2-isbaj --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.42.0 airbyte/normalization-snowflake:0.2.26 run --integration-type snowflake --config destination_config.json --catalog destination_catalog.json 2023-03-18 19:07:42 normalization > Running: transform-config --config destination_config.json --integration-type snowflake --out /data/12/2/normalize 2023-03-18 19:07:42 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/12/2/normalize') 2023-03-18 19:07:42 normalization > transform_snowflake 2023-03-18 19:07:42 normalization > Running: transform-catalog --integration-type snowflake --profile-config-dir /data/12/2/normalize --catalog destination_catalog.json --out /data/12/2/normalize/models/generated/ --json-column _airbyte_data 2023-03-18 19:07:43 normalization > Processing destination_catalog.json... 2023-03-18 19:07:43 normalization > Generating airbyte_ctes/POSTHOG_PROD_SCHEMA/EVENTS_AB1.sql from events 2023-03-18 19:07:43 normalization > Generating airbyte_ctes/POSTHOG_PROD_SCHEMA/EVENTS_AB2.sql from events 2023-03-18 19:07:43 normalization > Generating airbyte_views/POSTHOG_PROD_SCHEMA/EVENTS_STG.sql from events 2023-03-18 19:07:43 normalization > Generating airbyte_incremental/scd/POSTHOG_PROD_SCHEMA/EVENTS_SCD.sql from events 2023-03-18 19:07:43 normalization > Generating airbyte_incremental/POSTHOG_PROD_SCHEMA/EVENTS.sql from events 2023-03-18 19:07:43 normalization > Generating airbyte_ctes/POSTHOG_PROD_SCHEMA/EVENTS_PERSON_AB1.sql from events/person 2023-03-18 19:07:43 normalization > Generating airbyte_ctes/POSTHOG_PROD_SCHEMA/EVENTS_PERSON_AB2.sql from events/person 2023-03-18 19:07:43 normalization > Generating airbyte_ctes/POSTHOG_PROD_SCHEMA/EVENTS_PERSON_AB3.sql from events/person 2023-03-18 19:07:43 normalization > Generating airbyte_incremental/POSTHOG_PROD_SCHEMA/EVENTS_PERSON.sql from events/person 2023-03-18 19:07:43 normalization > Ignoring stream 'elements' from events/elements because properties list is empty 2023-03-18 19:07:43 normalization > Ignoring stream 'event' from events/event because properties list is empty 2023-03-18 19:07:43 normalization > Ignoring stream 'distinct_ids' from events/person/distinct_ids because properties list is empty 2023-03-18 19:07:43 normalization > detected no config file for ssh, assuming ssh is off. 2023-03-18 19:07:45 normalization > [--event-buffer-size EVENT_BUFFER_SIZE] 2023-03-18 19:07:45 normalization > --event-buffer-size EVENT_BUFFER_SIZE 2023-03-18 19:07:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2023-03-18 19:07:45 normalization > DBT >=1.0.0 detected; using 10K event buffer size 2023-03-18 19:07:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2023-03-18 19:07:48 normalization > Running with dbt=1.0.0 2023-03-18 19:07:48 normalization > Partial parse save file not found. Starting full parse. 2023-03-18 19:07:49 normalization > [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. There are 1 unused configuration paths: - models.airbyte_utils.generated.airbyte_tables 2023-03-18 19:07:49 normalization > Found 9 models, 0 tests, 0 snapshots, 0 analyses, 615 macros, 0 operations, 0 seed files, 1 source, 0 exposures, 0 metrics 2023-03-18 19:07:54 normalization > Concurrency: 5 threads (target='prod') 2023-03-18 19:07:54 normalization > 1 of 4 START view model _AIRBYTE_POSTHOG_PROD_SCHEMA.EVENTS_STG......................................................... [RUN] 2023-03-18 19:07:56 normalization > 1 of 4 OK created view model _AIRBYTE_POSTHOG_PROD_SCHEMA.EVENTS_STG.................................................... [SUCCESS 1 in 2.27s] 2023-03-18 19:07:56 normalization > 2 of 4 START incremental model POSTHOG_PROD_SCHEMA.EVENTS_SCD........................................................... [RUN] 2023-03-18 19:08:17 normalization > 2 of 4 OK created incremental model POSTHOG_PROD_SCHEMA.EVENTS_SCD...................................................... [SUCCESS 1 in 20.67s] 2023-03-18 19:08:17 normalization > 3 of 4 START incremental model POSTHOG_PROD_SCHEMA.EVENTS............................................................... [RUN] 2023-03-18 19:08:17 normalization > 4 of 4 START incremental model POSTHOG_PROD_SCHEMA.EVENTS_PERSON........................................................ [RUN] 2023-03-18 19:08:24 normalization > 4 of 4 OK created incremental model POSTHOG_PROD_SCHEMA.EVENTS_PERSON................................................... [SUCCESS 1 in 6.71s] 2023-03-18 19:08:27 normalization > 3 of 4 OK created incremental model POSTHOG_PROD_SCHEMA.EVENTS.......................................................... [SUCCESS 1 in 10.16s] 2023-03-18 19:08:27 normalization > Finished running 1 view model, 3 incremental models in 38.04s. 2023-03-18 19:08:27 normalization > Completed successfully 2023-03-18 19:08:27 normalization > Done. PASS=4 WARN=0 ERROR=0 SKIP=0 TOTAL=4 2023-03-18 19:08:28 INFO i.a.w.n.DefaultNormalizationRunner(close):194 - Terminating normalization process... 2023-03-18 19:08:28 INFO i.a.w.n.DefaultNormalizationRunner(close):207 - Normalization process successfully terminated. 2023-03-18 19:08:28 INFO i.a.w.g.DefaultNormalizationWorker(run):97 - Normalization executed in 46 seconds for job 12. 2023-03-18 19:08:28 INFO i.a.w.g.DefaultNormalizationWorker(run):109 - Normalization summary: io.airbyte.config.NormalizationSummary@ba9709c[startTime=1679166461949,endTime=1679166508296,failures=[]] 2023-03-18 19:08:28 INFO i.a.w.t.TemporalAttemptExecution(get):169 - Stopping cancellation check scheduling... 2023-03-18 19:08:28 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-03-18 19:08:28 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END DEFAULT NORMALIZATION ----- 2023-03-18 19:08:28 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating... 2023-03-18 19:08:28 INFO i.a.c.i.LineGobbler(voidCall):149 -