Summary
Error message related to unknown keywords in Snowflake destination connections
Question
Getting an error with all my connections with Snowflake destination (tested with version 3.15.2, 3.15.0, and 3.14), looks similar to this error: https://github.com/airbytehq/airbyte/issues/32479
2024-11-21 21:18:33 replication-orchestrator > Stream Status Update Received: pagespeed - RUNNING
2024-11-21 21:18:33 replication-orchestrator > Creating status: pagespeed - RUNNING
2024-11-21 21:18:33 destination > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword pattern_descriptor - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2024-11-21 21:18:33 destination > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2024-11-21 21:18:34 destination > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2024-11-21 21:18:34 destination > WARN main c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_hidden - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2024-11-21 21:18:37 destination > INFO main i.a.i.b.d.t.CatalogParser(parseCatalog):132 Running sync with stream configs: [StreamConfig(id=StreamId(finalNamespace=PAGESPEED, finalName=PAGESPEED, rawNamespace=airbyte_internal, rawName=pagespeed_raw__stream_pagespeed, originalNamespace=pagespeed, originalName=pagespeed), postImportAction=APPEND, primaryKey=[], cursor=Optional.empty, columns={ColumnId(name=ID, originalName=id, canonicalName=ID)=STRING, ColumnId(name=KIND, originalName=kind, canonicalName=KIND)=STRING, ColumnId(name=STRATEGY, originalName=strategy, canonicalName=STRATEGY)=STRING, ColumnId(name=CAPTCHARESULT, originalName=captchaResult, canonicalName=CAPTCHARESULT)=STRING, ColumnId(name=LIGHTHOUSERESULT, originalName=lighthouseResult, canonicalName=LIGHTHOUSERESULT)=Struct(properties={audits=Struct(properties={}), finalUrl=STRING, fetchTime=STRING, userAgent=STRING, categories=Struct(properties={}), environment=Struct(properties={hostUserAgent=STRING, benchmarkIndex=NUMBER, networkUserAgent=STRING}), runWarnings=Array(items=UNKNOWN), requestedUrl=STRING, categoryGroups=Struct(properties={}), configSettings=Struct(properties={locale=STRING, channel=STRING, formFactor=STRING, onlyCategories=Array(items=STRING), emulatedFormFactor=STRING}), lighthouseVersion=STRING}), ColumnId(name=LOADINGEXPERIENCE, originalName=loadingExperience, canonicalName=LOADINGEXPERIENCE)=Struct(properties={id=STRING, metrics=Struct(properties={FIRST_INPUT_DELAY_MS=Struct(properties={category=STRING, percentile=NUMBER, distributions=Array(items=Struct(properties={max=NUMBER, min=NUMBER, proportion=NUMBER}))}), FIRST_CONTENTFUL_PAINT_MS=Struct(properties={category=STRING, percentile=NUMBER, distributions=Array(items=Struct(properties={max=NUMBER, min=NUMBER, proportion=NUMBER}))}), LARGEST_CONTENTFUL_PAINT_MS=Struct(properties={category=STRING, percentile=NUMBER, distributions=Array(items=Struct(properties={max=NUMBER, min=NUMBER, proportion=NUMBER}))}), CUMULATIVE_LAYOUT_SHIFT_SCORE=Struct(properties={category=STRING, percentile=NUMBER, distributions=Array(items=Struct(properties={max=NUMBER, min=NUMBER, proportion=NUMBER}))}), EXPERIMENTAL_TIME_TO_FIRST_BYTE=Struct(properties={category=STRING, percentile=NUMBER, distributions=Array(items=Struct(properties={max=NUMBER, min=NUMBER, proportion=NUMBER}))}), EXPERIMENTAL_INTERACTION_TO_NEXT_PAINT=Struct(properties={category=STRING, percentile=NUMBER, distributions=Array(items=Struct(properties={max=NUMBER, min=NUMBER, proportion=NUMBER}))})}), initial_url=STRING, overall_category=STRING}), ColumnId(name=ANALYSISUTCTIMESTAMP, originalName=analysisUTCTimestamp, canonicalName=ANALYSISUTCTIMESTAMP)=STRING, ColumnId(name=ORIGINLOADINGEXPERIENCE, originalName=originLoadingExperience, canonicalName=ORIGINLOADINGEXPERIENCE)=Struct(properties={id=STRING, metrics=Struct(properties={FIRST_INPUT_DELAY_MS=Struct(properties={category=STRING, percentile=NUMBER, distributions=Array(items=Struct(properties={max=NUMBER, min=NUMBER, proportion=NUMBER}))}), FIRST_CONTENTFUL_PAINT_MS=Struct(properties={category=STRING, percentile=NUMBER, distributions=Array(items=Struct(properties={max=NUMBER, min=NUMBER, proportion=NUMBER}))}), LARGEST_CONTENTFUL_PAINT_MS=Struct(properties={category=STRING, percentile=NUMBER, distributions=Array(items=Struct(properties={max=NUMBER, min=NUMBER, proportion=NUMBER}))}), CUMULATIVE_LAYOUT_SHIFT_SCORE=Struct(properties={category=STRING, percentile=NUMBER, distributions=Array(items=Struct(properties={max=NUMBER, min=NUMBER, proportion=NUMBER}))}), EXPERIMENTAL_TIME_TO_FIRST_BYTE=Struct(properties={category=STRING, percentile=NUMBER, distributions=Array(items=Struct(properties={max=NUMBER, min=NUMBER, proportion=NUMBER}))}), EXPERIMENTAL_INTERACTION_TO_NEXT_PAINT=Struct(properties={category=STRING, percentile=NUMBER, distributions=Array(items=Struct(properties={max=NUMBER, min=NUMBER, proportion=NUMBER}))})}), initial_url=STRING, overall_category=STRING})}, generationId=16, minimumGenerationId=16, syncId=15)]
2024-11-21 21:18:37 destination > INFO main i.a.i.b.d.o.DefaultSyncOperation(createPerStreamOpClients):52 Preparing required schemas and tables for all streams
2024-11-21 21:18:37 destination > INFO main c.z.h.HikariDataSource(getConnection):109 HikariPool-1 - Starting...
2024-11-21 21:18:42 destination > INFO main c.z.h.p.HikariPool(checkFailFast):554 HikariPool-1 - Added connection net.snowflake.client.jdbc.SnowflakeConnectionV1@77429040
2024-11-21 21:18:42 destination > INFO main c.z.h.HikariDataSource(getConnection):122 HikariPool-1 - Start completed.
2024-11-21 21:18:42 destination > INFO main i.a.c.d.j.JdbcDatabase(execute$lambda$0):50 executing statement: create table if not exists "airbyte_internal"."_airbyte_destination_state" ("name" varchar, "namespace" varchar, "destination_state" varchar, "updated_at" timestamp with time zone)
2024-11-21 21:18:43 destination > INFO main i.a.c.d.j.JdbcDatabase(execute$lambda$0):54 statement successfully executed
2024-11-21 21:18:54 destination > INFO main i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):127 closing connection
2024-11-21 21:18:57 destination > INFO main i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):127 closing connection
2024-11-21 21:18:57 destination > INFO main i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):127 closing connection
2024-11-21 21:18:58 destination > INFO main i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):127 closing connection
2024-11-21 21:18:58 destination > INFO main i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):127 closing connection
2024-11-21 21:18:58 destination > INFO sync-operations-1 i.a.i.b.d.t.TyperDeduperUtil(runMigrationsAsync$lambda$12):165 Maybe executing SnowflakeDV2Migration migration for stream pagespeed.pagespeed.
2024-11-21 21:18:58 destination > INFO sync-operations-1 i.a.i.d.s.m.SnowflakeDV2Migration(migrateIfNecessary):32 Initializing DV2 Migration check
2024-11-21 21:18:58 destination > INFO sync-operations-1 i.a.i.b.d.t.BaseDestinationV1V2Migrator(migrateIfNecessary):19 Assessing whether migration is necessary for stream PAGESPEED
2024-11-21 21:18:58 destination > INFO sync-operations-1 i.a.i.b.d.t.BaseDestinationV1V2Migrator(shouldMigrate):43 Checking whether v1 raw table _airbyte_raw_pagespeed in dataset pagespeed exists
2024-11-21 21:18:58 destination > INFO sync-operations-1 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery$lambda$6):127 closing connection
2024-11-21 21:18:59 destination > WARN sync-operations-1 i.a.c.d.j.DefaultJdbcDatabase(unsafeQuery):138 closing connection because of an Exception net.snowflake.client.jdbc.SnowflakeSQLException: SQL compilation error:
Table 'STG."airbyte_internal"."pagespeed_raw__stream_pagespeed"' does not exist or not authorized.```
<br>
---
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C021JANJ6TY/p1732224730755509) if you want
to access the original thread.
[Join the conversation on Slack](https://slack.airbyte.com)
<sub>
["snowflake-destination", "error", "unknown-keywords", "connector"]
</sub>