Bug report: Snowflake destination PARALLEL parameter error

Summary

The user is reporting a bug in the Snowflake destination connector where the PARALLEL parameter is throwing an error due to exceeding the limit in Snowflake. The user provided a query and error message for reference.


Question

:airbyte-fire:Hi, I want to report a BUG that you have in Snowflake destination!:airbyte-fire:
This is a query that Airbyte executed in my Snowflake env in the latest snowflake version:
PUT file:///tmp/2f680376-2d30-445f-bcbe-xxxx.csv.gz @"airbyte_internal"."clientx_raw__stream_postgres_table"xxx-FCB5-4B1F-B425-7EED5EE5F2D4/ PARALLEL = 128;

Error:
SQL compilation error: invalid value [128] for parameter 'PARALLEL'

I’ve investigated the issue, as long the temporary file is bigger then the PARALLEL Parameter increased as well. The limit in Snowflake is 100!
Please look:
https://docs.snowflake.com/en/sql-reference/sql/put

What can i do mean time?

HELPPP:pray:



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["bug", "snowflake-destination", "parallel-parameter", "error"]

Hello Tal, thanks for reporting the issue. It looks the enginering team already fixed in https://github.com/airbytehq/airbyte/pull/39135 please upgrade your connector to the latest version and check again.