Redshift V2 Sync Failure Due to String Size Limit

Summary

User reports a sync failure with Redshift V2 due to a string value exceeding the maximum size limit of 65535 bytes, despite expectations set by documentation.


Question

Hi All - I am using Redshift V2 as my destination for Airbyte syncs. I am using version 2.1.8. The sync unfortunately fails saying that I should look at the stl_load_errors table. After inspecting it, I can see that the COPY command fails because of the error String value exceeds the max size of 65535 bytes. When I moved to V2, I was under the impression this would not happen any longer, also as mentioned in the docs here: https://docs.airbyte.com/integrations/destinations/redshift?_gl=1*1iprgay*_gcl_au*MTUyNDY0NTY2LjE3MTAxNjUzMTM.#data-size-limitations

Am I missing anything?



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

['redshift', 'sync-failure', 'string-size-limit', 'airbyte', 'version-2.1.8']