Error when bumping Redshift target > 0.3.29

Connector Questions & Issues
,
1
  • Is this your first time deploying Airbyte?: No
  • OS Version: macOS
  • Memory / Disk: 4 GB
  • Deployment: K8s
  • Airbyte Version: 0.35.0-alpha
  • Source name/version: S3 v0.1.13 (Avro files)
  • Destination name/version: Redshift v0.3.21
  • Step: Sync
  • Description:
    I’ve been ingesting data from S3 to redshift for a while now but was facing some OOM issues for bigger loads. I read that it can be fixed by bumping the version of redshift target to > 0.3.33 but when upgrading to any version above 0.3.20 I’m getting errors that I have never seen before. Also tested going back to v0.3.29 and then everything works fine.

Logs attached
logs-1148-0.txt (85.4 KB)

2

Hey after the upgrade of connector can you check for these both

  1. For old syncs (I can see that this is failing)
  2. Create a new connection and see if that works
3

Hi there from the Community Assistance team.
We’re letting you know about an issue we discovered with the back-end process we use to handle topics and responses on the forum. If you experienced a situation where you posted the last message in a topic that did not receive any further replies, please open a new topic to continue the discussion. In addition, if you’re having a problem and find a closed topic on the subject, go ahead and open a new topic on it and we’ll follow up with you. We apologize for the inconvenience, and appreciate your willingness to work with us to provide a supportive community.