Error when bumping Redshift target > 0.3.29

  • Is this your first time deploying Airbyte?: No
  • OS Version: macOS
  • Memory / Disk: 4 GB
  • Deployment: K8s
  • Airbyte Version: 0.35.0-alpha
  • Source name/version: S3 v0.1.13 (Avro files)
  • Destination name/version: Redshift v0.3.21
  • Step: Sync
  • Description:
    I’ve been ingesting data from S3 to redshift for a while now but was facing some OOM issues for bigger loads. I read that it can be fixed by bumping the version of redshift target to > 0.3.33 but when upgrading to any version above 0.3.20 I’m getting errors that I have never seen before. Also tested going back to v0.3.29 and then everything works fine.

Logs attached
logs-1148-0.txt (85.4 KB)

Hey after the upgrade of connector can you check for these both

  1. For old syncs (I can see that this is failing)
  2. Create a new connection and see if that works