Issue with Airbyte self-hosted not writing files to S3 bucket

Slack Knowledge Base Q&A Platform Questions
, , , ,
1

Summary

Airbyte self-hosted (version 0.57.4) is not writing files to S3 bucket despite successful connection. Stuck syncing Mariadb source to Redshift & S3. Need assistance in resolving the issue.


Question

Hello all,
We are currently facing an issue with our Airbyte self hosted (version 0.57.4) ; the connection starts syncing (here Mariadb as the source) and it keeps being stuck with the same messages in the log.
We checked with the destination and both Redshift & S3 connections are working (we are using : AWS S3 Staging as the uploading method).
However, despite the S3 connection/access working for Airbyte, we don’t see any file being created/written in our S3 bucket.
Do you know what could be the issue, please ?


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["airbyte-self-hosted", "s3-bucket", "syncing-issue", "mariadb-source", "redshift-destination"]
2

The issue was coming from a patch on Redshift.
We add to upgrade the Airbyte destination connector to a higher version.

Upgrade Redshift driver to work with Cluster patch 181; Adapt to CDK 0.33.0; Minor signature changes