Setting up external log storage in S3 from EKS cluster

Slack Knowledge Base Q&A Platform Questions
, , , ,
1

Summary

How to change default minio deployment to S3 for external log storage in EKS cluster


Question

Hi all, our team is attempting to set up external log storage in S3 from an EKS cluster, but the deployment keeps defaulting to minio. Any pointers on what to change would be appreciated. Note that this is not a self-hosted enterprise deployment.

  storage:
    type: "S3"
    storageSecretName: airbyte-config-secrets 
    bucket:
      log: ${s3_bucket_name}
      state: ${s3_bucket_name}
      workloadOutput: ${s3_bucket_name}
    s3:
      region: ${s3_bucket_region}
      authenticationType: credentials```

<br>

---

This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C021JANJ6TY/p1711048198470139) if you want 
to access the original thread.

[Join the conversation on Slack](https://slack.airbyte.com)

<sub>
["external-log-storage", "s3", "eks-cluster", "minio", "deployment"]
</sub>
2

Try adding

  enabled: false```