Increasing storage filesystem in Airbyte-minio pod deployed with Helm chart

Summary

The user is looking for guidance on increasing the /storage filesystem in the Airbyte-minio pod deployed using Helm chart.


Question

hi,
I deployed Airbyte application using Helm chart.
Could you please help me how to increase the /storage filesystem in the pod, Airbyte-minio



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["increase-storage-filesystem", "airbyte-minio", "helm-chart", "pod"]

yes…i did the same…i get the below error

helm upgrade dev1 airbyte-0.270.0/ --set minio.storage.volumeClaimValue=5Gi -n airbyte
Error: UPGRADE FAILED: post-upgrade hooks failed: 1 error occurred:
* timed out waiting for the condition

I’d check logs for pods and all resources kubectl get all
Maybe something related to minio needs to be removed as well :thinking_face:

everything related to minio pod is defined in the stateful set

when i deleted statefulset…minio pod, PVC and PV were automatically deleted

Oh…i missed to check Minio service…let me double check that

i deleted the minio service…still the same error

without logs I don’t know what is the problem
I use k9s https://k9scli.io/ and stern https://github.com/stern/stern to quickly search for issues in kubernetes

i got a fix…in azure portal…i increased the disk size…then rebooted the pod…i found the /storage filesystem space increased

but…kubectl get pvc …is showing old size

probably you need to set minio.storage.volumeClaimValue as I see in README (I haven’t tested it, I’m using S3 instead of Minio)
https://github.com/airbytehq/airbyte-platform/tree/main/charts/airbyte

I updated “VolumeClaimValue” in the values.yaml file…but it is not taking the new value

> then rebooted the pod
with statefulset I’d delete and create it again
> helm upgrade dev1 airbyte-0.270.0/ --set minio.storage.volumeClaimValue=5Gi -n airbyte
please check helm chart whether it supports that option
I’m trying to use as recent version as possible because usually, it has fixes and improvements and more compatible with documentation :slightly_smiling_face:

I think you need to delete PersistentVolume and PersistentVolumeClaim created for minio, and apply changes, so airbyte-minio will use the new value

its not allowing me to delete PVC…the status is always “Terminating”

if i delete the pod…the pvc is automatically created

i deleted the statefulset related to Minio and try to upgrade helm chart…still no luck

Have you tried to delete in following order?

  1. StatefulSet
  2. PVC
  3. PV