Configuring HPA on Airbyte Core Components

Slack Knowledge Base Q&A Platform Questions
, , , ,
1

Summary

Configuring Horizontal Pod Autoscaler (HPA) on Airbyte core components such as Airbyte worker and server, and the absence of default resource quotas.


Question

Hi Community Members,
How do we configure HPA on airbyte core components (like airbyte worker & Server). On which basis we can configure HPA.

Secondly, I am seeing we don’t have any default resource quota applied on the core components, can someone please comment on this as well, I’m looking forward to your insights.
Thanks


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["configuring-hpa", "airbyte-core-components", "resource-quota", "horizontal-pod-autoscaler"]
2

When it comes to HPA you need to make your own custom version of helm charts and/or contribute to Airbyte repository.
There were some changes like https://github.com/airbytehq/airbyte/blob/81f29184766dccf090b7ec6ad30ab59563dfde90/charts/airbyte-worker/templates/hpa.yaml|this in the past, but now I see only leftovers in templates.

Regarding resources requests/limits – you need to configure them on your own with values.yaml.