Resource Constraint Error in Airbyte Connectors

Summary

User is inquiring about methods to allocate sufficient resources for Airbyte connectors to prevent a ResourceConstraintException during replication pod startup.


Question

is there an easy way to set up resources for connectors/airbyte so as to avoid this error?: io.airbyte.workers.exception.ResourceConstraintException: Unable to start the REPLICATION pod. This may be due to insufficient system resources. Please check available resources and try again. at io.airbyte.workload.launcher.pipeline.stages.model.Stage.apply(Stage.kt:46)



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

['resource-constraint', 'replication-pod', 'airbyte-connectors', 'system-resources']

have plenty of resources (4vCPU, 32GB RAM, 500GB SSD)…can’t figure out how to get them to Airbyte replication pods to get off/running…

Read this thread. Set limits/requests for jobs pods
https://airbytehq.slack.com/archives/C021JANJ6TY/p1728562294190379?thread_ts=1728561176.853139&cid=C021JANJ6TY