Understanding resource allocation flags for Airbyte syncs

Slack Knowledge Base Q&A Platform Questions
, , , ,
1

Summary

Explanation of resource allocation flags for increasing resources during Airbyte syncs


Question

Hi everyone,
I want to increase the resources for airbyte syncs. But i dont have a clear idea what do these flags do

- JOB_MAIN_CONTAINER_CPU_LIMIT=${JOB_MAIN_CONTAINER_CPU_LIMIT}
- JOB_MAIN_CONTAINER_CPU_REQUEST=${JOB_MAIN_CONTAINER_CPU_REQUEST}
- JOB_MAIN_CONTAINER_MEMORY_LIMIT=${JOB_MAIN_CONTAINER_MEMORY_LIMIT}
- JOB_MAIN_CONTAINER_MEMORY_REQUEST=${JOB_MAIN_CONTAINER_MEMORY_REQUEST}


 - NORMALIZATION_JOB_MAIN_CONTAINER_CPU_LIMIT=${NORMALIZATION_JOB_MAIN_CONTAINER_CPU_LIMIT}
 - NORMALIZATION_JOB_MAIN_CONTAINER_CPU_REQUEST=${NORMALIZATION_JOB_MAIN_CONTAINER_CPU_REQUEST}
 - NORMALIZATION_JOB_MAIN_CONTAINER_MEMORY_LIMIT=${NORMALIZATION_JOB_MAIN_CONTAINER_MEMORY_LIMIT}
 - NORMALIZATION_JOB_MAIN_CONTAINER_MEMORY_REQUEST=${NORMALIZATION_JOB_MAIN_CONTAINER_MEMORY_REQUEST}```
Can someone please explain ? I specifically looking to alot more resources to the worker and the individual connector containers that are created while the syncing.

<br>

---

This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C021JANJ6TY/p1706775873755769) if you want to access the original thread.

[Join the conversation on Slack](https://slack.airbyte.com)

<sub>
["resource-allocation-flags", "airbyte-syncs", "worker-containers", "connector-containers"]
</sub>