Limiting CPU and Throttling in Airbyte

Slack Knowledge Base Q&A Platform Questions
, , , ,
1

Summary

How to set maximum CPU usage and throttle Airbyte to prevent VM overload


Question

I keep running into this problem every so often. Somewhere, somehow the CPU is just drained for no reason. Is there anyway to actually set the maximum amount of usage Airbyte can use? Limit the rows each batch loads? Some way to throttle so that the VM doesn’t cave in?


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.

Join the conversation on Slack

["limiting-cpu-usage", "throttling", "airbyte-platform"]
2

Yeah you can limit the cpu utilisation.
Did u deploy airbyte with docker or on K8’s

3

This is docker on a VM. I am uncertain how that actually happens because setting it in the .env file seems to have no effect?