Out of Memory Issue and High CPU Usage on Airbyte Docker Compose Setup

Slack Knowledge Base Q&A Platform Questions
, , , ,
1

Summary

Airbyte running on Digital Ocean VM via Docker Compose is facing out of memory issue and high CPU usage since 1 Aug, even when no syncs are running. CPU usage used to spike only during syncs. Java process is taking up 100% CPU.


Question

Hi all. I’m running Airbyte on a Digital Ocean VM via Docker Compose. Recently, since 1 Aug, I’ve been having some out of memory issue from Java in my VM, and it’s taking up 100% CPU all the time even when no Airbyte syncs are running. In the past, CPU only spikes up when syncs are running.

/usr/lib/jvm/java-21-amazon-corretto/bin/java -XX:+ExitOnOutOfMemoryError -XX:MaxRAMPercentage=75.0 -classpath /app/airbyte-app/lib/io.airbyte-airbyte-workers-0.63.0jar:/app/airbyte-app/lib/io.airbyte-airbyte-commons


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["out-of-memory-issue", "high-cpu-usage", "docker-compose", "digital-ocean-vm", "java-process"]
2

You can use ctop https://github.com/bcicen/ctop to check which container is doing that