High CPU usage on airbyte-worker in Airbyte OSS on EC2 t2.large instance

Slack Knowledge Base Q&A Platform Questions
, , , ,
1

Summary

The user is experiencing high CPU usage on the airbyte-worker component while running the OSS version of Airbyte on an EC2 t2.large instance and wants to know if this is normal.


Question

Hi Team, I am running the OSS version of Airbyte on EC2 t2.large instance. I see that the airbyte-worker has very high CPU usage. Is this normal ?


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.

Join the conversation on Slack

["high-cpu-usage", "airbyte-oss", "ec2", "t2.large-instance", "airbyte-worker"]
2

Yes, the worker is the component it’s going to process more load during syncs. Definitly there are some improvements the team will do during this quarter to setup better limit/requirements to each component https://github.com/airbytehq/airbyte/issues/16652