Summary
Guidance on scaling Airbyte Docker deployment without Kubernetes to improve performance, particularly addressing CPU spikes during syncs.
Question
Hello community, I am looking for some guidance & recommendation on how to scale airbyte if we aren’t planning to go down the Kubernetes route.
Currently we have a docker deployment.
We might go there (Kubernetes) in future, but for now I am interested to hear what all ways are there to improve/scale the docker setup.
CPU is the main issue for us, which spikes when our syncs are running. RAM doesn’t seem to be that much of a problem. Currently we have 4 cores & 16GB RAM.
Thank you for your help in advance.
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.