Summary
How to verify the maximum number of active syncs in Airbyte Kubernetes deployment by checking the number of source pods running in parallel.
Question
Hi!
I changed the MAX_SYNC_WORKERS
variable in my Airbyte kubernetes deployment.
I am looking for a (kubernetes?) command I could use to check that Airbyte is currently using at most 2 workers.
After some further research, if I understand it correctly this is the maximum number of active syncs, so I could check how many source pods run in parallel using kubectl get pods
, or?
So if I get this it would mean the maximum workers is at least 3 since 3 syncs are running concurrently:
...
source-amplitude-read-58-0-gpmom 4/4 Running 0 112s
source-mysql-read-54-0-mkoqf 4/4 Running 0 5m11s
source-mysql-read-57-0-dnblq 4/4 Running 0 66s```
<br>
---
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C021JANJ6TY/p1708519816200269) if you want to access the original thread.
[Join the conversation on Slack](https://slack.airbyte.com)
<sub>
["kubernetes", "airbyte", "maximum-sync-workers", "active-syncs", "source-pods"]
</sub>