As per the documentation - all interactions with connectors are run as jobs performed by a Worker and workers can be spec worker, check connection worker, discovery worker or sync worker.
Question 1 - Can a worker perform only a single job at a time or even more than one ?
Also for configuring parallelization, we have different parameters -
- As per this link, these are Maximum number of * workers allowed to run in parallel
- As per this second link, these are maximum number of * workers each Airbyte Worker container can support
Question 2 - Are these two definitions different ? What is this Airbyte Worker ? Is this worker different from the other four types of workers - spec/check/discover/sync ?
We have another configuration parameter
SUBMITTER_NUM_THREADS - the maximum number of concurrent jobs the Scheduler schedules.
Question 3 - How does this last configuration parameter relate to the