Summary
When ingesting data from an Oracle database with multiple schemas, defining schema in the connector leads to spawning additional services per schema, causing machine overload. Running multiple schemas in parallel consistently crashes the machine. Seeking advice on resolving this issue.
Question
I’m using Airbyte on a Linux machine to ingest data from an Oracle database, which contains 98 schemas with identical tables. However, in the connector, I’m required to define the schema. When I run it, Airbyte spawns one additional service per schema, overloading the machine. Although I’m attempting to run 5 schemas in parallel, this consistently crashes the machine. Any advice on how to address this issue?
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.