Optimizing data ingestion speed in Airbyte

[slack-user-airbyte]

Summary

Inquiring about speeding up data ingestion process in Airbyte by increasing workers or other optimizations

Question

Hii all, I am ingesting more than 30GB of data from the source to the destination via Airbyte. It is taking too much time. Is there any way to speed up the process, such as increasing the number of workers or other optimizations?

---

This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

_{["optimizing-data-ingestion", "speed-up", "workers", "optimizations", "airbyte-platform"]}

[slack-user-airbyte]

What type of connectors for source and destination do you use? How many streams in connection configuration do you have?

[slack-user-airbyte]

I’m having a similar issue, I’m using ClickHouse syncing to Redshift