Recommended AWS EC2 instance type for running Airbyte OSS version 1.1.0

Summary

Identifying the recommended AWS EC2 instance type for running Airbyte OSS version 1.1.0 via abctl


Question

What is the recommended AWS EC2 instance type for running Airbyte OSS version 1.1.0 via abctl ?

I’ve reviewed the documentation, but I feel the resource recommendations might not be accurate. Could anyone share which EC2 instance type has worked well for them with Airbyte OSS version 1.1.0 ?

Thanks!



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["recommended", "aws-ec2-instance-type", "airbyte-oss", "abctl"]

It depends™

People were quite successful with t3.xlarge. Some tweaking might be needed with --low-resource-mode option and setting jobs resources
https://airbytehq.slack.com/archives/C01AHCD885S/p1725632677747019

It depends how many synchronizations you are going to run simultaneously. At some point, it might be better to use e.g. EKS with autoscaling