Upon checking this page to deploy Airbyte to ECS On AWS ECS (Coming Soon) | Airbyte Documentation, I understand that you want to be able to spawn Docker container to run job, and ECS does not let you do this. I think instead of doing that, you can do something better, by tapping into the AWS API, by either:
- Launch an ECS task
- Launch an AWS Batch job
Maybe Airbyte wants to be platform agnostic, but targeting AWS, Azure, or GCP container services can be a very common use case.
Thanks for the suggestion Kha, the goal today is Airbyte be cloud/platform agnostic but it doesn’t limit community build an ecosystem around the project to help with your use case.
Hi there from the Community Assistance team.
We’re letting you know about an issue we discovered with the back-end process we use to handle topics and responses on the forum. If you experienced a situation where you posted the last message in a topic that did not receive any further replies, please open a new topic to continue the discussion. In addition, if you’re having a problem and find a closed topic on the subject, go ahead and open a new topic on it and we’ll follow up with you. We apologize for the inconvenience, and appreciate your willingness to work with us to provide a supportive community.