Integrating Airbyte with Dagster in a Docker Compose Environment

Summary

How to run Airbyte and Dagster on the same application in a Docker Compose environment


Question

Hi all, I have a dagster project orchestrating our data pipelines. All my docker images and definitions are defined in the docker_compose.yml file. I want to integrate airbyte to extract data from my source connections. For starters, I want to run airbyte and dagster on the same application. How can I do this?



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.

Join the conversation on Slack

["dagster", "docker-compose", "airbyte", "integration", "data-pipelines"]