Summary
User seeks guidance on implementing a pipeline using Airbyte, Airflow, and dbt, specifically on triggering downstream tasks based on data retrieval from Airbyte.
Question
Hello everyone, I need some suggestions to a POC implementation. I am using airbyte, airflow and dbt to build a pipeline. I am new to all these tools. I’m thinking of a case to trigger my downstream task only if my airbyte task retrieves any rows in the defined data stream. If not then not trigger the dbt tasks. Requesting for some suggestions to where I can start looking for and learn about these.
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.