Cannot dbt deps in Airbyte docker

Platform, Deploy & Infra Issues
, ,
1

Hi i found this article

image
image1365×1078 185 KB

accrding to that point we can dbt deps and use package in Airbyte dbt normalization right ? but i dont know how to dbt deps in Airbyte docker because it is containerized in docker and cloning dbt project from github.

tell me how to use dbt package in docker Airbyte ?

2

We do have custom DBT where you can write your own code and push it over airbyte to run. https://docs.airbyte.com/understanding-airbyte/operations#supported-operations here is some documentation hope it helps

3

so i just define this command in dbt transformation ? @harshith

deps && dbt run --models db_replication
4

Hey I hope this thread helps https://airbytehq-team.slack.com/archives/C03B5KG6A14/p1625881122181800?thread_ts=1624558824.435500&cid=C03B5KG6A14

5

Hi @harshith i can’t open that link is that archived channel ?

image
image2315×972 40.9 KB

and i cant sign in to that workspace

6 
1. needed to run dbt deps to install dbt_utils; i had to create a new docker image with dbt_utils pre-installed since the default image does not come with it; I wonder if there’s a way to invoke dbt deps and dbt run within the same transformation in Entrypoint arguments for dbt cli to run the project2. for now it seems workaround is use custom docker image that contains the pre-installed packages but correct me if I’m wrong3. you can change heremodules-path: "/tmp/dbt_modules" # directory which will store externaltomodules-path: "../dbt_modules" # directory which will store externalso you can run dbt deps and dbt run without a custom image

You can check this small conversation

1 Like