Summary
User is asking if Airbyte can be used to integrate with external services and ERP systems for a Django project.
Question
Hi everybody. I am new to Airbyte and quite frankly very clueless. I’m working on a Django project for a company where I need to integrate with several services and datasources from their users/customers and send data back into customer’s ERP systems. Is Airbte a tool I can leverage for that or is it only suitable for company internal data?
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.
Join the conversation on Slack
["integration", "external-services", "erp-systems", "airbyte-platform", "django"]
It’s half that stack, yes—we’re using Airbyte this way. In our case we actually hide Airbyte from the users by creating the Airbyte connections via API (and showing their status in the same way). You could manage those connections in Airbyte, but if you’re dealing with a multi-user environment there aren’t separate permissions for different users (except in the Enterprise version where you have have multiple workspaces).
But that only handles pulling data down from other systems (ETL), not pushing data back to the ERP (Reverse ETL). While Airbyte has plans to implement in this in the future (and even acquired Grouparoo which does this), that hasn’t been built out yet.
So in the meantime, we’re using https://www.getcensus.com/reverse-etl|Census for the Reverse ETL part. Since we have users authorize to our own app, we just pass the oAuth credentials to both Airbyte and Census so we can both read and write to the sources.
So the full flow for us is:
• (Source Systems) –> Airbyte –> BigQuery
• dbt modeling/enrichment in BigQuery
• BigQuery –> Census –> (Destination Systems)
It’ll be nice having everything in one place when Airbyte eventually adds the Reverse ETL functionality, but in the meantime this works pretty well for us.