Using Cloud SQL with Airbyte on GCP Compute Engine

Summary

How to configure Airbyte to use Cloud SQL instead of creating a local Postgres database during installation on GCP Compute Engine.


Question

Hey everyone.
I want to install Airbyte on GCP compute engine and use Cloud SQL as db. I don’t want to install through Kubernetes. Can anyone share any link or tell me how to use Cloud SQL instead of Airbyte creating Postgres database locally when installation is taking place. On Airbyte documentation they are installing Airbyte via docker compose using a startup script and other way is to use abctl command. But how can i pass Cloud SQL credentials? In both of these methods they are creating database locally when installing Airbyte.



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["cloud-sql", "gcp-compute-engine", "airbyte-platform", "installation", "credentials"]

The documentation for configuring an external database is here: https://docs.airbyte.com/deploying-airbyte/integrations/database

You can see how you would use that with abctl here: https://docs.airbyte.com/using-airbyte/getting-started/oss-quickstart#customizing-your-installation-with-a-values-file

Note that abctl local install also supports a --secret flag that you can load secrets with.