Summary
How to retrieve detailed logs of job sync in Airbyte deployed on a VPS with Docker Compose using the API or logs written to disk with a shared volume. The user is specifically looking to get logs from a Google Cloud Compute Engine instance.
Question
Hi all!
When deploying Airbyte on a VPS with Docker Compose, how can I retrieve all the detailed logs of a job sync (using the API or logs written to the disk with a shared volume)?
I am using a Google Cloud Compute Engine instance and try to get the detailed logs of each job sync out of the VM (Cloud Logging, Cloud Storage or else).
Here’s the <Slack with the Kapa bot> that lets me think the answer is in the settings of the instance, but the following attempts did not work:
• add a Docker daemon.json file with basic log-driver: https://docs.docker.com/config/containers/logging/gcplogs/
• switch the OS to a Container-Optimized OS with logging: https://cloud.google.com/container-optimized-os/docs/how-to/logging
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.