Forwarding Airbyte logs to Azure Storage Account

Summary

Exploring workaround to forward Airbyte logs to Azure Blob Storage


Question

Hi everyone,
I am trying to forward Airbyte logs to Azure Storage Account. I can see that it is not officially supported. However, is there a workaround that lets me forward all logs to azure blob storage?



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["forwarding-logs", "airbyte", "azure-storage-account", "workaround", "azure-blob-storage"]

I know that there are several proxy tools that allow you to talk to ABS using the S3-compatible API, so that’s one option. (e.g. Flexify or others)

I also know that this is supported via Minio, but I don’t think those configs are surfaced currently.

However, I did see a comment somewhere that the Airbyte team is working on more Azure support OOTB, so a proxy may be a good workaround that can later be dropped.