Managing EC2 Instance Size for Airbyte Logs

Summary

This message inquires about managing the size of an EC2 instance running Airbyte, specifically regarding log size limits and retention policies.


Question

How do y’all keep the size of your EC2 running Airbyte under control?
Within a couple weeks, we quickly maxed out the 30GB originally assigned to the instance.
It looks like the logs are likely what are pushing the size limits. . . .
Any reason to keep logs older than a day or so around?



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["ec2-instance", "airbyte-logs", "log-management", "size-limit", "retention-policy"]