Airbyte Rotation Logs

Q&A
4

Airbyte schedules periodic jobs to delete logs from syncs.
By default these logs are deleted every month or when their size exceeds 5GB.
You can change the value of the following env variable according to your need and your available disk space:

  • MINIMUM_WORKSPACE_RETENTION_DAYS - Defines the minimum configuration file age for sweeping. The Scheduler will do it’s best to now sweep files younger than this. Defaults to 1 day.

  • MAXIMUM_WORKSPACE_RETENTION_DAYS - Defines the oldest un-swept configuration file age. Files older than this will definitely be swept. Defaults to 60 days.

  • MAXIMUM_WORKSPACE_SIZE_MB - Defines the workspace size sweeping will continue until. Defaults to 5GB.

1 Like