AWS RDS Postgres Disk Space Full Issue

Summary

The user is inquiring about performing maintenance on an AWS RDS Postgres external database used with Airbyte, as the disk space is full and is seeking guidance on safely removing old data or if Airbyte has built-in mechanisms for this.


Question

HI all, today I have an ocurrance that the airbyte external database (AWS RDS Postgres with initial disk space of 100 GB) was suddenly full, when I go to monitoring I can see that there is some type of clean up, how can I perform some type of maintenance with old data that I can safely remove, or does Airbyte have something configured for this?



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

['aws-rds', 'postgres', 'disk-space', 'data-cleanup', 'maintenance']

Which version of the Airbyte Platform are you using?

using helm chart 1.1.0 <@U01MMSDJGC9>

any suggestions on how to clean up the database <@U01MMSDJGC9>?

Can you identify which tables are consuming the most space?

yes, this is from temporal database
history_node - 65 GB
from temporal_visibility database
executions_visibility - 11GB

I asked some help to the platform team. Let’s wait their return <@U0833QRRWTH>

in which channel should I post this then <@U01MMSDJGC9>?