Postgres Temporary Storage Issue During Data Sync

Summary

User is experiencing a sync failure when transferring data from Postgres to BigQuery due to insufficient temporary storage in Postgres, as indicated by the error message regarding no space left on device.


Question

Hi guys! New to Airbyte here.
• I am using Airbyte Open Source on my local system, to transfer data from a Postgres database in our EC2 instance, to our data warehouse in Bigquery.
• Runnning select pg_size_pretty(pg_database_size(database)) tells me the database has a total storage of 1.5 GB.
• The table sync is unsuccessful though, as I am getting the error,
java.lang.RuntimeException: java.lang.RuntimeException: org.postgresql.util.PSQLException: ERROR: could not write to file "base/pgsql_tmp/pgsql_tmp1707336.3": No space left on device
Looking at previous threads, I suspect it is an issue with Postgres not having enough temporary storage.
Please advise me on how to solve this issue.



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

['postgres', 'bigquery', 'data-sync', 'error', 'temporary-storage']