Error syncing data from Postgres to Bigquery due to insufficient temporary storage in Postgres

Summary

The user is facing an issue with syncing data from a Postgres database to Bigquery due to insufficient temporary storage in Postgres. They are encountering a ‘No space left on device’ error. They suspect it is related to Postgres not having enough temporary storage.


Question

Hi guys! New to Airbyte here.
• I am using Airbyte Open Source on my local system, to transfer data from a Postgres database in our EC2 instance, to our data warehouse in Bigquery.
• Runnning select pg_size_pretty(pg_database_size(database)) tells me the database has a total storage of 1.5 GB.
• The table sync is unsuccessful though, as I am getting the error,
java.lang.RuntimeException: java.lang.RuntimeException: org.postgresql.util.PSQLException: ERROR: could not write to file "base/pgsql_tmp/pgsql_tmp1707336.3": No space left on device
Looking at previous threads, I suspect it is an issue with Postgres not having enough temporary storage.
Please advise me on how to solve this issue.



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.

Join the conversation on Slack

["syncing-data", "postgres", "bigquery", "temporary-storage", "error"]