Summary
User is experiencing issues transferring 17GB of data from PostgreSQL Aurora on AWS to BigQuery using Airbyte deployed on Kubernetes, despite documentation stating a capacity of 500GB.
Question
Hello team, I have a problem moving around 17GB from a PostgreSQL Aurora in AWS to BigQuery. My Airbyte deployment is on Kubernetes.
I’ve seen in the documentation that up to 500GB of information can be moved. Has anyone faced this problem, or how have you solved moving more than 20GB from a PostgreSQL table?
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.