Error syncing 5 million CSV to Postgres job


Error encountered while trying to sync a large CSV file to Postgres due to byte array limitation


Hello Team,
We are trying to configure a 5million csv to postgres sync job,but we are facing the below error.

Internal message: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.IllegalArgumentException: Cannot read more than 2,147,483,647 into a byte array

Here is the log file

This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.

Join the conversation on Slack

["csv-to-postgres", "sync", "error", "byte-array-limitation"]