Error syncing 5 million CSV to Postgres job

Slack Knowledge Base Q&A Connector Questions
, , , ,
1

Summary

Error encountered while trying to sync a large CSV file to Postgres due to byte array limitation


Question

Hello Team,
We are trying to configure a 5million csv to postgres sync job,but we are facing the below error.

Internal message: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.IllegalArgumentException: Cannot read more than 2,147,483,647 into a byte array

Here is the log file


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.

Join the conversation on Slack

["csv-to-postgres", "sync", "error", "byte-array-limitation"]