Error syncing large table with Airbyte


Error occurs when syncing a large table with over 50 million rows from Oracle to local Postgres using Airbyte with Docker. The error message suggests unexpected data beyond EOF in a relation block, potentially related to buggy kernels.


Hi Everyone, I keep getting this error when trying to sync large table over 50 Million rows, all I did is changing the cpu and memory request to 4 cpu and 4g memory.
I’m using airbyte with docker and the source database is oracle and destination is local postgres, postgres also running on docker.

2741 Hint: This has been seen to occur with buggy kernels; consider updating your system.
2742 Where: COPY public_raw__stream_fdebts_primium_micro_daily, line 234
2743 at io.airbyte.integrations.destination.postgres.PostgresSqlOperations.lambda$insertRecordsInternal$0(
2744 at io.airbyte.cdk.db.jdbc.DefaultJdbcDatabase.execute(DefaultJdbcDatabase.kt:30)
2745 at io.airbyte.integrations.destination.postgres.PostgresSqlOperations.insertRecordsInternal(
2746 at io.airbyte.integrations.destination.postgres.PostgresSqlOperations.insertRecordsInternalV2(
2747 at io.airbyte.cdk.integrations.destination.jdbc.JdbcSqlOperations.insertRecords(JdbcSqlOperations.kt:231)
2748 at io.airbyte.cdk.integrations.destination.jdbc.JdbcBufferedConsumerFactory.recordWriterFunction$lambda$5(JdbcBufferedConsumerFactory.kt:302)
2749 at io.airbyte.cdk.integrations.destination.jdbc.JdbcInsertFlushFunction.flush(JdbcInsertFlushFunction.kt:19)
2750 at io.airbyte.cdk.integrations.destination.async.FlushWorkers.flush$lambda$6(FlushWorkers.kt:172)
2751 at java.base/java.util.concurrent.Executors$
2752 at java.base/
2753 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(
2754 at java.base/java.util.concurrent.ThreadPoolExecutor$
2755 at java.base/
2756 Caused by: org.postgresql.util.PSQLException: ERROR: unexpected data beyond EOF in block 26789 of relation base/224213/233904
2757 Hint: This has been seen to occur with buggy kernels; consider updating your system.
2758 Where: COPY public_raw__stream_fdebts_primium_micro_daily, line 234
2759 at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(
2760 at org.postgresql.core.v3.QueryExecutorImpl.processCopyResults(
2761 at org.postgresql.core.v3.QueryExecutorImpl.endCopy(
2762 at org.postgresql.core.v3.CopyInImpl.endCopy(
2763 at org.postgresql.copy.CopyManager.copyIn(
2764 at org.postgresql.copy.CopyManager.copyIn(
2765 at io.airbyte.integrations.destination.postgres.PostgresSqlOperations.lambda$insertRecordsInternal$0(```



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here]( if you want 
to access the original thread.

[Join the conversation on Slack](

["error", "syncing-large-table", "oracle", "postgres", "airbyte", "docker", "bug", "relation-block", "buggy-kernels"]