Sync job failing with 'Source process read attempt failed' error

Summary

The sync job is failing with an error message ‘Source process read attempt failed’ and seems to be stuck in an infinite loop. The logs show frequent messages related to CDC events queue stats and heartbeat events. The user has tried refreshing the connection multiple times without success.


Question

Hello,

One of our sync jobs suddenly started failing with a not so clear error message. It simply says Source process read attempt failed.

Taking a look at the logs, it seems like the job is stuck on an infinite loop.

The following 3 messages are very frequent, until the job eventually fails:

2024-10-28 19:11:26 source > INFO main i.a.c.i.d.i.DebeziumRecordIterator(computeNext):87 CDC events queue poll(): blocked for PT10.022736437S after its previous call which was also logged.
2024-10-28 19:11:26 source > INFO main i.a.c.i.d.i.DebeziumRecordIterator(computeNext):140 CDC events queue poll(): returned a heartbeat event: no progress since last heartbeat.```
I have refreshed the connection multiple times, but it always fails on the next sync.

Can someone help me figure out what the problem is?

Attached you’ll finde the attempt logs.

*Airbyte version:* v0.63.13
*Source:* Postgres - v3.6.22
*Destination:* Postrges - v2.4.0

<br>

---

This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C021JANJ6TY/p1730143805591009) if you want 
to access the original thread.

[Join the conversation on Slack](https://slack.airbyte.com)

<sub>
["sync-job", "source-process-read-attempt-failed", "infinite-loop", "cdc-events-queue", "refresh-connection", "postgres"]
</sub>