- Is this your first time deploying Airbyte?: No
- OS Version / Instance: Ubuntu
- Memory / Disk: 204Gb / 1 Tb
- Deployment: Kubernetes
- Airbyte Version: 0.39.28-alpha (error persisted on 0.39.21)
- Source name/version: Postgres(0.4.28) and Postgres(0.4.26)
- Destination name/version: Bigquery(1.1.11) and Bigquery(1.1.9)
- Step: source(not really sure)
- Description:
CDC stopped working after not testing again for two weeks, full load works, but in the next sync when there is some CDC record to be collected, it pops the following error:
2022-06-28 14:43:20 source > 2022-06-28 14:43:20 ERROR i.d.p.ErrorHandler(setProducerThrowable):35 - Producer failure
2022-06-28 14:43:20 source > org.postgresql.util.PSQLException: ERROR: out of memory
2022-06-28 14:43:20 source > Detail: Cannot enlarge string buffer containing 1073741806 bytes by 23 more bytes.
a similar error can be found here When i use Debezium and wal2json it cause a problem · Issue #183 · eulerto/wal2json · GitHub.
Whenever i try a update/insert of like one row, this error appears so a memory issue looks unlikely