Summary
After upgrading Kubernetes to version 1.30, the MySQL to PostgreSQL connection in Airbyte has stopped working. Despite updating all components to their latest versions, the process gets stuck in a loop without completing. No error messages are shown, and the logs keep repeating the same entries. Assistance is needed to identify the problem.
Question
Hi there. I’m currently facing issues with Airbyte after upgrading Kubernetes to version 1.30. Since the upgrade, my MySQL to PostgreSQL connection has stopped working. I have updated all components to their latest versions:
Airbyte-api-server/connector-builder/cron/db/server/webapp/worker: 0.63.8
Airbyte-pod-sweeper: 1.28.9
Airbyte-temporal: 1.23.0
Airbyte-minio: RELEASE.2024-07-15T19-02-30Z
MySQL Source: 3.5.0
PostgreSQL Destination: 2.0.15
MySQL DB: 8.0.35-27.1
PostgreSQL DB: 15.4.0-debian-11-r39```
Despite setting up a new source, destination, connection, destination schema and doing a full new sync, the connection that previously functioned well for months is no longer operational. There are no error messages; the process simply does not complete. It successfully reads from the source database, retrieves 3.5 million entries from the table, and writes them in raw format to the PostgreSQL database. However, it then becomes stuck in a loop. The destination-postgres-write and orchestrator-repl-job-1497-attempt-0 pods are still active, but the raw entries do not populate the destination schema.
When I check the sync logs, I see the same entries repeating every few seconds. The latest log entries not generated by the platform date back a few hours. If necessary I can open an issue in GitHub where I can provide more logs.
Do these details provide enough insight to identify the problem? I’m not sure what I’m doing differently this time.
Any help is very much appreciated. Thanks in advance.
<br>
---
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C021JANJ6TY/p1721159651728419) if you want
to access the original thread.
[Join the conversation on Slack](https://slack.airbyte.com)
<sub>
["kubernetes-upgrade", "mysql-to-postgresql-connection", "sync-issue", "logs-repeating"]
</sub>