Summary
User reports significant increase in sync runtime after upgrading MySQL connector on Airbyte. Before the upgrade, sync took 2-3 minutes; now it takes about 15 minutes, with unchanged configuration and observations of record syncing.
Question
Hi everyone,
Happy New Year! I hope you’re all having a great start to 2025.
We recently upgraded our MySQL connector
from version 3.3.21
to 3.9.4
on Airbyte version 0.64.7
and noticed a significant increase in the runtime of our hourly sync for Mariadb connection. Before the upgrade, the sync typically completed in 2-3 minutes, but post-upgrade, it consistently takes about 15 minutes.
Here’s a summary of the issue:
• Sync mode: “Scan Changes with User Defined Cursor” (no changes made post-upgrade).
• Configuration: No new streams were added, and the setup remains the same.
• Log observations:
◦ Before upgrade: Records loaded ~100-150K, records synced ~15K.
◦ After upgrade: Records loaded remain ~100-150K, but now records synced match the loaded records (~100-150K).
Has anyone else experienced this behaviour after upgrading the connector? Any ideas on why the runtime has increased or how to resolve this would be greatly appreciated.
Thanks in advance for your help!
CC: <@U06QLBTA725>
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.