Issue with syncing large MySQL tables to PostgreSQL

Summary

User experiences issues syncing large tables (5 million rows) from MySQL to PostgreSQL using Airbyte, where only 1,000 rows are synced without error.


Question

Hi everyone, I’m using Airbyte on my local to sync data from Mysql into Postgresql, seems with table small of data it work well, but with table large of data (about 5 mil rows) the Airbyte just sync 1k row and stop without error , do you have any idea to sync table large of data in mysql source?
Thanks.



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

['mysql', 'postgresql', 'airbyte', 'sync', 'large-tables']