Issue with committing data during MySQL to PostgreSQL ingestion

Slack Knowledge Base Q&A Connector Questions
, , , ,
1

Summary

Ingesting data from MySQL to PostgreSQL with more than 50GB of data gets stuck at committing stage despite increasing memory and CPU size.


Question

Hello everyone,

I am ingesting data from MySQL to PostgreSQL with more than 50GB of data. When I start the ingestion, it loads the data, but when it comes to committing, it gets stuck at that point. I have increased the memory and CPU size, but the issue is still there. Does anyone have any ideas regarding this?

Thank you in advance


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["mysql", "postgresql", "data-ingestion", "committing-issue", "memory", "cpu"]