Performance issues replicating data from Oracle to Teradata

Summary

The user is facing performance issues while replicating data from Oracle to Teradata. They have tried allocating more memory and adjusting JDBC parameters but haven’t seen significant improvements. They are seeking advice on how to address these performance issues.


Question

I am looking for some help about performance issues while replicating data from oracle into teradata.

The replication took 9 hours 37 seconds for replicating 36.44GB, which corresponds to about 164918245 records

So far I see one suggestion is to split the connection between streams but this is not so-far doable in my use case.

I have attempted to give 4GB memory for the main jobs and added JDBC parameter XX:MaxRAMPercentage=75.0 - but I haven’t noticed major performance improvements
Has someone had similar experiences in the past? how to address these performance issues?



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["performance-issues", "replicating-data", "oracle", "teradata", "memory-allocation", "JDBC-parameters"]

Hi all - someone knows something about this on how the performance can be improved?

<@U06KAV0H59U> Take a look at this thread as this seems to be a similar problem to what you are having

https://airbytehq.slack.com/archives/C01AHCD885S/p1718878256952289