Improving Throughput for Destination Connectors in Teradata Java Connector

Summary

Inquiring about increasing parallelism for the Teradata Java connector to improve throughput. Questioning the factors determining the number of workers used and the limitation to only 2 concurrent threads flushing batches to the worker.


Question

Hi all. I am looking for some help on how to improve the throughput for the destination connectors. I want to increase the parallelism for the teradata java connector but I am not sure based on what it depends the number of workers it uses for it. I thought it was depending on the cores available but even if I add more of them there are only 2 concurrent threads flushing batches to the worker



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["improve-throughput", "destination-connectors", "teradata-java-connector", "parallelism", "number-of-workers", "concurrent-threads", "flushing-batches"]