Concurrent Requests for Sub-Streams in Customer Connector using Connector Builder

Slack Knowledge Base Q&A Connector Development
, , , ,
1

Summary

In a customer connector built with connector-builder that utilizes a parent stream, the user is inquiring about the number of concurrent requests made when fetching sub-streams. They also want to know if each partition value is fetched sequentially.


Question

I have a customer connector built with connector-builder that uses a parent stream. When fetching the sub-stream, how many concurrent requests are made? Or is each partition value fetched sequentially?


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.

Join the conversation on Slack

["customer-connector", "connector-builder", "parent-stream", "sub-stream", "concurrent-requests", "partition-value", "sequential-fetch"]
2

Right now, they’re sequential, not concurrent. We’re going to enable concurrent mode on them soon, a few months I think.

3

Thank you, is there an issue or task for this enhancement?

4

We definitely track this somewhere but I don’t see it in the public repo ;(