Summary
Inquiring about fetching parent details (substream) in parallel using Airbyte connector builder and seeking clarification on the partitioning documentation.
Question
I am using the airbyte connector builder. I have an incremental parent stream which fetches the top level attributes of the object and a substream which then fetches the detail which requires one call per parent. Is there a way to fetch the parent details (substream) in parallel? I see the partitioning documentation but it’s unclear if it helps in this scenario.
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.