Partitioning by Fields in Custom Connector Parent Stream


Exploring the possibility of partitioning by specific fields in a custom connector’s parent stream and the requirement of the Parent Key parameter.


Hi – I am trying to use a parent stream to enable partitioning in a custom connector. The documentation states <Partitioning | Airbyte Documentation“Each record of the parent stream is used as a partition for the current stream.”> Is it possible to partition by fields for a <Partitioning | Airbyte Documentation object>? For example, the response from my parent stream is in the format

    "table1": [
    "table2": [
    "table3": [
and I would like to use `table1, table2, table3` as my partition values, but it appears that the <|"Parent Key"> parameter is required (it seems that I would like to partition by the parent key).



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here]( if you want 
to access the original thread.

[Join the conversation on Slack](

["partitioning", "custom-connector", "parent-stream", "fields", "partition-values", "parent-key"]