Custom Connector Parent Stream Field Selection Inquiry

Slack Knowledge Base Q&A Connector Development
, , , ,
1

Summary

User is inquiring about the ability to select multiple fields, specifically ‘price’, from the Parent Stream in a custom connector within Airbyte Cloud, while currently only able to access the Parent Key (ID).


Question

Hi all :wave:,

I’m quite new to Airbyte Cloud and currently building my first custom connector. Is it in any way possible to select multiple values from your Parent Stream other than the Parent Key alone? I seem to only be able to select the ID which is the PK of the Parent Stream, but in my “Child Stream” installments I’d also like to select field price from the Parent Stream. I’ve looked online and in this Slack for any help on this but I’m still wondering if this is possible with some sort of work around. Any help will be much appreciated.

      "price": "23200.000000",
      "id": "xxx",
      "start_date": "2019-02-01",
      "end_date": "2019-10-01",
      "installments": [
        {
          "name": "Second",
          "percentage": 50.043103448275865,
          "invoice_id": "x1"
        },
        {
          "name": "Third",
          "percentage": 46.5948275862069,
          "invoice_id": "x2"
        }
      ],```


<br>

---

This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C027KKE4BCZ/p1733388205854609) if you want
to access the original thread.

[Join the conversation on Slack](https://slack.airbyte.com)

<sub>
['custom-connector', 'parent-stream', 'child-stream', 'field-selection', 'airbyte-cloud']
</sub>
2

Did you try the following in the child stream:

3

Yes I’ve tried that but doesn’t work

4

Also, if I just append {{ stream_partition }} as a whole to a column then I can already see that there’s only one value in that dict and that is the PK of the Parent Stream, which makes sense.

5

I understand, Laurens, confirming this isn’t possible today. I’ve <https://github.com/airbytehq/airbyte-python-cdk/issues/142|submitted a feature> request in airbyte-python-cdk for future implementation. Please :+1: the issue to show maintainers it’s an important missing feature in builder and if possible include more examples why you want the feature.
For now, you’ll need to perform a post-join between your parent and child tables after syncing the data.

6

Thanks <@U01MMSDJGC9> for picking this up, left a :+1: on the issue in Github!