Attaching ID to parent partitioning response in Airbyte builder

Summary

Inquiring about attaching the ID passed to parent partitioning in Airbyte builder to the response. The user is querying an API where each block has a unique ID, but the subsequent endpoint does not include the ID in the response.


Question

Hey, is there a way we can attach the ID that we are passing to the parent partitioning in the Airbyte builder to the response? I have an API that I am querying, which sends a bunch of data with each block having a unique ID. Then, I am using these IDs on a different stream to query another endpoint, but this endpoint doesn’t generate the response with the ID



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.

Join the conversation on Slack

["attach-id", "parent-partitioning", "airbyte-builder", "api", "unique-id", "response"]

<@U071GE1J8KE> I think that what you’re looking for is the Current Parent Key Value Identifier, as defined in the <http://currencyCode|Builder docs>.

For example, if you set this to parent_id, then you can use {{ stream_partition.parent_id }}. From a use-case standpoint, you would usually put this interpolated variable in a field such as URL Path , which might look like /children/{{ stream_partition.parent_id }}/list (or maybe it’s a query param or JSON body or whatsuch depending on your API structure).

If you aren’t sure which fields you can use this in, there are often examples of it you’ll see when hovering over the little info icon next to the field name, like in URL Path: