Data extraction based on multiple id from another stream

Q&A
1

I have a scenario where i get list of ids from stream 1 and based on those ids I want to extract data from another stream 2.
Is there any recursive way to do that as my stream 2 url requires passing those ids in url to get the data.
I want to iterate those ids on url to get data based on those ids.

Thank you

2

Hey! You can leverage HttpSubStream class on the stream that requires fetching parent stream data first. This is a common pattern we have on several connectors. It was discussed here on the forum and you can read more about it in our documentation.
Let me know if these references helped and if you need additional assistance.

1 Like
3

Thank you for giving me the correct direction. :+1:

4

The key here is to read parent’s records in the substream stream_slice function. You can generate one stream slice per parent record. The path method will be called for each stream_slice . You can then process the stream_slice value in the path function to build the URL you want.

5

I have created custom connector and im looking for the same solution as above in low code connector, do we have the same solution in for something /employees/{id}/details like this in low code connector ? or I have to create HTTP-api based connector ? @alafanechere