I have a scenario where i get list of ids from stream 1 and based on those ids I want to extract data from another stream 2.
Is there any recursive way to do that as my stream 2 url requires passing those ids in url to get the data.
I want to iterate those ids on url to get data based on those ids.
Hey! You can leverage HttpSubStream class on the stream that requires fetching parent stream data first. This is a common pattern we have on several connectors. It was discussed here on the forum and you can read more about it in our documentation.
Let me know if these references helped and if you need additional assistance.
Thank you for giving me the correct direction.
The key here is to read parent’s records in the substream
stream_slice function. You can generate one stream slice per parent record. The
path method will be called for each
stream_slice . You can then process the
stream_slice value in the
path function to build the URL you want.