User seeking assistance with a question posted on GitHub discussion #32748
Hi, any chance someone can help answer this question? https://github.com/airbytehq/airbyte/discussions/32748
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.
New message text here
<@U06LPU5ECA3> can you add a comment to the discussion detailing what you’re trying to achieve? From the description it is unclear to me - /product/1000-1199 is not a record, so I don’t understand why you would want the string “as a record”. Is it about resolving those as paths to retrieve the actual records?
<@U047ANT3J84> for me, I’m using this source as a parent for another source – iterating the list of IDs returned from one HTTP API to use as a URL path fragment in another.
And you have the same problem that the list of IDs is just a list of strings (or ints or whatever) and not a list of objects with an ID field?
I understand the use case, I’m not sure if I’d approach it from the substream perspective or if that’s more of a use case for a https://docs.airbyte.com/connector-development/config-based/understanding-the-yaml-file/partition-router#listpartitionrouter|ListPartitionRouter (especially since the other user’s API seems to be returning URL paths and not an explicit list of IDs) and the problem is that we need a dynamic way to supply that list
https://developer.fastspring.com/reference/get-all-subscriptions
This returns a response that matches this structure (some data redacted for privacy reasons):
"action": "subscription.getall",
"result": "success",
"page": 1,
"limit": 10,
"nextPage": 2,
"total": 999999,
"subscriptions": [
"..................thsw",
"..................giXw",
"..................-PcQ",
"..................-6RA",
"..................HxUQ",
"..................mZ_g",
"..................ki9A",
"..................6jPQ",
"..................f0HA",
"..................W0Yg"
]
}```Was just going to ask which api you’re using
I need to take that list of subscription IDs, then hit <https://api.fastspring.com/subscriptions/{subscription_id}>, one request for each ID …
I was hoping to use something like /subscriptions/{{ stream_slice.parent_id }} as my URL Path in the stream that will fetch the subscription details.
I’d be happy to build this as a Python connector, but I’m not having luck following the tutorial (https://airbytehq.slack.com/archives/C027KKE4BCZ/p1709151644541239)