Custom Connector Pagination Parameters

Summary

The user is trying to configure a custom connector in Airbyte cloud that requires multiple pagination cursor parameters, but the UI only allows selecting one parameter. They are exploring options to work around this limitation by either adding multiple parameters in the underlying YAML or utilizing the nextPageUrl key returned by the API.


Question

Hi Everyone:

I’m using Airbyte cloud, and building a custom connector.
My API requires multiple pagination cursor parameters called startAfterId and startAfter this is for building a custom connector.

However the custom connector UI only allows me to select one parameter. Is there a way with the underlying yaml to add more then one?

Another option the api makes available is it returns the entire request URL in a key called nextPageUrl like so:
http://services.leadconnectorhq.com/contacts/?startAfterId=TPZc&startAfter=1710510928094

so perhaps if I cant use multiple parameters, is there a way to use the key nextPageUrl for this purpose?



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["custom-connector", "pagination-cursor", "multiple-parameters", "yaml", "nextpageurl"]