Using Pagination Variables in Stream URL Path

Slack Knowledge Base Q&A Connector Development
, , , ,
1

Summary

How to modify the URL path of streams using pagination variables in a connector


Question

Does anybody have experience using pagination variables to modify the url path of their streams? I need to modify this path /company/{{ config['realm_id'] }}/query?query=SELECT * FROM Account STARTPOSITION {{ next_page_token }} MAXRESULTS 2 so the {{ next_page_token }} variable is driven by a fixe offset pagination, but my smooth-brain can’t figure it out from the documentation. I’m feel THIS CLOSE, but need help to get it across the finish line. Any guidance would be GREATELY appreciated!


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.

Join the conversation on Slack

["pagination-variables", "url-path", "streams", "connector"]
2

Try using Cursor-based and then Custom to inject the token, then it acts like Path but you can add whatever variables you need (although you may need to URL encode the SQL bit)

3

Exactly what <@U035912NS77> says! You can use cursor-based pagination, set it to inject a query parameter, name query, value as you stated above, that I think should work.