Summary
User is experiencing issues with the connector builder’s incremental sync configuration, where it only syncs the last 1000 records instead of new records based on the primary ID key. The paging is set to 1000, but it fails to move to the next page for additional records during subsequent incremental syncs.
Question
i am having a few issues with the connector builder specifically the incremental sync and the No Filter (data feed) configuration. When i set this up my connector just sync’s the last 1000 records every sync (my paging is set to 1000 records), it doesn’t seem to just sync the new records based on the primary id key.
it also just does the 1000 rather than actually move on to the next page if there is more. The first sync is fine and all 500k rows are loaded in fine, its just on the subsequent incremental’s. Has anyone else managed to set this up successfully for an api that doesn’t support date time filtering but does incremental id’s
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.