Zendesk Support Limits Users stream to 100,000

Connector Questions & Issues
,
1
  • Airbyte version: 0.35.64-alpha
  • OS Version / Instance: AWS EC2
  • Deployment: Docker
  • Source Connector and version: Zendesk Support (0.2.5)
  • Destination Connector and version: Snowflake (0.4.24)
  • Severity: Critical
  • Step where error happened: Sync
  • Description: zendesk support connector does not pull all users for the Users stream. It is limited to 100,000.

If you read the API docs, it explicitly details this here

2

Hi @danieldiamond ,
The doc says:

When the count exceeds 100,000, the refreshed_at property may occasionally be null. This indicates that the count is being updated in the background. The count object’s value property is limited to 100,000 until the update is complete.

Do you think it means that the connector should not read data from this stream if refreshed_at is null?

Do you mind opening an issue on our GitHub repo for this improvement and mention it here?

4

Hi there from the Community Assistance team.
We’re letting you know about an issue we discovered with the back-end process we use to handle topics and responses on the forum. If you experienced a situation where you posted the last message in a topic that did not receive any further replies, please open a new topic to continue the discussion. In addition, if you’re having a problem and find a closed topic on the subject, go ahead and open a new topic on it and we’ll follow up with you. We apologize for the inconvenience, and appreciate your willingness to work with us to provide a supportive community.