Zendesk Support Limits Users stream to 100,000

  • Airbyte version: 0.35.64-alpha
  • OS Version / Instance: AWS EC2
  • Deployment: Docker
  • Source Connector and version: Zendesk Support (0.2.5)
  • Destination Connector and version: Snowflake (0.4.24)
  • Severity: Critical
  • Step where error happened: Sync
  • Description: zendesk support connector does not pull all users for the Users stream. It is limited to 100,000.

If you read the API docs, it explicitly details this here

Hi @danieldiamond ,
The doc says:

When the count exceeds 100,000, the refreshed_at property may occasionally be null. This indicates that the count is being updated in the background. The count object’s value property is limited to 100,000 until the update is complete.

Do you think it means that the connector should not read data from this stream if refreshed_at is null?

Do you mind opening an issue on our GitHub repo for this improvement and mention it here?