Issue with schema detection and incremental loading in connector for sticky.io

Summary

The user is facing an issue with schema detection and incremental loading in the connector for sticky.io. They are receiving a ‘Discovering schema failed’ error when trying to set up a new connection. Disabling incremental loading resolves the issue, but it is necessary for this data source. The tests in the connector builder are successful.


Question

Im trying to build a connector to load transaction data from http://sticky.io|sticky.io. I’m running into an issue with the schema detection when trying to sync. The tests in the builder work perfectly fine, but when I try to set up a new connection, I’m getting the following error

common.error```
I found that if I disable incremental loading, then it seems to work fine, however for this data source I need incremental loading to work, else I would overload the api. Any suggestions?

<br>

---

This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C027KKE4BCZ/p1707590761413379) if you want to access the original thread.

[Join the conversation on Slack](https://slack.airbyte.com)

<sub>
["sticky.io-connector", "schema-detection", "incremental-loading", "api-overload"]
</sub>

New message text here

I have the exact same issue and is trying to find the solution.