Hi Team,
I am facing a problem when building a connector. The issue is:
- How to handle
backoff
during request when we don’t have aresponse
.
{"type": "LOG", "log": {"level": "INFO", "message": "Backing off _send(...) for 5.0s (airbyte_cdk.sources.streams.http.exceptions.DefaultBackoffException: Request URL: https://data.integralplatform.com/report, Response Code: 429, Response Text: {\n \"message\":\"API rate limit exceeded\"\n})"}}
{"type": "LOG", "log": {"level": "INFO", "message": "Caught retryable error 'Request URL: https://data.integralplatform.com/report, Response Code: 429, Response Text: {\n \"message\":\"API rate limit exceeded\"\n}' after 1 tries. Waiting 5 seconds then retrying..."}}
{"type": "LOG", "log": {"level": "INFO", "message": "Backing off _send(...) for 10.0s (airbyte_cdk.sources.streams.http.exceptions.DefaultBackoffException: Request URL: https://data.integralplatform.com/report, Response Code: 429, Response Text: {\n \"message\":\"API rate limit exceeded\"\n})"}}
{"type": "LOG", "log": {"level": "INFO", "message": "Caught retryable error 'Request URL: https://data.integralplatform.com/report, Response Code: 429, Response Text: {\n \"message\":\"API rate limit exceeded\"\n}' after 2 tries. Waiting 10 seconds then retrying..."}}
{"type": "LOG", "log": {"level": "INFO", "message": "Backing off _send(...) for 20.0s (airbyte_cdk.sources.streams.http.exceptions.DefaultBackoffException: Request URL: https://data.integralplatform.com/report, Response Code: 429, Response Text: {\n \"message\":\"API rate limit exceeded\"\n})"}}
{"type": "LOG", "log": {"level": "INFO", "message": "Caught retryable error 'Request URL: https://data.integralplatform.com/report, Response Code: 429, Response Text: {\n \"message\":\"API rate limit exceeded\"\n}' after 3 tries. Waiting 20 seconds then retrying..."}}