- Is this your first time deploying Airbyte?: No
- OS Version / Instance: Ubuntu
- Memory / Disk: 32Gb / 120gb
- Deployment: Docker Swarm
- Airbyte Version: 0.42.1
- Source name/version: Custom Amazon Seller Partner on v0.2.29
- Destination name/version: MYSQL 0.1.20
- Step: The issue is happening during sync
- Description:
A few months ago i made a Custom Amazon Seller Partner connector on v0.2.29 (to fix the non renewal of the security token after 1 hour and because on 0.2.30 “GET_FLAT_FILE_ALL_ORDERS_DATA_BY_LAST_UPDATE_GENERAL” did not return any data. (PR pending)
And for the last 2 months this worked great. But today, from one day to the other all my syncs on this connector are failing withe the following error:
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 120, in read
yield from self._read_stream(
File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 189, in _read_stream
for record in record_iterator:
File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 307, in _read_full_refresh
for record_data_or_message in record_data_or_messages:
File "/airbyte/integration_code/source_amazon_seller_partner/streams.py", line 372, in read_records
yield from self.parse_response(response, stream_state, stream_slice)
File "/airbyte/integration_code/source_amazon_seller_partner/streams.py", line 320, in parse_response
document = self.decompress_report_document(payload.get("url"), payload)
File "/airbyte/integration_code/source_amazon_seller_partner/streams.py", line 312, in decompress_report_document
return zlib.decompress(bytearray(report), 15 + 32).decode("iso-8859-1")
zlib.error: Error -3 while decompressing data: incorrect header check
Logs:
05789bfa_4c52_48ad_9150_09e59474ff51_logs_196_txt.txt (185.6 KB)
I have zero clue how and why this happens, anyone with an idea?