Twilio > S3 failing and twilio refresh source schema not finishing

Connector Questions & Issues
, ,
1
  • Is this your first time deploying Airbyte?: no
  • OS Version / Instance: amazon-linux-2
  • Memory / Disk: you can use something like 8GB memory / 200GB disk
  • Deployment: docker
  • Airbyte Version: 0.40.3
  • Source name/version: twilio 0.1.8
  • Destination name/version: S3 0.3.15
  • Step: The issue is happening during sync
  • Description: I just updated to airbyte v 0.40.3 and Twilio started failing. I am seeing the following errors.
    2022-09-02 18:26:14 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed.
    and
    2022-09-02 18:27:03 ERROR i.a.w.g.DefaultReplicationWorker(run):184 - Sync worker failed.
    When I try to refresh source schema to see if anything has changed it never finishing fetching.
2

Hey could you share the complete log of the sync here as a file? It can help us understand and help in a better fashion.

3

logs-2459.txt (224.1 KB)
@harshith here you go. Thanks for taking a look!

4

Hey got it. Looks to me like some trouble with the connector

File "/airbyte/integration_code/main.py", line 13, in launch(source, sys.argv[1:]) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 123, in launch
for message in source_entrypoint.run(parsed_args):
File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 114, in run for message in generator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 102, in read stream_instances = {s.name: s for s in self.streams(config)}
File "/airbyte/integration_code/source_twilio/source.py", line 71, in streams
"lookback_window": config["lookback_window"],
KeyError: 'lookback_window'

Could you create a github issue so that team can look into it