Issue with S3 Connector Sync Failure

Summary

User is experiencing a sync failure in pyAirbyte when attempting to connect to the S3 source connector. The sync process fails entirely if one CSV file is unreadable, rather than allowing the remaining files to sync successfully.


Question

Hi !subteam^S01SHT8BSCU|@dev-zazmic, I am trying to connect the source S3 connector using pyairbyte and I am trying to extract the contents of all the .csv files in AWS S3. It’s mostly working fine, but if I have a CSV file which cannot be read by Airbyte, the entire sync is failing instead of just that one file failing and rest of the CSV files still syncing fine. Am I missing something? :slightly_smiling_face:



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

['s3-connector', 'pyairbyte', 'csv-files', 'sync-failure', 'aws']