Summary
The user is facing issues while using the GCS source connector to read CSV files from a GCS bucket. They are able to read files using the File connector but need to read multiple files for an event stream. Multiple CSV files are encountering the same problem, and the error log indicates an exit code of 1.
Question
Hello ! I am having trouble using the source GCS connector to read CSV files from GCS bucket . I am able to read it using the File connector (but I need to read multiple files for event stream ) which shows I can connect from Airbyte to the GCS bucket .
I tried with multiple CSVs and all are having same issues ; not sure what I am doing wrong.
Error logs
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File “/airbyte/integration_code/main.py”, line 8, in <module>
run()
File “/airbyte/integration_code/source_gcs/run.py”, line 44, in run
launch(source, sys.argv[1:])
File “/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py”, line 214, in launch
for message in source_entrypoint.run(parsed_args):
File “/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py”, line 114, in run
yield from map(AirbyteEntrypoint.airbyte_message_to_string, self.check(source_spec, config))
File “/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py”, line 138, in check
check_result = self.source.check(self.logger, config)
File “/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py”, line 84, in check
check_succeeded, error = self.check_connection(logger, config)
File “/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/file_based/file_based_source.py”, line 105, in check_connection
raise AirbyteTracedException(
airbyte_cdk.utils.traced_exception.AirbyteTracedException: Please check the logged errors for more information.
2024-03-27 20:39:04 platform > Check connection job subprocess finished with exit code 1
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.