GCS Connector Connection Issue

Summary

The user is facing issues with the GCS connector failing to list files from a GCS bucket despite the service account having access to the objects. They are unsure if the issue lies in the way they are listing the BucketName & Streams.


Question

Source: GCS - Connection Issue

Hello, I have a GCS bucket, let’s call it main_bucket with 4 subfolders, each getting a new CSV file daily. I am trying to connect the GCS connector but it is failing and not listing the files. The service account can access the objects (tested in a notebook). What is it that I am missing? Is it the way we list BucketName & Streams?

object path examples:

<gs://main_bucket/sub_folder2/20240218T040007_google.csv>```

<br>

---

This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C021JANJ6TY/p1708437995032659) if you want to access the original thread.

[Join the conversation on Slack](https://slack.airbyte.com)

<sub>
["gcs-connector", "connection-issue", "bucketname", "streams"]
</sub>