Error setting up Google Drive Connector in local Docker instance of Airbyte

Slack Knowledge Base Q&A Connector Questions
, , , ,
1

Summary

The user is encountering an error while setting up the Google Drive Connector in a local Docker instance of Airbyte. The error indicates that no files were identified in the stream, possibly due to no files in the specified container or overly strict glob patterns. The folder contains PDF files.


Question

Running a local Docker instance of Airbyte. Setting up the Google Drive Connector I keep getting this error:

[‘Traceback (most recent call last):\n File “/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/file_based/availability_strategy/default_file_based_availability_strategy.py”, line 81, in _check_list_files\n file = next(iter(stream.get_files()))\nStopIteration\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File “/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/file_based/availability_strategy/default_file_based_availability_strategy.py”, line 62, in check_availability_and_parsability\n file = self._check_list_files(stream)\n File “/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/file_based/availability_strategy/default_file_based_availability_strategy.py”, line 83, in _check_list_files\n raise CheckAvailabilityError(FileBasedSourceError.EMPTY_STREAM, stream=stream.name)\nairbyte_cdk.sources.file_based.exceptions.CheckAvailabilityError: No files were identified in the stream. This may be because there are no files in the specified container, or because your glob patterns did not match any files. Please verify that your source contains files last modified after the start_date and that your glob patterns are not overly strict. Contact Support if you need assistance.\nstream=posted.ohs\n’] that your source contains files last modified after the start_date and that your glob patterns are not overly strict. Contact Support if you need assistance.\nstream=posted.ohs\n’]

Any solutions for this?

The folder is full of PDF files.


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.

Join the conversation on Slack

["error", "google-drive-connector", "local-docker-instance", "file-based", "availability-strategy", "pdf-files"]
2

<@U06E3D5SW1F> I am also running the latest Airbyte Docker. I am getting a similar issue with GCS connector. I am trying to read CSV files from a bucket. But the Glob pattern never picks up any of the files. Please post back here if/when you solve your issue.

3

JoeReuter helped out. There were two things. I had to update my docker image (https://docs.airbyte.com/operator-guides/upgrading-airbyte), even though it was only a couple of days old.

The next thing was to make certain that the Google Drive URL doesn’t have anything extra appended to the end.

After that, I as able to connect using either OAuth or Service Account.

4

Cool thanks <@U06E3D5SW1F>