Setting up Bigquery as Destination in Airbyte with Default Credentials Error

Slack Knowledge Base Q&A Connector Questions
, , , ,
1

Summary

When setting up Bigquery as a destination in Airbyte, encountering an error related to default credentials not being found. User has configured ADC with Google Account locally but still facing the issue.


Question

Hi All,
I am trying to setup Bigquery as Destion in Airbyte, I have given all the required information and while testing connection i am getting the below error.
“Configuration check failed
java.io.IOException: Your default credentials were not found. To set up Application Default Credentials for your environment, see https://cloud.google.com/docs/authentication/external/set-up-adc.”

I am running Open source Airbyte on my local machine, I have done Configure ADC with your Google Account locally and done the default login, still the same error. ( service account option not preferred as running locally ) . Any help for the default authentication part?


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["bigquery-connector", "airbyte-destination", "default-credentials", "google-account", "authentication"]
2

Have you set Service Account Key JSON?

3

• In documentation it says (Required for Airbyte Cloud; Optional for Airbyte Open Source) A Google Cloud <https://cloud.google.com/iam/docs/service-accounts|Service Account> with the BigQuery User and BigQuery Data Editor roles and the <https://cloud.google.com/iam/docs/creating-managing-service-account-keys|Service Account Key in JSON format>.
So i was trying with out the service account and going with default login , Is that not possible?

4

If you want to use default credentials, feel free to dig into code and figure out how to do that
https://github.com/airbytehq/airbyte/blob/7b70a70eb098e16924ecafbf0896910a821f1ad2/airbyte-integrations/connectors/destination-bigquery/src/main/kotlin/io/airbyte/integrations/destination/bigquery/BigQueryDestination.kt#L548|BigQueryDestination.kt#L548
<Class GoogleCredentials (1.28.0)  |  Java client library  |  Google Cloud(HttpTransportFactory transportFactory)>