Failure syncing data to BigQuery from multiple sources

Slack Knowledge Base Q&A Connector Questions
, , , ,
1

Summary

Encountering failures while syncing data from multiple sources to BigQuery with a common error message. Need assistance in understanding and resolving the root cause of the issue.


Question

Hello Team,
I need your assistance as I’m encountering failures while attempting to sync data from three different sources to BigQuery using Airbyte. They all fail with the same message: “message=‘io.temporal.serviceclient.CheckedExceptionWrapper: io.airbyte.workers.exception.WorkerException: Running the launcher replication-orchestrator failed’, type=‘java.lang.RuntimeException’, nonRetryable=false”. I’m struggling to understand the root cause of this issue. Could you please help me understand and resolve it as soon as possible?

Sourcesand Destination that we are using are

  1. ADP Secure SFTP to BigQuery
  2. Google Drive to BigQuery
  3. Google Sheet to BigQuery
    Thank you.

This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.

Join the conversation on Slack

["sync-data", "bigquery", "failure", "multiple-sources", "adp-secure-sftp", "google-drive", "google-sheet"]
2

<@U06PB8VHBA7>, have you updated airbyte? are you hosted on docker? IF so, maybe you need to perform the docker volume owner change as specified in airbyte migration guide. https://docs.airbyte.com/release_notes/march_2024#platform-releases

3

Hi Jade We haven’t updated our Airbte and yes we have hosted it on docker. Please help us in updating the airbyte

4

Usually on docker the procedure is pretty straightforward. Here is the doc: https://docs.airbyte.com/operator-guides/upgrading-airbyte|https://docs.airbyte.com/operator-guides/upgrading-airbyte