Error starting source with abctl using mongo to bigquery connection

Slack Knowledge Base Q&A Connector Questions
, , , ,
1

Summary

Error message ‘Unable to start the source’ encountered while using abctl with mongo to bigquery connection


Question

Hello everyone, can help me with this error "internalMessage" : "Unable to start the source" "stacktrace" : "io.airbyte.workers.exception.WorkerException: Unable to start the source\n\ , I’m using abctl, the connection is mongo -> bigquery


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["error", "start-source", "abctl", "mongo", "bigquery"]
2

abctl uses kind cluster (https://kind.sigs.k8s.io/) under the hood
If you want to debug, here’s an instruction

install kubectl (https://kubernetes.io/docs/tasks/tools/#kubectl) and kubectx + kubens (https://github.com/ahmetb/kubectx)
install also k9s (https://k9scli.io/)

then execute commands:

KUBECONFIG=~/.airbyte/abctl/abctl.kubeconfig kubectl config view --flatten > ~/.kube/config
kubectx kind-airbyte-abctl
kubens airbyte-abctl```
with `k9s` you can check details about pods and logs

maybe there is a problem with memory? or any other issues that pod cannot be scheduled?
3

<@U05JENRCF7C> I have installed all but the context is not settled?

4

<@U05JENRCF7C> ready to use k9s

5

:ok_hand::skin-tone-2:
how long do you have this Pending state for destination-bigquery-…?

6

it’s funny bigquery pod is up but mongo pod is down now:

7

<@U05JENRCF7C> yes the vm is 6core with 16G of Ram and 1tb of disk

8

Are you running other connections <@U06SFCM101Z>?

9

<@U01MMSDJGC9> no, it’s the only one

10

<@U01MMSDJGC9> if a connector run the other fail (source or dest)

11

Let’s continue the discussion in the other thread: https://airbytehq.slack.com/archives/C021JANJ6TY/p1725396811745139

12

d shortcut opens view with kubectl describe pod ... content
maybe there will be some info why pod cannot start in time

13

do you have enough disk space and memory?