Troubleshooting network resolution issues in Airbyte container on unraid home lab using abctl

Slack Knowledge Base Q&A Platform Questions
, , , ,
1

Summary

The user is facing resolution errors when trying to connect to an external API from the Airbyte container in an unraid home lab setup. They can run nslookup and curl from inside the container but not from the UI. They are seeking guidance on diagnosing this network issue.


Question

I have created a local airbyte install using abctl in an unraid home lab for testing. I have created the instance and am able to connect, and now trying to connect to the example exchante rate api (https://api.apilayer.com) but am getting resolution errors when testing. I can run nslookup and curl on the url from inside the container but not from the ui.

How can i go about diagnosing this networks issue?


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["troubleshooting", "network-resolution", "airbyte-container", "unraid", "abctl", "external-api", "nslookup", "curl", "network-issue"]
2

i was checking from the control plane continer, I dont see any other containers appear after installing with abctl

3

abctl uses kind cluster (https://kind.sigs.k8s.io/) under the hood
If you want to debug, here’s an instruction

install kubectl (https://kubernetes.io/docs/tasks/tools/#kubectl) and kubectx + kubens (https://github.com/ahmetb/kubectx)
install also k9s (https://k9scli.io/)

then execute commands:

KUBECONFIG=~/.airbyte/abctl/abctl.kubeconfig kubectl config view --flatten > ~/.kube/config
kubectx kind-airbyte-abctl
kubens airbyte-abctl```
then you can follow this instruction
<https://kubernetes.io/docs/tasks/administer-cluster/dns-debugging-resolution/>
4

I think i need to define the gateway in the context of the airbyte python env but I dont know how I would do this

5

> I can run nslookup and curl on the url from inside the container but not from the ui.
Which container have you checked?

Maybe some extra DNS configuration is needed like in this thread
https://forums.unraid.net/topic/102067-solved-where-to-configure-docker-dns/

6

I think this is the path that i would need to be chasing down to see what is happening with the kind routing. when installing kubectl woudl taht be done inside the airbyte control container or just on the unraid host machine?

7

step above are for unraid host machine