How Can I Assign a DNS to Airbyte Web UI Deployed on AWS EC2?

Platform, Deploy & Infra Issues
1

  • Is this your first time deploying Airbyte?: Yes

  • OS Version / Instance: Linux (Amazon)

  • Memory / Disk: you can use something like 16Gb / 8 Gb

  • Deployment: Docker

  • Airbyte Version: 0.40.10

  • Source name/version: Zuora alpha 0.1.3

  • Destination name/version: Snowflake

  • Step: The issue is happening during sync

  • Description:
    I deployed Airbyte on an AWS EC2 instance. I can access the web UI using an ssh tunnel as described in the documentation. But I’d like to assign it a DNS and make it available to the other team members. Is that possible?

2

Hey @murat,

This is a good question. I’m not entirely sure but my immediate answer is either that it’s not possible or that it is actually possible but not recommended. Mainly because you don’t really want to expose your private instance Airbyte to the world. I’ll ask the team about this and try to get a more concrete answer for you soon. Just wanted to make you aware that we saw your post here.

Thanks!

3

Thank you @sajarin .
My goal is not to have a public DNS but a private one to my team or my company. Something that can be reached via a VPN.

Best,
Murat

4

Hey @murat,

I asked my team about this. It is possible, you’d have to use a reverse proxy like nginx or traefik in front of airbyte to assign a URL and route DNS to there. You’ll have to terminate TLS since Airbyte doesn’t support it at the moment. You may also want to consider using ELB.

We don’t have a guide at the moment for any of this, so I imagine some of it will be trial and error. It would be great if you get it to work and come back here to share your findings with the rest of the community. Hope this helps!

5

Thank you @sajarin . I’ll let you know about it.

6

Hi @murat-cetinkaya , Could you plz share if you’ve been successful in this approach to view the UI for the AirByte deployed on EC2

7

Hi @dheeraj_neppalli,
Airbyte has added basic authentication feature since version 0.40.17.
Here’s the documentation October 2022 | Airbyte Documentation
I hope it helps.
Murat

8

Hi @murat-cetinkaya ,
Thank you for the prompt response. I’ve tried today and was able to successfully perform SSH tunneling from my local machine to EC2 Instance and eventually checkout the Airbyte UI (Though not recommened to expose airbyte to public internet ports). I am looking at putting an nginx reverse proxy as mentioned under Network Security in the article Have you tried that approach before and could you plz share if you’ve been able to accomplish “My goal is not to have a public DNS but a private one to my team or my company. Something that can be reached via a VPN.”

Thanks,
Dheeraj

9

Hi @dheeraj_neppalli ,
I changed my strategy and used a private dns instead. Using Airbyte’s out of box basic authentication with a VPN is pretty enough for me now.
Best,
Murat