Error connecting MySQL with local DuckDB

Slack Knowledge Base Q&A Connector Questions
, , , ,
1

Summary

When trying to sync data from MySQL to local DuckDB in Airbyte, encountering an error ‘IO Error: Cannot open file /local/destination.duckdb: No such file or directory’.


Question

Hello all,
I am trying to connect MySQL with local DuckDB.
MySQL source is set properly and test pass.
DuckDb is set with default parameter everywhere and test and save pass.
I have followed the doc but when I lunch sync the connection I have the following error :
IO Error: Cannot open file "/local/destination.duckdb": No such file or directory
I do not understand why.
PS : I have installed Airbyte with the abctl local install and everything went good. I am newbie in airbyte and duckdb.


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["mysql", "duckdb", "sync", "error", "airbyte", "abctl", "newbie"]
2

Airbyte in Kubernetes doesn’t support local file access yet. I think your DuckDB connector is trying to access a local file.

3

Ah ok. Can i install airbyte locally ?

4

No, Airbyte is native to K8S now.

We have talked about adding support for local file access though. There’s been a few threads – this one is recent: https://airbytehq-team.slack.com/archives/C021JANJ6TY/p1727299403946419?thread_ts=1727295395.747489&cid=C021JANJ6TY

5

Ok so i have no solution if i want a local database (duckdb, postgre), airbyte is not working for that purpose anymore ?

6

If you can expose the database over the network (e.g. postgres) it works, it just local file access that doesn’t work

7

I’m not familiar with DuckDB

8

Ok thanks for the answer :slightly_smiling_face: I will make a localpostgre with network connection