Ingesting TSV Files from SFTP Source to Snowflake via Airbyte

Slack Knowledge Base Q&A Connector Questions
, , , ,
1

Summary

Airbyte can recognize CSV streams but not TSV from SFTP source to Snowflake. Looking for a solution.


Question

I have a very simple use case. We have a sftp source where files are in csv and tsv. Want to ingest everything to snowflake via airbyte. While Airbyte can recognise the CSV streams TSV it cant. Any solution?


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["ingest", "tsv-files", "sftp-source", "snowflake", "airbyte", "connector"]
2

Seems like the Reader Options field would let you specify a different separator

3

yep, should be able to specify a tab using something like {"sep":"\t"}

I don’t recall if this field needs to be double-escaped, if so you may need to enter it as {"sep":"\\t"}

(If that still doesn’t work, you could try the Unicode representation of a tab using \u0009 or \\u0009)