SFTP Connector Appending Airbyte Metadata Columns with Additional Double Quotes


When using the SFTP connector to transfer files to S3, the Airbyte metadata columns are appended with additional double quotes for all column values, including the Airbyte data column. The user is looking for a way to transform this file as part of Airbyte.


I am using SFTP connector for transferring file to S3, After file transfer successfully , I can see the airbyte metadata columns are appended in the file putting additional double quotes for all column values including the airbyte data column. Is there a way I can transform this file as a part of airbyte ?

This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.

Join the conversation on Slack

["sftp-connector", "airbyte-metadata", "double-quotes", "file-transfer", "transform"]