Copying Files AS IS from Source to Destination in Azure Blob Storage

Slack Knowledge Base Q&A Connector Questions
, , , ,
1

Summary

The user is looking for a way to copy CSV files from source to destination without JSONifying the contents. They have tried using the Files and Azure Blob Storage connectors in Airbyte but are facing the issue of the data being transformed into JSON format.


Question

Hi. Is there a way to copy files AS IS from source to destination? Currently, when I copy a CSV file test.txt from source:

John,25,New York
Emma,30,Los Angeles```
it shows up like this in the destination.
```_airbyte_ab_id,_airbyte_emitted_at,_airbyte_data
"0141053...","1708...",{"Name":"John","Age":"25","Location":"New York"}
"ee0b078...","1708...",{"Name":"Emma","Age":"30","Location":"Los Angeles"}```
 *Is there a way to simply transport the file from source to destination without changing it?* (or at least, not JSONify the contents of the original file)?

More info:
In my case, source and destination are both Azure Blob Storage.
For the source connector, I have tried both the <https://docs.airbyte.com/integrations/sources/file|Files> the <https://docs.airbyte.com/integrations/sources/azure-blob-storage|Azure Blob Storage> with file format set to CSV, but they both yield the same result as above.

<br>

---

This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C021JANJ6TY/p1708452369535779) if you want to access the original thread.

[Join the conversation on Slack](https://slack.airbyte.com)

<sub>
["copy-files", "source-destination", "azure-blob-storage", "csv", "jsonification"]
</sub>
2

thanks for the question Banin, I created a discussion https://github.com/airbytehq/airbyte/discussions/35447 with an answer about the topic. Feel free to ask more directly in the Discussion

3

Thanks for the quick response! :slightly_smiling_face: Will follow up there