Summary
The user is looking to modify document structure to avoid extra indentation for Airbyte data, specifically removing the airbyte_raw prefix and restructuring the data fields.
Question
Hi!,
I’m trying to avoid the extra level of indentation in the documents. Because ORM model will break.
All documents have the data in _airbyte_data and the collection have the the prefix airbyte_raw
eg: the collection airbyte_raw_INFOBIKE_EDIZIONE
{
_id: ObjectId("61ee879f399a9d1f227c5584"),
_airbyte_data: {
ANNO_EDIZIONE_DEL_FILE_AAAA: '2022',
MESE_EDIZIONE_DEL_FILE_MM: '02',
DATA_AGGIORNAMENTO_DEL_FILE_AAAAMMGG: '20211220',
TAPPO_NUMERICO: '0'
},
_airbyte_data_hash: 'f3ed19d8-2826-38b0-8162-8068ab5b238a',
_airbyte_emitted_at: '2022-01-24T10:59:10.273'
}
]```
I want to be able to mirror the source, or at least have the collections without the airbyte_raw prefix and have the airbyte necessary information inside airbyte_data, while removing the level airbyte_data
eg: the collection airbyte_raw_INFOBIKE_EDIZIONE become INFOBIKE_EDIZIONE
```[
{
_id: ObjectId("61ee879f399a9d1f227c5584"),
ANNO_EDIZIONE_DEL_FILE_AAAA: '2022',
MESE_EDIZIONE_DEL_FILE_MM: '02',
DATA_AGGIORNAMENTO_DEL_FILE_AAAAMMGG: '20211220',
TAPPO_NUMERICO: '0'
_airbyte_data_hash: 'f3ed19d8-2826-38b0-8162-8068ab5b238a',
_airbyte_emitted_at: '2022-01-24T10:59:10.273'
}
]```
<br>
---
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C027KKE4BCZ/p1705496589033059) if you want to access the original thread.
[Join the conversation on Slack](https://slack.airbyte.com)
<sub>
["airbyte-data", "indentation", "document-structure", "prefix-removal"]
</sub>