Naming convention for synced tables in Airbyte API

Slack Knowledge Base Q&A API, Terraform and Other Topics
, , , ,
1

Summary

When creating a connection via the Airbyte API with custom_format as namespaceDefinition, the synced table name includes additional pieces like raw__stream. How to avoid this and have only <namespaceFormat>_<source_table_name>?


Question

Hi all, just puzzled by the final name of the table where the data is synced. When creating the connection via the Airbyte API I use custom_format as namespaceDefinition , I can see the namespaceFormat string prepended in the table name, but there’re additional pieces like raw__stream so the final name is <namespaceFormat>_raw__strem_<source_table_name> , does anyone know how to avoid this? Ideally, I would want only <namespaceFormat>_<source_table_name>


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["naming-convention", "synced-tables", "airbyte-api", "namespace-definition", "table-name"]
2

namespace defines where the data will lands, you can use prefix to append anything to your final tables names.
What destination are you using? It looks if you have only raw__ as final ones maybe is a destination doesn’t support dv2 typing and deduping.

3

Destination is Clickhouse, it seems typing and deduping has been rolled back indeed

4

I see, the destination Clickhouse doesn’t support typing-deduping today [https://github.com/airbytehq/airbyte/discussions/35339|1] so you’re going ending with the raw__ tables and unfortunately it isn’t possible to change this today.

5

I understand, thanks