Data Backfilling from MySQL to ClickHouse

Slack Knowledge Base Q&A Connector Questions
, , , ,
1

Summary

User seeks assistance with backfilling data using Airbyte from MySQL to ClickHouse and is unable to find the transform section or related query options.


Question

Hi guys, I have installed airbyte and want to use it for backfilling data from MySQL sources to clickhouse destination. But I can not find any transform section or any section to specify a query to move a part of data. Can you help me please?
should I install any other version or …?


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

['mysql', 'clickhouse', 'backfilling', 'data-transfer']
2

Not today; there is future work planned to introduce a usability layer that will allow you to customize database sources.

3

For today if you want to limit data you must create a view in your database source and using the view.

4

And what about transformations like add columns or edit some columns?

5

You can deselect columns but not edit/add with rules. You can include new one as schema changes.