Handling Renamed Tables in MySQL Source Connector

Slack Knowledge Base Q&A Connector Questions
, , , ,
1

Summary

The user is facing issues with handling renamed tables in the MySQL source connector, leading to duplicate data in the destination table. They are seeking advice on preventing this issue.


Question

Hey team :octavia-hello:

here i was using mysql source connector
My setup is using self hosted airbyte via docker composer
— what i facing in mysql connector

  1. on one of my table [abc] i renamed in my production RENAME TABLE abc TO abc_backup, abc_tmp TO abc;
  2. what i do after i pushed my abc_backup data to abc
  3. in destination i have already sync data of table abc , when i perform rename after that cdc changes make it duplicate data in my destination table
    — how can i prevent this :thinking_face:

This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["mysql-source-connector", "renamed-tables", "duplicate-data", "cdc-changes"]