MySQL Source Error with Non-English Columns

[slack-user-airbyte]

Summary

The user is encountering an error with MySQL Source when using non-English columns in a table. The error message indicates a duplicate field issue in the Avro schema, and there is a warning log about illegal characters in the field name.

Question

Hello!
Doesn’t MySQL Source support other language column?
Table has columns that is not english, then I got error like below:
org.apache.avro.AvroRuntimeException: Duplicate field _____ in record [my_table_name]: _____ type:UNION pos:17 and _____ type:UNION pos:16.
and there is WARN log like below:
destination > WARN main i.a.c.i.d.s.a.JsonToAvroSchemaConverter(getAvroSchema):121 Field name "[column name not english]" contains illegal character(s) and is standardized to "________"

---

This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

_{["mysql-source", "non-english-columns", "avro-runtime-exception", "duplicate-field", "illegal-characters", "warning-log"]}

[slack-user-airbyte]

I’ve seen others report issues with this in the past. It also affects other destinations, such as Snowflake:
https://github.com/airbytehq/airbyte/issues/18058

I would recommend searching GitHub for an existing issue that matches yours, or adding a feature request there related to this functionality.