Source MySQL Datetime column is replicated with microseconds

marcosmarxm · March 11, 2022, 5:44pm

In mysql to mysql connection Datetime columns are replicated as string. Ex: ‘2018-02-09 09:45:00’ is replicated as ‘2018-02-09T06:45:00.000000Z’. Is there a solution in Airbyte for this?

From Slack Thread

marcosmarxm · March 11, 2022, 5:53pm

Airbyte transform MySQL datetimes and timestamp to ISO 8601 format with micro seconds. This allow Airbyte to apply normalization in a more standard way and keep both times similar to other databases.

github.com

airbytehq/airbyte/blob/744e0d5f1305fe5069ed85a54ee9d1e5e27eab9b/airbyte-integrations/connectors/source-mysql/src/main/java/io/airbyte/integrations/source/mysql/MySqlSourceOperations.java#L74-L77

      
        
            case DECIMAL, DECIMAL_UNSIGNED -> putBigDecimal(json, columnName, resultSet, colIndex);
            case DATE -> putDate(json, columnName, resultSet, colIndex);
            case DATETIME, TIMESTAMP -> putTimestamp(json, columnName, resultSet, colIndex);
            case TIME -> putTime(json, columnName, resultSet, colIndex);

Topic		Replies	Views
Setting up datetime format between MySQL table and Parquet file in Airbyte Connector Questions mysql-table , airbyte-connector , connector , question , parquet-file	1	3	September 8, 2024
BigQuery destination field data type Connector Questions & Issues destination-bigquery , connectors	2	630	June 15, 2023
Handling numeric and date data conversion issue in Airbyte Platform Questions platform , mysql , airbyte , question , data-synchronization	0	40	May 14, 2024
Data Type Conversion Issues in Airbyte Connector Questions mysql , airbyte , connector , google-sheets , data-type-conversion	0	4	November 28, 2024
Guidance / update on MySQL source connector issues Connector Questions & Issues source-mysql	3	276	July 14, 2022

Source MySQL Datetime column is replicated with microseconds

Related topics