Source MySQL Datetime column is replicated with microseconds

marcosmarxm · March 11, 2022, 5:44pm

In mysql to mysql connection Datetime columns are replicated as string. Ex: ‘2018-02-09 09:45:00’ is replicated as ‘2018-02-09T06:45:00.000000Z’. Is there a solution in Airbyte for this?

From Slack Thread

marcosmarxm · March 11, 2022, 5:53pm

Airbyte transform MySQL datetimes and timestamp to ISO 8601 format with micro seconds. This allow Airbyte to apply normalization in a more standard way and keep both times similar to other databases.

github.com

airbytehq/airbyte/blob/744e0d5f1305fe5069ed85a54ee9d1e5e27eab9b/airbyte-integrations/connectors/source-mysql/src/main/java/io/airbyte/integrations/source/mysql/MySqlSourceOperations.java#L74-L77

      
        
            case DECIMAL, DECIMAL_UNSIGNED -> putBigDecimal(json, columnName, resultSet, colIndex);
            case DATE -> putDate(json, columnName, resultSet, colIndex);
            case DATETIME, TIMESTAMP -> putTimestamp(json, columnName, resultSet, colIndex);
            case TIME -> putTime(json, columnName, resultSet, colIndex);

Topic		Replies	Views
BigQuery destination field data type Connector Questions & Issues destination-bigquery , connectors	2	541	June 15, 2023
Guidance / update on MySQL source connector issues Connector Questions & Issues source-mysql	3	237	July 14, 2022
Maintain datetime/timestamp datatype in destination (IE Postgres & SQL Server sources) Connector Questions & Issues normalization , data-loading , connectors	1	651	October 25, 2022
MSQL Source SQL Exception Month/Year Connector Questions & Issues data-loading	9	518	October 27, 2022
MS SQL Server: How to keep a Date being a Date Connector Questions & Issues connectors	2	142	March 16, 2023

Source MySQL Datetime column is replicated with microseconds

Related Topics