Postgres to BigQuery logical replication errors out with invalid timestamp

  • Is this your first time deploying Airbyte?: No
  • OS Version / Instance: GCP
  • Memory / Disk: 16Gb
  • Deployment: Docker
  • Airbyte Version: 0.39.19-alpha
  • Source name/version: Postgres 0.4.24
  • Destination name/version: Bigquery 1.1.9
  • Step: Sync job (normalization)
  • Description:
    Logical replication fails, with error message such as -
2022-06-20 16:24:17 normalization > 16:24:12.538432 [info ] [MainThread]: Completed with 1 error and 0 warnings:
2022-06-20 16:24:17 normalization > 16:24:12.539085 [info ] [MainThread]: 
2022-06-20 16:24:17 normalization > 16:24:12.539571 [error] [MainThread]: Database Error in model deposit_scd (models/generated/airbyte_incremental/scd/raw_checkmate/deposit_scd.sql)
2022-06-20 16:24:17 normalization > 16:24:12.540151 [error] [MainThread]:   Invalid timestamp string "0000-12-30T00:00:00Z"
2022-06-20 16:24:17 normalization > 16:24:12.540678 [error] [MainThread]:   compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_incremental/scd/raw_<db>/<table>_scd.sql

Checking the source table, there is no row with the timestamp 0000-12-30T00:00:00Z. Although there are a couple of entries with the timestamp 0001-01-01 00:00:00+00.

Probably some parsing that turns 0001-01-01 00:00:00+00 into 0000-12-30T00:00:00Z, as the errored out timestamp is exactly 2 days prior to the original timestamp.

Logs -
logs-81417.txt (998.6 KB)

source_catalog.json -
source_catalog.json.txt (4.1 KB)

The Standard replication works as expected for these dbs.

Related issue - Postgres to BigQuery logical replication errors out with invalid timestamp · Issue #13946 · airbytehq/airbyte · GitHub

@alafanechere Please lemme know if any other info is needed :slight_smile:

Hey @alafanechere! Did you get a chance to look at the catalog?