- Is this your first time deploying Airbyte?: No
- OS Version / Instance: MacOS
- Deployment: Hosted on google cloud
- Airbyte Version: 0.40.9
- Source name/version: Postgres 1.0.14
- Destination name/version: BigQuery (denormalized typed struct) 0.1.11
- Step: The issue is happening during sync
- Description:
Hey Team,
I’m connecting our PostgresSQL to BigQuery denormalized using the Postgres source. I’m running into an issue with Keywords
table , where during the initial run using the incremental load with id
as the cursor, it’s establishing the cursor fields during the first run. But when I run it again instead of appending new values it is again establishing the cursors, and performing full-refresh append
There’s about 700K records, with around 600k log lines.
First run:
e30640bb_ad76_4a17_adb0_e97a492316d9_logs_44035_txt.txt (305.1 KB)
Second run:
e30640bb_ad76_4a17_adb0_e97a492316d9_logs_44039_txt.txt (1.4 MB)