Incremental append and deduped + history

  • Is this your first time deploying Airbyte?: No
  • OS Version / Instance: Ubuntu
  • Memory / Disk: 32Gb / 30 Gb
  • Deployment: Docker
  • Airbyte Version: 0.39.41-alpha
  • Source name/version: MySQL (0.6.1)
  • Destination name/version: BigQuery (1.1.14)
  • Step: The issue is happening during sync.
  • Description: Each sync pull the whole data from the source as if it were a full refresh. I expect it to pull only new records

Please share one log example so it’s possible to understand what is causing that, if it’s missing a cursor etc.

here’s a link to the log

https://github.com/airbytehq/airbyte/files/9283813/logs-32.txt

I think it is missing a cursor because it shows null in the logs.
CDC is set on the source

I escalated the issue to Github to Airbyte team investigate the issue: https://github.com/airbytehq/airbyte/issues/15450