Summary
User is experiencing an issue where deleted records in MongoDB are also being removed from BigQuery, despite using incremental append with deduplication. They want the records to remain in BigQuery with the
ab_cdc_deleted_atfield populated instead.
Question
Hello community !
Im using Airbyte v0.63.3 with UI.
I configured a connection with mongoDB as source and bigquery as target with incremental append + deduped.
The issu is when I delete a record in the source database, the record is deleted in the target bigquery.
I would like the record not to disappear but the field ab_cdc_deleted_at to be active.
In the target bigquery database all records has the field ab_cdc_deleted_at set to null.
Thank you for your time and help !
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.