Summary
User is facing an issue setting up CDC from Postgres to Snowflake with history data sync mode. They are unable to find the ‘deduped + history’ sync mode as recommended.
Question
Hi, We are setting a connection from postgres (source) to snowflake (destination) using CDC, now we can get the postgres data to snowflake, however, we can not get the history data. For example, if a record is updated in the postgres table, we only get the updated value for the record in snowflake, but we do not keep track of the historical value of the record with metadata like “_airbyte_start_at”. I was then recommended to use “deduped + history” sync mode, but I can not find this sync mode at all. I only saw four types of sync mode:
incremental | Append + Deduped
incremental | Append
Full refresh | Overwrite
Full refresh | Append
Where could I set it up wrong? Thank you!
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.