Running a sync with Incremental | Deduped mode but it works the same way as incremental | Append

Connector Questions & Issues
1

Hi,
I created a connection from Freshdesk to Redshift & selected the stream “ticket” for replication.

For this, I set the sync mode to Incremental | Deduped with following settings:
Primary Key: subject
Cursor field: This is source defined [updated_at], therefore i couldn’t change this.

image
image1370×592 55.8 KB

image
image912×231 9.45 KB

After i run first sync, i have the following output

1
11915×319 33.4 KB

After 2nd sync, it adds another row with updated subject which is technically the behavior of incremental | Append & not deduped.
We can observe that the column “updated_at” which was my cursor field has an updated value but still it adds another row instead of updating the existing row
image
image1915×319 39.9 KB

2

If you have a change in the subject column then how could it match the two rows?
Try setting the PK to Id column which should allow matching the same row
Primary Key: id

1 Like
3

this worked for me, thanks!