Question about Refresh Mode in Airbyte

Summary

User is asking about the behavior of switching from full refresh to incremental (dedupe) in Airbyte’s Refresh mode, specifically whether it retains or removes records when refreshing the stream.


Question

Hey team, for the new Refresh mode,

When i switch from full refresh to incremental (dedupe), it will ask to refresh the stream,

Wondering, it is refresh and retain OR remove record?



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["refresh-mode", "full-refresh", "incremental", "dedupe", "retain-records", "remove-records"]

https://docs.airbyte.com/operator-guides/refreshes

have test it out, it is refresh and retain then dedupe, if remove, the internal table will almost remove the old generation records, but switching sync mode didnt remove old record in generation records