Is there any built in functionality to leverage for a destination, specifically S3, to be able to back fill if my connection was down for a few days? Specifically, if I want to ingest a set period of data everyday and save, can I simulate this until the connector is caught up?
Hi @ngille,
With incremental streams comes the notion of cursor
field. These cursor fields are meant to track the progress of replication and are stored in the state
of a connection.
It means that if your sync is off or failing, the next run will pick up from the last cursor value that was stored in the state
.
In other words, yes, you already have free backfill