What is the "guarantee" of Airbyte data extraction?

Q&A
1

What is the “guarantee” of Airbyte data extraction?

  • At least once
  • At most once
  • Exactly once
2

Hey @datayoshi,
Great question!
The current guarantee is at least once.
Partial failure can lead to duplicates and we consider that the most important is to have exhaustive raw data and that cleaning can happen downstream or via our Incremental Dedupe normalization.

1 Like
4

Thanks @alafanechere for your reply,
can you please direct me if there is a reference in the docs about it?
thanks in advance.

5

This is lightly referenced here. Feel free to ask what additional details would be useful to you so that we can improve this documentation.