Concerns Regarding Timestamp-Based Data Consistency

Summary

User expresses concerns about data consistency in a timestamp-based approach, particularly when parsing jobs run before Airbyte sync completion and the handling of block deletions.


Question

Another thing that borders me when I think about a time stamp based approach is data consistency. What will happen when my parsing job will be executed before the airbite sync is finished? How to handle blocks deletion?



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

['data-consistency', 'timestamp-based', 'parsing-job', 'airbyte-sync', 'block-deletion']