Issue with Incremental Refresh in Airbyte Sync

Summary

After dropping destination schema and _airbyte schema, incremental refresh in Airbyte sync is missing data. User seeks help to understand how to clear initial data and ensure incremental refresh runs smoothly.


Question

Hello Everyone,

In the latest Airbyte version, after running a sync, I anticipated that those configured with incremental append and deduped would initiate a full refresh at the beginning, but it seems that’s not the case. My incremental refresh are missing data too.

Prior to syncing, I dropped the destination schema previously, and its related _airbyte schema.

Could you help me understand what’s going on please? How do I completely clear the initial data, and ensure incremental refresh runs fine?



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["incremental-refresh", "airbyte-sync", "destination-schema", "_airbyte-schema", "data-missing"]