Airbyte continues to sync data using the configured schema until that schema is updated. Because Airbyte treats all fields as optional, if a field is renamed or deleted in the source, that field simply will no longer be replicated, but all remaining fields will. The same is true for streams as well.
For now, the schema can only be updated manually in the UI (by clicking “Update Schema” in the settings page for the connection). When a schema is updated Airbyte will re-sync all data for that source using the new schema.
Hi @avaidyanatha,
Can you please share what is the current status of the roadmap with regards to handling of source schema changes ? Is there an ETA for the possibility to reset only 1 stream ?
Having to reset the whole source just to sync a new column in a table is a pain and causes the loss of the whole history.
I am talking about Postgres source in incremental model, but I guess the evolution is more general.
Hi @anatole,
Our team is actively working this quarter to make schema changes available in Airbyte. Feel free to track evolution on these GitHub issues: