Schema Changes Not Propagated for Old Records

Summary

When using Airbyte (version 0.58.1) with schema changes set to propagate all changes, new columns in streams are not updating old records, resulting in null values. Questioning why the sync job did not update old records for new columns.


Question

Hello team,
I have a question related to schema changes.
We are using airbyte (0.58.1) and one of the streams updated with new column. We have set Detect and propagate schema changes to Propagate all changes. But still we are observing that there are null values in the newly added column for the old records.
We are aware that full_refresh/clear data will populate the data but we want to know why the sync job did not update old records for new columns.
Thanks in adv



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["schema-changes", "airbyte", "sync-job", "propagate-all-changes", "null-values"]