Duplicate data in Bigquery when synchronizing in Incremental mode

Summary

When synchronizing data in Incremental mode (Append OR Append + Deduped), user is experiencing a lot of duplicates in Bigquery and seeks explanation.


Question

I also have a second issue :
When synchronizing data in an Incremental mode (Append OR Append + Deduped), I recover a lot of duplicates in Bigquery and I can’t explain why
Thanks again for your help



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.

Join the conversation on Slack

["duplicate-data", "bigquery", "incremental-mode", "append", "deduped"]