Issue with Full Refresh Overwrite Mode for Postgres to BigQuery

Summary

User reports that using full refresh overwrite mode for syncing a Postgres table to BigQuery results in occasional blank tables in the destination, despite data being present in the source table.


Question

Hi team,
I am observing a weird behavior for a postgres table. As this table is not having timestamp column I am using full refresh overwrite mode for syncing the data. But the problem is some times the table come as blank and because of full refresh the table in destination bigquery is also getting blank. I have verified the data is present in postgres table and it is not blank, why still airbyte is fetching it to be blank?



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

['postgres', 'bigquery', 'full-refresh', 'overwrite-mode', 'data-sync']