Issue with Full Refresh Overwrite on BigQuery

Summary

User reports that during a Full Refresh Overwrite on BigQuery, the destination table is deleted before the transformation completes, leading to an empty table if the transformation fails. User is inquiring if this is expected behavior or a bug.


Question

Hello, everyone!

I’m facing an issue when performing a Full Refresh Overwrite on BigQuery from an internal API. My destination table gets deleted before the transformation is complete, so if the transformation fails, my table ends up empty. Is this the expected behavior or is it a bug?
I’m using Airbyte version 0.5.15 and BigQuery version 1.8.0.

Any help or suggestions would be greatly appreciated!

Thanks in advance!



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

['full-refresh-overwrite', 'bigquery', 'transformation-failure', 'airbyte-0.5.15']