Airbyte tables truncated before July 22nd 10pm UTC

Slack Knowledge Base Q&A Platform Questions
, , , ,
1

Summary

Data in Airbyte tables truncated before specific date and time, impacting reporting. Seeking help on resyncing connectors.


Question

Hi, all our Airbyte tables are have been truncated for data before July 22nd 10pm UTC :warning:
We are using Airbyte Cloud with Postgres Destination V2. This has a critical impact as all our reporting are down.

:point_right: Has anyone else experienced similar issue ?
Iā€™m trying to resync the smaller connectors but am quite worried for the larger ones as we would incur high fees for the resync


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["airbyte-tables", "truncated-data", "postgres-destination-v2", "data-loss", "resync", "reporting-impact"]
2

Can you share which version of postgres you used? We had a bug with the v2.1.x line which could cause a truncation. We have have rolled back support for refreshes for the moment with the v2.2x. line, which fixes this bug.

3

I received an email that confirms this :


 

We are reaching out because connection(s) in your workspace were impacted by a recent incident involving the Postgres Destination Connector. Due to the nature of this incident, your Raw and Final Tables are likely missing records. Unfortunately, we are unable to isolate which connections were explicitly impacted by this and recommend checking the completeness of your data in your Destination Tables.  

To restore all data to your Tables:


   1. Run a "Clear" on any impacted connection(s)


           a. If the Clear fails due to a Failed to drop table without the CASCADE option  error we recommend manually dropping the Final Table(s) in Postgres or running alter table <final table> drop column _airbyte_generation_id   on all of the Final Tables


   2. Once the "Clear" has completed Successfully Initiate a Sync


   3. This sync will be a Historic Backfill, please submit a Support Ticket once it is completed and we will return the credits consumed by the Backfill to your workspace

We apologize for any inconvenience this incident caused. Please reach out to Airbyte Cloud support if you have any questions or to request credit reimbursement. To open a ticket, select the "Support" icon in the Cloud platform, or visit our Help Center.

 

Sincerely,
Airbyte Support```