Remove related views in "full refresh + overwrite" mode?

Connector Questions & Issues
1
  • Is this your first time deploying Airbyte?: No
  • OS Version / Instance: Ubuntu
  • Memory / Disk: you can use something like 4Gb
  • Deployment: Docker
  • Airbyte Version: airbyte/octavia-cli:0.36.0-alpha
  • Source name/version: snowflake
  • Destination name/version: postgreSQL
  • Step: The issue is happening during sync
  • Description:

Want to know will airbyte remove all related views & the table for each sync in postgreSQL if postgreSQL is set as a destination and use full refresh + overwrite mode?

If set up my environment as using octavia client, source is snowflake, destination is pgSQL, by using “full refresh + overwrite” mode. I defined another view for my destination table in pgSQL.
But each time airbyte is synced, it will automatically first deletes that view. Wondering whether this is intended?

2

Hi @zhydhkcws,

On full refresh, Airbyte won’t remove the raw table but truncate these.
If you use normalization, it might happen that, on full refresh overwrite, DBT drops the views created on top of the tables managed by DBT. This is a DBT known issue:

1 Like
3

Hi there from the Community Assistance team.
We’re letting you know about an issue we discovered with the back-end process we use to handle topics and responses on the forum. If you experienced a situation where you posted the last message in a topic that did not receive any further replies, please open a new topic to continue the discussion. In addition, if you’re having a problem and find a closed topic on the subject, go ahead and open a new topic on it and we’ll follow up with you. We apologize for the inconvenience, and appreciate your willingness to work with us to provide a supportive community.