Upgrading Airbyte version and speeding up PG destination upgrade process

Summary

When upgrading from v0.50.35 to 0.63.13 with major upgrades to PG destination, some existing connections are taking several days due to large databases. User is seeking recommendations on speeding up the process, considering resetting the connection to bring all data at once. Initial full sync only took 10-12 hours.


Question

Hi Everyone- I have a question regarding upgrading from v 0.50.35 to 0.63.13 and that involve major upgrade to PG destination. Some of these upgrades on existing connection is taking looonger (several days) as they are large databases. Any recommendation on how to speed it up? is it better to RESET the coonnection to bring all data instead of going thru this upgrade process. Initial full sync only took 10-12 hours when we did it.

Appreciate any Help!
Thanks in Advance!



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["upgrading", "airbyte-version", "pg-destination", "large-databases", "speed-up", "reset-connection", "full-sync"]