Airbyte upgrade version on GCP fails

Platform, Deploy & Infra Issues
,
1
  • Is this your first time deploying Airbyte?: Yes
  • OS Version / Instance: DEBIAN - COMPUTE ENGINE GCP
  • Memory / Disk: you can use something like 16Gb / 4 vCPU / 100 GB
  • Deployment: Are you using Docker or Kubernetes deployment? DOCKER
  • Airbyte Version: What version are you using now?
  • Source name/version: -
  • Destination name/version: -
  • Step: The issue is happening during sync, creating the connection or a new source? DEPLOY
  • Description: I update the docker-compose.yaml and .env file to 0.40.1 and now I can’t access airbyte anymore.
$ docker-compose down
WARNING: The RUN_DATABASE_MIGRATION_ON_STARTUP variable is not set. Defaulting to a blank string.
WARNING: The DEPLOYMENT_MODE variable is not set. Defaulting to a blank string.
WARNING: The SECRET_PERSISTENCE variable is not set. Defaulting to a blank string.
WARNING: The WORKER_ENVIRONMENT variable is not set. Defaulting to a blank string.
WARNING: The JOB_ERROR_REPORTING_SENTRY_DSN variable is not set. Defaulting to a blank string.
WARNING: The NEW_SCHEDULER variable is not set. Defaulting to a blank string.
Stopping airbyte-webapp   ... done
Stopping airbyte-db       ... done
Stopping airbyte-cron     ... done
Stopping airbyte-worker   ... done
Stopping airbyte-server   ... done
Stopping airbyte-temporal ... done
WARNING: Found orphan containers (airbyte-scheduler) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up.
Removing airbyte-webapp     ... done
Removing airbyte-db         ... done
Removing airbyte-cron       ... done
Removing airbyte-worker     ... done
Removing airbyte-bootloader ... done
Removing init               ... done
Removing airbyte-server     ... done
Removing airbyte-temporal   ... done
Removing network airbyte_default
ERROR: error while removing network: network airbyte_default id ed83db0c8828e5218993e3f92ebf880ddb2b29850bc4222bac166a361025f5aa has active endpoints

$ docker-compose up -d
WARNING: The RUN_DATABASE_MIGRATION_ON_STARTUP variable is not set. Defaulting to a blank string.
WARNING: The DEPLOYMENT_MODE variable is not set. Defaulting to a blank string.
WARNING: The SECRET_PERSISTENCE variable is not set. Defaulting to a blank string.
WARNING: The WORKER_ENVIRONMENT variable is not set. Defaulting to a blank string.
WARNING: The JOB_ERROR_REPORTING_SENTRY_DSN variable is not set. Defaulting to a blank string.
WARNING: The NEW_SCHEDULER variable is not set. Defaulting to a blank string.
WARNING: Found orphan containers (airbyte-scheduler) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up.
Creating airbyte-db         ... done
Creating airbyte-cron       ... done
Creating init               ... done
Creating airbyte-webapp     ... done
Creating airbyte-bootloader ... done
Creating airbyte-temporal   ... done
Creating airbyte-worker     ... done
Creating airbyte-server     ... done
2

$ docker logs airbyte-server

2022-08-24 18:30:17 WARN i.a.d.c.DatabaseAvailabilityCheck(check):38 - Waiting for database to become available...
2022-08-24 18:30:17 INFO i.a.d.c.DatabaseAvailabilityCheck(lambda$isDatabaseConnected$1):75 - Testing airbyte configs database connection...
2022-08-24 18:30:18 INFO i.a.d.c.DatabaseAvailabilityCheck(check):57 - Database available.
2022-08-24 18:30:18 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
2022-08-24 18:30:18 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Database: jdbc:postgresql://db:5432/airbyte (PostgreSQL 13.8)
2022-08-24 18:30:18 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
2022-08-24 18:30:18 INFO i.a.d.c.DatabaseMigrationCheck(check):46 - Current database migration version 0.29.0.001.
2022-08-24 18:30:18 INFO i.a.d.c.DatabaseMigrationCheck(check):47 - Minimum Flyway version required 0.35.15.001.
2022-08-24 18:30:24 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
2022-08-24 18:30:24 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
2022-08-24 18:30:30 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
2022-08-24 18:30:30 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
2022-08-24 18:30:36 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
2022-08-24 18:30:36 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
2022-08-24 18:30:42 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
2022-08-24 18:30:42 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
2022-08-24 18:30:48 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
2022-08-24 18:30:48 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
2022-08-24 18:30:54 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
2022-08-24 18:30:54 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
2022-08-24 18:31:00 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
2022-08-24 18:31:00 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
2022-08-24 18:31:06 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
2022-08-24 18:31:06 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
2022-08-24 18:31:12 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
2022-08-24 18:31:12 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
2022-08-24 18:31:18 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
2022-08-24 18:31:18 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
2022-08-24 18:31:18 ERROR i.a.s.ServerApp(main):307 - Server failed
io.airbyte.db.check.DatabaseCheckException: Timeout while waiting for database to fulfill minimum flyway migration version..
	at io.airbyte.db.check.DatabaseMigrationCheck.check(DatabaseMigrationCheck.java:51) ~[io.airbyte.airbyte-db-db-lib-0.40.1.jar:?]
	at io.airbyte.server.ServerApp.assertDatabasesReady(ServerApp.java:148) ~[io.airbyte-airbyte-server-0.40.1.jar:?]
	at io.airbyte.server.ServerApp.getServer(ServerApp.java:169) ~[io.airbyte-airbyte-server-0.40.1.jar:?]
	at io.airbyte.server.ServerApp.main(ServerApp.java:304) [io.airbyte-airbyte-server-0.40.1.jar:?]
2022-08-24 18:31:18 INFO c.z.h.HikariDataSource(close):350 - HikariPool-1 - Shutdown initiated...
2022-08-24 18:31:18 INFO c.z.h.HikariDataSource(close):352 - HikariPool-1 - Shutdown completed.
2022-08-24 18:31:18 INFO c.z.h.HikariDataSource(close):350 - HikariPool-2 - Shutdown initiated...
2022-08-24 18:31:18 INFO c.z.h.HikariDataSource(close):352 - HikariPool-2 - Shutdown completed.
3

@pha_andrade thanks for your post. Could you try upgrading to the latest version again?

instructions are available in our documentation: https://docs.airbyte.com/operator-guides/upgrading-airbyte/#upgrading-on-docker

Let me know if it helps.