Error installing Airbyte using run-ab-platform.sh

Summary

Error encountered while starting Micronaut server during Airbyte installation on Debian 12 using run-ab-platform.sh script.


Question

Hi everyone !
I’m trying to install airbyte using the run-ab-platform.sh. But unfortunatly I have this error :
airbyte-worker | 2024-09-24 09:06:45 ERROR i.m.r.Micronaut(handleStartupException):349 - Error starting Micronaut server: Error instantiating bean of type [io.airbyte.workers.temporal.check.connection.CheckConnectionActivityImpl]
I’ve seen that there are some tickets and messages about it but didn’t see any solution :confused:
It’s a vanilla install on a debian 12
Docker version 27.0.3, build 7d4bcd8



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["error", "install", "airbyte", "run-ab-platform.sh", "micronaut", "debian-12", "docker"]
  1. How much memory do you have on that machine with debian 12?
  2. Have you tried Airbyte installation with abctl?

I can’t sue kube on this machine. It’s managed by our provider :confused:
I have 11Go available

It looks like the airbyte-server is crashing in a loop.

Due to the micronaut server

Do you have more details about error?
By default there is LOG_LEVEL=INFO in .env, can you change it to LOG_LEVEL=DEBUG and restart Airbyte?

airbyte-worker                    |
airbyte-worker                    | Message: /flags (Permission denied)
airbyte-worker                    | Path Taken: new ApplicationInitializer() --> ApplicationInitializer.checkConnectionActivities --> ActivityBeanFactory.checkConnectionActivities([CheckConnectionActivity checkConnectionActivity]) --> new CheckConnectionActivityImpl(WorkerConfigsProvider workerConfigsProvider,ProcessFactory processFactory,SecretsRepositoryReader secretsRepositoryReader,Path workspaceRoot,WorkerEnvironment workerEnvironment,LogConfigs logConfigs,AirbyteApiClient airbyteApiClient,String airbyteVersion,AirbyteMessageSerDeProvider serDeProvider,AirbyteProtocolVersionedMigratorFactory migratorFactory,FeatureFlags featureFlags,[FeatureFlagClient featureFlagClient],GsonPksExtractor gsonPksExtractor,WorkloadClient workloadClient,WorkloadIdGenerator workloadIdGenerator,MetricClient metricClient,ActivityOptions activityOptions)
airbyte-worker                    | io.micronaut.context.exceptions.BeanInstantiationException: Error instantiating bean of type  [io.airbyte.workers.temporal.check.connection.CheckConnectionActivityImpl]
airbyte-worker                    |
airbyte-worker                    | Message: /flags (Permission denied)
airbyte-worker                    | Path Taken: new ApplicationInitializer() --> ApplicationInitializer.checkConnectionActivities --> ActivityBeanFactory.checkConnectionActivities([CheckConnectionActivity checkConnectionActivity]) --> new CheckConnectionActivityImpl(WorkerConfigsProvider workerConfigsProvider,ProcessFactory processFactory,SecretsRepositoryReader secretsRepositoryReader,Path workspaceRoot,WorkerEnvironment workerEnvironment,LogConfigs logConfigs,AirbyteApiClient airbyteApiClient,String airbyteVersion,AirbyteMessageSerDeProvider serDeProvider,AirbyteProtocolVersionedMigratorFactory migratorFactory,FeatureFlags featureFlags,[FeatureFlagClient featureFlagClient],GsonPksExtractor gsonPksExtractor,WorkloadClient workloadClient,WorkloadIdGenerator workloadIdGenerator,MetricClient metricClient,ActivityOptions activityOptions)
airbyte-worker                    | 	at io.micronaut.context.DefaultBeanContext.resolveByBeanFactory(DefaultBeanContext.java:2343) ~[micronaut-inject-4.5.4.jar:4.5.4]
airbyte-worker                    | 	at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2298) ~[micronaut-inject-4.5.4.jar:4.5.4]
airbyte-worker                    | 	at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2310) ~[micronaut-inject-4.5.4.jar:4.5.4]
airbyte-worker                    | 	at io.micronaut.context.DefaultBeanContext.createRegistration(DefaultBeanContext.java:3120) ~[micronaut-inject-4.5.4.jar:4.5.4]
airbyte-worker                    | 	at io.micronaut.context.SingletonScope.getOrCreate(SingletonScope.java:80) ~[micronaut-inject-4.5.4.jar:4.5.4]
airbyte-worker                    | 	at io.micronaut.context.DefaultBeanContext.findOrCreateSingletonBeanRegistration(DefaultBeanContext.java:3022) ~[micronaut-inject-4.5.4.jar:4.5.4]
airbyte-worker                    | 	at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2983) ~[micronaut-inject-4.5.4.jar:4.5.4]
airbyte-worker                    | 	at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2749) ~[micronaut-inject-4.5.4.jar:4.5.4]
airbyte-worker                    | 	at io.micronaut.context.DefaultBeanContext.getBean(DefaultBeanContext.java:1748) ~[micronaut-inject-4.5.4.jar:4.5.4]
airbyte-worker                    | 	at io.micronaut.context.AbstractBeanResolutionContext.getBean(AbstractBeanResolutionContext.java:89) ~[micronaut-inject-4.5.4.jar:4.5.4]
airbyte-worker                    | 	at io.micronaut.context.AbstractInitializableBeanDefinition.resolveBean(AbstractInitializableBeanDefinition.java:2188) ~[micronaut-inject-4.5.4.jar:4.5.4]
airbyte-worker                    | 	at io.micronaut.context.AbstractInitializableBeanDefinition.getBeanForConstructorArgument(AbstractInitializableBeanDefinition.java:1350) ~[micronaut-inject-4.5.4.jar:4.5.4]```

Same as here I think : https://github.com/airbytehq/airbyte/issues/32450

Have you changed anything in .env or this happens right after running ./run-ab-platform.sh?

No, it’s the vanilla install

With a fresh git pull

In the last comment of the previous ticket, it says that adding SECRET_PERSISTENCE=TESTING_CONFIG_DB_TABLE to the .env solves the problem for him, but it already is in my .env

https://github.com/search?q=org%3Aairbytehq+"%24{FEATURE_FLAG_PATH%3A%2Fflags}"&type=code
just an experiment,
can you try to set FEATURE_FLAG_PATH=/featureflags in environment for worker and server in docker-compose.yaml ?

it looks like it cannot register under /flags because path is taken

airbyte-worker                    |
airbyte-worker                    | Message: /flags (Permission denied)
airbyte-worker                    | Path Taken: new ApplicationInitializer() --> ApplicationInitializer.checkConnectionActivities --> ActivityBeanFactory.checkConnectionActivities([CheckConnectionActivity checkConnectionActivity]) --> new CheckConnectionActivityImpl(WorkerConfigsProvider workerConfigsProvider,ProcessFactory processFactory,SecretsRepositoryReader secretsRepositoryReader,Path workspaceRoot,WorkerEnvironment workerEnvironment,LogConfigs logConfigs,AirbyteApiClient airbyteApiClient,String airbyteVersion,AirbyteMessageSerDeProvider serDeProvider,AirbyteProtocolVersionedMigratorFactory migratorFactory,FeatureFlags featureFlags,[FeatureFlagClient featureFlagClient],GsonPksExtractor gsonPksExtractor,WorkloadClient workloadClient,WorkloadIdGenerator workloadIdGenerator,MetricClient metricClient,ActivityOptions activityOptions)
airbyte-worker                    | io.micronaut.context.exceptions.BeanInstantiationException: Error instantiating bean of type  [io.airbyte.workers.temporal.check.connection.CheckConnectionActivityImpl]
airbyte-worker                    |
airbyte-worker                    | Message: /flags (Permission denied)
airbyte-worker                    | Path Taken: new ApplicationInitializer() --> ApplicationInitializer.checkConnectionActivities --> ActivityBeanFactory.checkConnectionActivities([CheckConnectionActivity checkConnectionActivity]) --> new CheckConnectionActivityImpl(WorkerConfigsProvider workerConfigsProvider,ProcessFactory processFactory,SecretsRepositoryReader secretsRepositoryReader,Path workspaceRoot,WorkerEnvironment workerEnvironment,LogConfigs logConfigs,AirbyteApiClient airbyteApiClient,String airbyteVersion,AirbyteMessageSerDeProvider serDeProvider,AirbyteProtocolVersionedMigratorFactory migratorFactory,FeatureFlags featureFlags,[FeatureFlagClient featureFlagClient],GsonPksExtractor gsonPksExtractor,WorkloadClient workloadClient,WorkloadIdGenerator workloadIdGenerator,MetricClient metricClient,ActivityOptions activityOptions)
airbyte-worker                    | 	at io.micronaut.context.DefaultBeanContext.resolveByBeanFactory(DefaultBeanContext.java:2343) ~[micronaut-inject-4.5.4.jar:4.5.4]
airbyte-worker                    | 	at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2298) ~[micronaut-inject-4.5.4.jar:4.5.4]
airbyte-worker                    | 	at io.micronaut.context.DefaultBeanContext.doCreateBean(DefaultBeanContext.java:2310) ~[micronaut-inject-4.5.4.jar:4.5.4]
airbyte-worker                    | 	at io.micronaut.context.DefaultBeanContext.createRegistration(DefaultBeanContext.java:3120) ~[micronaut-inject-4.5.4.jar:4.5.4]
airbyte-worker                    | 	at io.micronaut.context.SingletonScope.getOrCreate(SingletonScope.java:80) ~[micronaut-inject-4.5.4.jar:4.5.4]
airbyte-worker                    | 	at io.micronaut.context.DefaultBeanContext.findOrCreateSingletonBeanRegistration(DefaultBeanContext.java:3022) ~[micronaut-inject-4.5.4.jar:4.5.4]
airbyte-worker                    | 	at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2983) ~[micronaut-inject-4.5.4.jar:4.5.4]
airbyte-worker                    | 	at io.micronaut.context.DefaultBeanContext.resolveBeanRegistration(DefaultBeanContext.java:2749) ~[micronaut-inject-4.5.4.jar:4.5.4]
airbyte-worker                    | 	at io.micronaut.context.DefaultBeanContext.getBean(DefaultBeanContext.java:1748) ~[micronaut-inject-4.5.4.jar:4.5.4]
airbyte-worker                    | 	at io.micronaut.context.AbstractBeanResolutionContext.getBean(AbstractBeanResolutionContext.java:89) ~[micronaut-inject-4.5.4.jar:4.5.4]
airbyte-worker                    | 	at io.micronaut.context.AbstractInitializableBeanDefinition.resolveBean(AbstractInitializableBeanDefinition.java:2188) ~[micronaut-inject-4.5.4.jar:4.5.4]
airbyte-worker                    | 	at io.micronaut.context.AbstractInitializableBeanDefinition.getBeanForConstructorArgument(AbstractInitializableBeanDefinition.java:1350) ~[micronaut-inject-4.5.4.jar:4.5.4]```

Doesn’t change the result

abctl runs kind cluster (https://kind.sigs.k8s.io/) on Docker. This is not allowed by your provider?

Worth trying at least. Let me try

Problem is that it needs root access