Summary
User successfully installed Airbyte 1.2.0 on a Linux VM using abctl, but is unable to create sources or destinations. Logs indicate version mismatches and null pointer exceptions related to workspace IDs.
Question
Hello everyone,
I’m trying to install Airbyte 1.2.0 on a Linux VM using abctl
.
The installation appears successful, and Airbyte is running without any error logs from the pods. The PostgreSQL database seems properly set up, with all the expected schemas and tables created. The only record I’ve seen added so far is the one for the workspace.
global:
env_vars:
HTTP_PROXY: "<http://10.0.0.0:10>"
HTTPS_PROXY: "<http://10.0.0.0:10>"
NO_PROXY: "10.0.0.0/8,localhost,127.0.0.1,.domain.fr,.cluster.local,.local,.svc,airbyte-*"
http_proxy: "<http://10.0.0.0:10>"
https_proxy: "<http://10.0.0.0:10>"
no_proxy: "10.0.0.0/8,localhost,127.0.0.1,.domain.fr,.cluster.local,.local,.svc,airbyte-*"
JAVA_TOOL_OPTIONS: "-Dhttp.proxyHost=10.0.0.0 -Dhttp.proxyPort=10 -Dhttps.proxyHost=10.0.0.0 -Dhttps.proxyPort=10 -Dhttp.nonProxyHosts=10.*|localhost|127.0.0.1|*.internal|*.cluster.local|*.local|*.svc|airbyte-*"
webapp:
image:
repository: registry/airbyte-webapp-no-ipv6
tag: 1.2.0```
```abctl local install -v --values=./values.yaml --host=domain.fr --port=8080 --insecure-cookies --no-browser --low-resource-mode```
However, I’m unable to create any sources or destinations.
server pod logs :
```2024-11-30 16:54:08,745 [main] WARN o.j.t.JooqLogger(lambda$warn$7):461 - Version mismatch : Database version is older than what dialect POSTGRES supports: 13.16. Consider <https://www.jooq.org/download/support-matrix> to see what jOOQ version and edition supports which RDBMS versions.
2024-11-30 16:54:08,829 [main] INFO i.a.d.c.DatabaseAvailabilityCheck(check):57 - Database available.
2024-11-30 16:54:09,021 [main] INFO o.f.c.i.l.s.Slf4jLog(info):37 - Database: jdbc:<postgresql://airbyte-db-svc:5432/db-airbyte> (PostgreSQL 13.16)
2024-11-30 16:54:09,497 [main] INFO i.a.d.c.DatabaseMigrationCheck(check):46 - Current database migration version 1.1.0.005.
2024-11-30 16:54:09,502 [main] INFO i.a.d.c.DatabaseMigrationCheck(check):47 - Minimum Flyway version required 0.35.15.001.
2024-11-30 16:54:09,503 [main] INFO i.a.d.c.DatabaseMigrationCheck(check):62 - Verified that database has been migrated to the required minimum version 0.35.15.001.
2024-11-30 16:54:09,503 [main] INFO i.a.s.DatabaseEventListener(onApplicationEvent):45 - Checking jobs database flyway migration version...
2024-11-30 16:54:09,504 [main] WARN i.a.d.c.DatabaseAvailabilityCheck(check):38 - Waiting for database to become available...
2024-11-30 16:54:09,504 [main] INFO i.a.d.c.DatabaseAvailabilityCheck(lambda$isDatabaseConnected$1):75 - Testing airbyte jobs database connection...
2024-11-30 16:54:09,512 [main] INFO i.a.d.c.DatabaseAvailabilityCheck(check):57 - Database available.
2024-11-30 16:54:09,575 [main] INFO o.f.c.i.l.s.Slf4jLog(info):37 - Database: jdbc:<postgresql://airbyte-db-svc:5432/db-airbyte> (PostgreSQL 13.16)
2024-11-30 16:54:09,706 [main] INFO i.a.d.c.DatabaseMigrationCheck(check):46 - Current database migration version 1.1.0.000.
2024-11-30 16:54:09,707 [main] INFO i.a.d.c.DatabaseMigrationCheck(check):47 - Minimum Flyway version required 0.40.26.001.
2024-11-30 16:54:09,707 [main] INFO i.a.d.c.DatabaseMigrationCheck(check):62 - Verified that database has been migrated to the required minimum version 0.40.26.001.
2024-11-30 16:54:09,716 [main] INFO i.m.r.Micronaut(start):101 - Startup completed in 23600ms. Server Running: <http://airbyte-abctl-server-7ff674575f-zzgz5:8001>
2024-11-30 19:44:19,448 [io-executor-thread-6] INFO i.a.c.s.RemoteDefinitionsProvider(getRemoteConnectorRegistry):199 - Fetched latest remote definitions (-253858662)
2024-11-30 19:44:32,294 [io-executor-thread-2] WARN i.a.c.s.c.JobConverter(getWorkspaceId):403 - Unable to retrieve workspace ID for job null.
java.lang.NullPointerException: null
at com.google.common.base.Preconditions.checkNotNull(Preconditions.java:904)
at com.google.common.cache.LocalCache.get(LocalCache.java:4016)
at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4040)
at com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4989)
at io.airbyte.persistence.job.WorkspaceHelper.lambda$getWorkspaceForJobId$4(WorkspaceHelper.java:162)
at io.airbyte.persistence.job.WorkspaceHelper.handleCacheExceptions(WorkspaceHelper.java:231)
at io.airbyte.persistence.job.WorkspaceHelper.getWorkspaceForJobId(WorkspaceHelper.java:162)
at io.airbyte.commons.server.converters.JobConverter.getWorkspaceId(JobConverter.java:401)
at io.airbyte.commons.server.converters.JobConverter.getAttemptLogs(JobConverter.java:320)
at io.airbyte.commons.server.converters.JobConverter.getSynchronousJobRead(JobConverter.java:349)
at io.airbyte.commons.server.handlers.ConnectorDefinitionSpecificationHandler.getSourceSpecificationRead(ConnectorDefinitionSpecificationHandler.java:145)
at io.airbyte.commons.server.handlers.ConnectorDefinitionSpecificationHandler.getSourceDefinitionSpecification(ConnectorDefinitionSpecificationHandler.java:96)
at io.airbyte.server.apis.SourceDefinitionSpecificationApiController.lambda$getSourceDefinitionSpecification$0(SourceDefinitionSpecificationApiController.java:38)
at io.airbyte.server.apis.ApiHelper.execute(ApiHelper.kt:29)
at io.airbyte.server.apis.SourceDefinitionSpecificationApiController.getSourceDefinitionSpecification(SourceDefinitionSpecificationApiController.java:38)
at io.airbyte.server.apis.$SourceDefinitionSpecificationApiController$Definition$Exec.dispatch(Unknown Source)
at io.micronaut.context.AbstractExecutableMethodsDefinition$DispatchedExecutableMethod.invokeUnsafe(AbstractExecutableMethodsDefinition.java:461)
at io.micronaut.context.DefaultBeanContext$BeanContextUnsafeExecutionHandle.invokeUnsafe(DefaultBeanContext.java:4350)
at io.micronaut.web.router.AbstractRouteMatch.execute(AbstractRouteMatch.java:272)
at io.micronaut.web.router.DefaultUriRouteMatch.execute(DefaultUriRouteMatch.java:38)
at io.micronaut.http.server.RouteExecutor.executeRouteAndConvertBody(RouteExecutor.java:498)
at io.micronaut.http.server.RouteExecutor.lambda$callRoute$5(RouteExecutor.java:475)
at io.micronaut.core.execution.ExecutionFlow.lambda$async$1(ExecutionFlow.java:87)
at io.micronaut.core.propagation.PropagatedContext.lambda$wrap$3(PropagatedContext.java:211)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
at java.base/java.lang.Thread.run(Thread.java:1583)```
Has anyone encountered this issue before or have any insights on what might be causing this?
Thank you in advance for your help!
<br>
---
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C021JANJ6TY/p1733008277452879) if you want
to access the original thread.
[Join the conversation on Slack](https://slack.airbyte.com)
<sub>
['airbyte', 'installation', 'abctl', 'postgresql', 'database-issues', 'null-pointer-exception']
</sub>