Summary
The user encountered a 500 error when trying to use a custom docker connector in the Airbyte dashboard. The logs show an ‘IllegalStateException: Get Spec job failed’ error.
Question
Hi everyone, I used python-cdk to make a custom-connector and after I make a docker image and in the Airbyte dashboard I wanted to use the docker image name, I got 500 error and the logs of docker airbyte server is like the below:
2024-08-08 15:08:34 ERROR i.a.s.a.ApiHelper(execute):49 - Unexpected Exception
java.lang.IllegalStateException: Get Spec job failed.
at com.google.common.base.Preconditions.checkState(Preconditions.java:515) ~[guava-33.2.0-jre.jar:?]
at io.airbyte.commons.server.converters.SpecFetcher.getSpecFromJob(SpecFetcher.java:17) ~[io.airbyte-airbyte-commons-server-0.63.8.jar:?]
at io.airbyte.commons.server.handlers.helpers.ActorDefinitionHandlerHelper.getSpecForImage(ActorDefinitionHandlerHelper.java:162) ~[io.airbyte-airbyte-commons-server-0.63.8.jar:?]
at io.airbyte.commons.server.handlers.helpers.ActorDefinitionHandlerHelper.defaultDefinitionVersionFromCreate(ActorDefinitionHandlerHelper.java:79) ~[io.airbyte-airbyte-commons-server-0.63.8.jar:?]
at io.airbyte.commons.server.handlers.SourceDefinitionsHandler.createCustomSourceDefinition(SourceDefinitionsHandler.java:254) ~[io.airbyte-airbyte-commons-server-0.63.8.jar:?]
at io.airbyte.server.apis.SourceDefinitionApiController.lambda$createCustomSourceDefinition$0(SourceDefinitionApiController.java:65) ~[io.airbyte-airbyte-server-0.63.8.jar:?]
at io.airbyte.server.apis.ApiHelper.execute(ApiHelper.java:28) ~[io.airbyte-airbyte-server-0.63.8.jar:?]
at io.airbyte.server.apis.SourceDefinitionApiController.createCustomSourceDefinition(SourceDefinitionApiController.java:65) ~[io.airbyte-airbyte-server-0.63.8.jar:?]
at io.airbyte.server.apis.$SourceDefinitionApiController$Definition$Exec.dispatch(Unknown Source) ~[io.airbyte-airbyte-server-0.63.8.jar:?]
at io.micronaut.context.AbstractExecutableMethodsDefinition$DispatchedExecutableMethod.invokeUnsafe(AbstractExecutableMethodsDefinition.java:461) ~[micronaut-inject-4.5.3.jar:4.5.3]
at io.micronaut.context.DefaultBeanContext$BeanContextUnsafeExecutionHandle.invokeUnsafe(DefaultBeanContext.java:4325) ~[micronaut-inject-4.5.3.jar:4.5.3]
at io.micronaut.web.router.AbstractRouteMatch.execute(AbstractRouteMatch.java:271) ~[micronaut-router-4.5.3.jar:4.5.3]
at io.micronaut.web.router.DefaultUriRouteMatch.execute(DefaultUriRouteMatch.java:39) ~[micronaut-router-4.5.3.jar:4.5.3]
at io.micronaut.http.server.RouteExecutor.executeRouteAndConvertBody(RouteExecutor.java:490) ~[micronaut-http-server-4.5.3.jar:4.5.3]
at io.micronaut.http.server.RouteExecutor.lambda$callRoute$6(RouteExecutor.java:467) ~[micronaut-http-server-4.5.3.jar:4.5.3]
at io.micronaut.core.execution.ExecutionFlow.lambda$async$1(ExecutionFlow.java:87) ~[micronaut-core-4.5.3.jar:4.5.3]
at io.micronaut.core.propagation.PropagatedContext.lambda$wrap$3(PropagatedContext.java:211) ~[micronaut-core-4.5.3.jar:4.5.3]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
at java.base/java.lang.Thread.run(Thread.java:1583) [?:?]
2024-08-08 15:08:34 ERROR i.a.c.s.e.h.UncaughtExceptionHandler(handle):31 - Uncaught exception
java.lang.IllegalStateException: Get Spec job failed.
at com.google.common.base.Preconditions.checkState(Preconditions.java:515) ~[guava-33.2.0-jre.jar:?]
at io.airbyte.commons.server.converters.SpecFetcher.getSpecFromJob(SpecFetcher.java:17) ~[io.airbyte-airbyte-commons-server-0.63.8.jar:?]
at io.airbyte.commons.server.handlers.helpers.ActorDefinitionHandlerHelper.getSpecForImage(ActorDefinitionHandlerHelper.java:162) ~[io.airbyte-airbyte-commons-server-0.63.8.jar:?]
at io.airbyte.commons.server.handlers.helpers.ActorDefinitionHandlerHelper.defaultDefinitionVersionFromCreate(ActorDefinitionHandlerHelper.java:79) ~[io.airbyte-airbyte-commons-server-0.63.8.jar:?]
at io.airbyte.commons.server.handlers.SourceDefinitionsHandler.createCustomSourceDefinition(SourceDefinitionsHandler.java:254) ~[io.airbyte-airbyte-commons-server-0.63.8.jar:?]
at io.airbyte.server.apis.SourceDefinitionApiController.lambda$createCustomSourceDefinition$0(SourceDefinitionApiController.java:65) ~[io.airbyte-airbyte-server-0.63.8.jar:?]
at io.airbyte.server.apis.ApiHelper.execute(ApiHelper.java:28) ~[io.airbyte-airbyte-server-0.63.8.jar:?]
at io.airbyte.server.apis.SourceDefinitionApiController.createCustomSourceDefinition(SourceDefinitionApiController.java:65) ~[io.airbyte-airbyte-server-0.63.8.jar:?]
at io.airbyte.server.apis.$SourceDefinitionApiController$Definition$Exec.dispatch(Unknown Source) ~[io.airbyte-airbyte-server-0.63.8.jar:?]
at io.micronaut.context.AbstractExecutableMethodsDefinition$DispatchedExecutableMethod.invokeUnsafe(AbstractExecutableMethodsDefinition.java:461) ~[micronaut-inject-4.5.3.jar:4.5.3]
at io.micronaut.context.DefaultBeanContext$BeanContextUnsafeExecutionHandle.invokeUnsafe(DefaultBeanContext.java:4325) ~[micronaut-inject-4.5.3.jar:4.5.3]
at io.micronaut.web.router.AbstractRouteMatch.execute(AbstractRouteMatch.java:271) ~[micronaut-router-4.5.3.jar:4.5.3]
at io.micronaut.web.router.DefaultUriRouteMatch.execute(DefaultUriRouteMatch.java:39) ~[micronaut-router-4.5.3.jar:4.5.3]
at io.micronaut.http.server.RouteExecutor.executeRouteAndConvertBody(RouteExecutor.java:490) ~[micronaut-http-server-4.5.3.jar:4.5.3]
at io.micronaut.http.server.RouteExecutor.lambda$callRoute$6(RouteExecutor.java:467) ~[micronaut-http-server-4.5.3.jar:4.5.3]
at io.micronaut.core.execution.ExecutionFlow.lambda$async$1(ExecutionFlow.java:87) ~[micronaut-core-4.5.3.jar:4.5.3]
at io.micronaut.core.propagation.PropagatedContext.lambda$wrap$3(PropagatedContext.java:211) ~[micronaut-core-4.5.3.jar:4.5.3]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
at java.base/java.lang.Thread.run(Thread.java:1583) [?:?]
do you have any idea how can I use the “add a new docker connector” in airbyte? Thanks
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.