Failed to fetch schema. Please try again: ERROR: value too long for type character varying(32)

  • Is this your first time deploying Airbyte?: No
  • OS Version / Instance: Ubuntu, Windows or MacOS… are some example remove it with yours
  • Memory / Disk: you can use something like 8Gb / 1 Tb
  • Deployment: Kubernetes
  • Airbyte Version: 0.35.65-alpha
  • Source name/version: New custom source
  • Destination name/version: Snowflake
  • Step: creating the connection
  • Description: Failed to fetch schema. Please try again
    Please see below the response for api/v1/sources/discover_schema
HTTP/1.1 500 Internal Server Error
Date: Thu, 14 Jul 2022 14:03:43 GMT
Content-Type: application/json
Transfer-Encoding: chunked
Connection: close
Server: nginx/1.19.10
Access-Control-Allow-Origin: *
Access-Control-Allow-Headers: Origin, Content-Type, Accept, Content-Encoding
Access-Control-Allow-Methods: GET, POST, PUT, DELETE, OPTIONS, HEAD

{
  "message": "Internal Server Error: SQL [insert into \"public\".\"actor_catalog_fetch_event\" (\"id\", \"actor_id\", \"actor_catalog_id\", \"config_hash\", \"actor_version\", \"modified_at\", \"created_at\") values (cast(? as uuid), cast(? as uuid), cast(? as uuid), ?, ?, cast(? as timestamp with time zone), cast(? as timestamp with time zone))]; ERROR: value too long for type character varying(32)",
  "exceptionClassName": "org.jooq.exception.DataAccessException",
  "exceptionStack": [
    "org.jooq.exception.DataAccessException: SQL [insert into \"public\".\"actor_catalog_fetch_event\" (\"id\", \"actor_id\", \"actor_catalog_id\", \"config_hash\", \"actor_version\", \"modified_at\", \"created_at\") values (cast(? as uuid), cast(? as uuid), cast(? as uuid), ?, ?, cast(? as timestamp with time zone), cast(? as timestamp with time zone))]; ERROR: value too long for type character varying(32)",
    "\tat org.jooq_3.13.4.POSTGRES.debug(Unknown Source)",
    "\tat org.jooq.impl.Tools.translate(Tools.java:2753)",
    "\tat org.jooq.impl.DefaultExecuteContext.sqlException(DefaultExecuteContext.java:755)",
    "\tat org.jooq.impl.AbstractQuery.execute(AbstractQuery.java:385)",
    "\tat org.jooq.impl.AbstractDelegatingQuery.execute(AbstractDelegatingQuery.java:119)",
    "\tat io.airbyte.config.persistence.ConfigRepository.lambda$writeActorCatalogFetchEvent$22(ConfigRepository.java:899)",
    "\tat io.airbyte.db.Database.lambda$transaction$0(Database.java:31)",
    "\tat org.jooq.impl.DefaultDSLContext.lambda$transactionResult0$0(DefaultDSLContext.java:564)",
    "\tat org.jooq.impl.Tools$12$1.block(Tools.java:4926)",
    "\tat java.base/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463)",
    "\tat java.base/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434)",
    "\tat org.jooq.impl.Tools$12.get(Tools.java:4923)",
    "\tat org.jooq.impl.DefaultDSLContext.transactionResult0(DefaultDSLContext.java:616)",
    "\tat org.jooq.impl.DefaultDSLContext.transactionResult(DefaultDSLContext.java:533)",
    "\tat io.airbyte.db.Database.transaction(Database.java:31)",
    "\tat io.airbyte.db.ExceptionWrappingDatabase.transaction(ExceptionWrappingDatabase.java:31)",
    "\tat io.airbyte.config.persistence.ConfigRepository.writeActorCatalogFetchEvent(ConfigRepository.java:890)",
    "\tat io.airbyte.server.handlers.SchedulerHandler.discoverSchemaForSourceFromSourceId(SchedulerHandler.java:269)",
    "\tat io.airbyte.server.apis.ConfigurationApi.lambda$discoverSchemaForSource$36(ConfigurationApi.java:498)",
    "\tat io.airbyte.server.apis.ConfigurationApi.execute(ConfigurationApi.java:871)",
    "\tat io.airbyte.server.apis.ConfigurationApi.discoverSchemaForSource(ConfigurationApi.java:498)",
    "\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)",
    "\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)",
    "\tat java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)",
    "\tat java.base/java.lang.reflect.Method.invoke(Method.java:568)",
    "\tat org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:52)",
    "\tat org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:124)",
    "\tat org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:167)",
    "\tat org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:219)",
    "\tat org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:79)",
    "\tat org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:469)",
    "\tat org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:391)",
    "\tat org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:80)",
    "\tat org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253)",
    "\tat org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)",
    "\tat org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)",
    "\tat org.glassfish.jersey.internal.Errors.process(Errors.java:292)",
    "\tat org.glassfish.jersey.internal.Errors.process(Errors.java:274)",
    "\tat org.glassfish.jersey.internal.Errors.process(Errors.java:244)",
    "\tat org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265)",
    "\tat org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:232)",
    "\tat org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:680)",
    "\tat org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:394)",
    "\tat org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:346)",
    "\tat org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:366)",
    "\tat org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:319)",
    "\tat org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:205)",
    "\tat org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763)",
    "\tat org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:569)",
    "\tat org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)",
    "\tat org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377)",
    "\tat org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)",
    "\tat org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507)",
    "\tat org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)",
    "\tat org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292)",
    "\tat org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)",
    "\tat org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)",
    "\tat org.eclipse.jetty.server.Server.handle(Server.java:501)",
    "\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)",
    "\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556)",
    "\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)",
    "\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)",
    "\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)",
    "\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)",
    "\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)",
    "\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336)",
    "\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313)",
    "\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171)",
    "\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129)",
    "\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375)",
    "\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)",
    "\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)",
    "\tat java.base/java.lang.Thread.run(Thread.java:833)",
    "Caused by: org.postgresql.util.PSQLException: ERROR: value too long for type character varying(32)",
    "\tat org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2674)",
    "\tat org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2364)",
    "\tat org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:354)",
    "\tat org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:484)",
    "\tat org.postgresql.jdbc.PgStatement.execute(PgStatement.java:404)",
    "\tat org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:162)",
    "\tat org.postgresql.jdbc.PgPreparedStatement.execute(PgPreparedStatement.java:151)",
    "\tat org.apache.commons.dbcp2.DelegatingPreparedStatement.execute(DelegatingPreparedStatement.java:94)",
    "\tat org.apache.commons.dbcp2.DelegatingPreparedStatement.execute(DelegatingPreparedStatement.java:94)",
    "\tat org.jooq.tools.jdbc.DefaultPreparedStatement.execute(DefaultPreparedStatement.java:209)",
    "\tat org.jooq.impl.AbstractQuery.execute(AbstractQuery.java:453)",
    "\tat org.jooq.impl.AbstractDMLQuery.execute(AbstractDMLQuery.java:904)",
    "\tat org.jooq.impl.AbstractQuery.execute(AbstractQuery.java:371)",
    "\t... 69 more"
  ],
  "rootCauseExceptionClassName": "java.lang.Class",
  "rootCauseExceptionStack": [
    "org.postgresql.util.PSQLException: ERROR: value too long for type character varying(32)",
    "\tat org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2674)",
    "\tat org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2364)",
    "\tat org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:354)",
    "\tat org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:484)",
    "\tat org.postgresql.jdbc.PgStatement.execute(PgStatement.java:404)",
    "\tat org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:162)",
    "\tat org.postgresql.jdbc.PgPreparedStatement.execute(PgPreparedStatement.java:151)",
    "\tat org.apache.commons.dbcp2.DelegatingPreparedStatement.execute(DelegatingPreparedStatement.java:94)",
    "\tat org.apache.commons.dbcp2.DelegatingPreparedStatement.execute(DelegatingPreparedStatement.java:94)",
    "\tat org.jooq.tools.jdbc.DefaultPreparedStatement.execute(DefaultPreparedStatement.java:209)",
    "\tat org.jooq.impl.AbstractQuery.execute(AbstractQuery.java:453)",
    "\tat org.jooq.impl.AbstractDMLQuery.execute(AbstractDMLQuery.java:904)",
    "\tat org.jooq.impl.AbstractQuery.execute(AbstractQuery.java:371)",
    "\tat org.jooq.impl.AbstractDelegatingQuery.execute(AbstractDelegatingQuery.java:119)",
    "\tat io.airbyte.config.persistence.ConfigRepository.lambda$writeActorCatalogFetchEvent$22(ConfigRepository.java:899)",
    "\tat io.airbyte.db.Database.lambda$transaction$0(Database.java:31)",
    "\tat org.jooq.impl.DefaultDSLContext.lambda$transactionResult0$0(DefaultDSLContext.java:564)",
    "\tat org.jooq.impl.Tools$12$1.block(Tools.java:4926)",
    "\tat java.base/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463)",
    "\tat java.base/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434)",
    "\tat org.jooq.impl.Tools$12.get(Tools.java:4923)",
    "\tat org.jooq.impl.DefaultDSLContext.transactionResult0(DefaultDSLContext.java:616)",
    "\tat org.jooq.impl.DefaultDSLContext.transactionResult(DefaultDSLContext.java:533)",
    "\tat io.airbyte.db.Database.transaction(Database.java:31)",
    "\tat io.airbyte.db.ExceptionWrappingDatabase.transaction(ExceptionWrappingDatabase.java:31)",
    "\tat io.airbyte.config.persistence.ConfigRepository.writeActorCatalogFetchEvent(ConfigRepository.java:890)",
    "\tat io.airbyte.server.handlers.SchedulerHandler.discoverSchemaForSourceFromSourceId(SchedulerHandler.java:269)",
    "\tat io.airbyte.server.apis.ConfigurationApi.lambda$discoverSchemaForSource$36(ConfigurationApi.java:498)",
    "\tat io.airbyte.server.apis.ConfigurationApi.execute(ConfigurationApi.java:871)",
    "\tat io.airbyte.server.apis.ConfigurationApi.discoverSchemaForSource(ConfigurationApi.java:498)",
    "\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)",
    "\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)",
    "\tat java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)",
    "\tat java.base/java.lang.reflect.Method.invoke(Method.java:568)",
    "\tat org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:52)",
    "\tat org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:124)",
    "\tat org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:167)",
    "\tat org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:219)",
    "\tat org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:79)",
    "\tat org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:469)",
    "\tat org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:391)",
    "\tat org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:80)",
    "\tat org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253)",
    "\tat org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)",
    "\tat org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)",
    "\tat org.glassfish.jersey.internal.Errors.process(Errors.java:292)",
    "\tat org.glassfish.jersey.internal.Errors.process(Errors.java:274)",
    "\tat org.glassfish.jersey.internal.Errors.process(Errors.java:244)",
    "\tat org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265)",
    "\tat org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:232)",
    "\tat org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:680)",
    "\tat org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:394)",
    "\tat org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:346)",
    "\tat org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:366)",
    "\tat org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:319)",
    "\tat org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:205)",
    "\tat org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763)",
    "\tat org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:569)",
    "\tat org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)",
    "\tat org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377)",
    "\tat org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)",
    "\tat org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507)",
    "\tat org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)",
    "\tat org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292)",
    "\tat org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)",
    "\tat org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)",
    "\tat org.eclipse.jetty.server.Server.handle(Server.java:501)",
    "\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)",
    "\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556)",
    "\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)",
    "\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)",
    "\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)",
    "\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)",
    "\tat org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)",
    "\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336)",
    "\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313)",
    "\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171)",
    "\tat org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129)",
    "\tat org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375)",
    "\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)",
    "\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)",
    "\tat java.base/java.lang.Thread.run(Thread.java:833)"
  ]
}

application_sessions.txt (3.5 KB)
Attached the schema for that stream

Would be possible to upgrade Airbyte to latest version? Can you share the complete server logs?

Hey Macros, thanks for the response. I figured this was because the version for the source was too long (commit ID - our CI job tags the development builds that way). After shrinking it, it’s working fine.