Summary
Encountering an internal server error during the ‘Sync Data’ step in Airbyte Helm chart version 0.64.7 with MySQL source and PostgreSQL destination due to a missing column ‘temporal_workflow_id’ in the schema, leading to a DataAccessException.
Question
Hello ,
I am currently using the Airbyte Helm chart, version 0.64.7, with a MySQL source and PostgreSQL destination (PostgreSQL image: 14-alpine). When attempting to establish a data connection, everything progresses smoothly until I reach the final “Sync Data” step. At that point, I encounter an internal server error with the following message:
"response": {
"message": "Internal Server Error: Error executing SQL Query: ERROR: column job_with_attempts_attempts_.temporal_workflow_id does not exist\n Position: 780",
"exceptionClassName": "io.micronaut.data.exceptions.DataAccessException",
"exceptionStack": [
"io.micronaut.data.exceptions.DataAccessException: Error executing SQL Query: ERROR: column job_with_attempts_attempts_.temporal_workflow_id does not exist",
" Position: 780",
"\tat io.micronaut.data.jdbc.operations.DefaultJdbcRepositoryOperations.findAll(DefaultJdbcRepositoryOperations.java:380)",
"\tat io.micronaut.data.jdbc.operations.DefaultJdbcRepositoryOperations.lambda$findAll$5(DefaultJdbcRepositoryOperations.java:530)",
"\tat io.micronaut.data.jdbc.operations.DefaultJdbcRepositoryOperations.lambda$executeRead$23(DefaultJdbcRepositoryOperations.java:770)",
"\tat io.micronaut.data.connection.support.AbstractConnectionOperations.executeWithNewConnection(AbstractConnectionOperations.java:143)",
"\tat io.micronaut.data.connection.support.AbstractConnectionOperations.execute(AbstractConnectionOperations.java:90)",
"\tat io.micronaut.data.connection.ConnectionOperations.executeRead(ConnectionOperations.java:71)",
"\tat io.micronaut.data.jdbc.operations.DefaultJdbcRepositoryOperations.executeRead(DefaultJdbcRepositoryOperations.java:767)",
"\tat io.micronaut.data.jdbc.operations.DefaultJdbcRepositoryOperations.findAll(DefaultJdbcRepositoryOperations.java:530)",
"\tat io.micronaut.data.runtime.intercept.criteria.AbstractSpecificationInterceptor.findAll(AbstractSpecificationInterceptor.java:156)",
"\tat io.micronaut.data.runtime.intercept.criteria.FindPageSpecificationInterceptor.intercept(FindPageSpecificationInterceptor.java:56)",
"\tat io.micronaut.data.runtime.intercept.DataIntroductionAdvice.intercept(DataIntroductionAdvice.java:83)",
"\tat io.micronaut.aop.chain.MethodInterceptorChain.proceed(MethodInterceptorChain.java:143)",
"\tat io.airbyte.data.repositories.JobsWithAttemptsRepository$Intercepted.findAll(Unknown Source)",
"\tat io.airbyte.data.services.impls.data.JobServiceDataImpl.listJobs(JobServiceDataImpl.kt:40)",
"\tat io.airbyte.commons.server.handlers.JobHistoryHandler.listJobsFor(JobHistoryHandler.java:160)",
"\tat io.airbyte.server.apis.JobsApiController.lambda$listJobsFor$12(JobsApiController.java:179)",
"\tat io.airbyte.server.apis.ApiHelper.execute(ApiHelper.java:28)",
"\tat io.airbyte.server.apis.JobsApiController.listJobsFor(JobsApiController.java:179)",
"\tat io.airbyte.server.apis.$JobsApiController$Definition$Exec.dispatch(Unknown Source)",
"\tat io.micronaut.context.AbstractExecutableMethodsDefinition$DispatchedExecutableMethod.invokeUnsafe(AbstractExecutableMethodsDefinition.java:461)",
"\tat io.micronaut.context.DefaultBeanContext$BeanContextUnsafeExecutionHandle.invokeUnsafe(DefaultBeanContext.java:4350)",
"\tat io.micronaut.web.router.AbstractRouteMatch.execute(AbstractRouteMatch.java:272)",
"\tat io.micronaut.web.router.DefaultUriRouteMatch.execute(DefaultUriRouteMatch.java:38)",
"\tat io.micronaut.http.server.RouteExecutor.executeRouteAndConvertBody(RouteExecutor.java:498)",
"\tat io.micronaut.http.server.RouteExecutor.lambda$callRoute$5(RouteExecutor.java:475)",
"\tat io.micronaut.core.execution.ExecutionFlow.lambda$async$1(ExecutionFlow.java:87)",
"\tat io.micronaut.core.propagation.PropagatedContext.lambda$wrap$3(PropagatedContext.java:211)",
"\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)",
"\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)",
"\tat java.base/java.lang.Thread.run(Thread.java:1583)",
"Caused by: org.postgresql.util.PSQLException: ERROR: column job_with_attempts_attempts_.temporal_workflow_id does not exist",
" Position: 780",
"\tat org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2733)",
"\tat org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2420)",
"\tat org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:372)",
"\tat org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:517)",
"\tat org.postgresql.jdbc.PgStatement.execute(PgStatement.java:434)",
"\tat org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:194)",
"\tat org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:137)",
"\tat com.zaxxer.hikari.pool.ProxyPreparedStatement.executeQuery(ProxyPreparedStatement.java:52)",
"\tat com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeQuery(HikariProxyPreparedStatement.java)",
"\tat io.micronaut.data.jdbc.operations.DefaultJdbcRepositoryOperations.findAll(DefaultJdbcRepositoryOperations.java:385)",
"\tat io.micronaut.data.jdbc.operations.DefaultJdbcRepositoryOperations.findAll(DefaultJdbcRepositoryOperations.java:378)",
"\t... 29 more"
],
"rootCauseExceptionClassName": "org.postgresql.util.PSQLException",
"rootCauseExceptionStack": [
"org.postgresql.util.PSQLException: ERROR: column job_with_attempts_attempts_.temporal_workflow_id does not exist",
" Position: 780",
"\tat org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2733)",
"\tat org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2420)",
"\tat org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:372)",
"\tat org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:517)",
"\tat org.postgresql.jdbc.PgStatement.execute(PgStatement.java:434)",
"\tat org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:194)",
"\tat org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:137)",
"\tat com.zaxxer.hikari.pool.ProxyPreparedStatement.executeQuery(ProxyPreparedStatement.java:52)",
"\tat com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeQuery(HikariProxyPreparedStatement.java)",
"\tat io.micronaut.data.jdbc.operations.DefaultJdbcRepositoryOperations.findAll(DefaultJdbcRepositoryOperations.java:385)",
"\tat io.micronaut.data.jdbc.operations.DefaultJdbcRepositoryOperations.findAll(DefaultJdbcRepositoryOperations.java:378)",
"\tat io.micronaut.data.jdbc.operations.DefaultJdbcRepositoryOperations.lambda$findAll$5(DefaultJdbcRepositoryOperations.java:530)",
"\tat io.micronaut.data.jdbc.operations.DefaultJdbcRepositoryOperations.lambda$executeRead$23(DefaultJdbcRepositoryOperations.java:770)",
"\tat io.micronaut.data.connection.support.AbstractConnectionOperations.executeWithNewConnection(AbstractConnectionOperations.java:143)",
"\tat io.micronaut.data.connection.support.AbstractConnectionOperations.execute(AbstractConnectionOperations.java:90)",
"\tat io.micronaut.data.connection.ConnectionOperations.executeRead(ConnectionOperations.java:71)",
"\tat io.micronaut.data.jdbc.operations.DefaultJdbcRepositoryOperations.executeRead(DefaultJdbcRepositoryOperations.java:767)",
"\tat io.micronaut.data.jdbc.operations.DefaultJdbcRepositoryOperations.findAll(DefaultJdbcRepositoryOperations.java:530)",
"\tat io.micronaut.data.runtime.intercept.criteria.AbstractSpecificationInterceptor.findAll(AbstractSpecificationInterceptor.java:156)",
"\tat io.micronaut.data.runtime.intercept.criteria.FindPageSpecificationInterceptor.intercept(FindPageSpecificationInterceptor.java:56)",
"\tat io.micronaut.data.runtime.intercept.DataIntroductionAdvice.intercept(DataIntroductionAdvice.java:83)",
"\tat io.micronaut.aop.chain.MethodInterceptorChain.proceed(MethodInterceptorChain.java:143)",
"\tat io.airbyte.data.repositories.JobsWithAttemptsRepository$Intercepted.findAll(Unknown Source)",
"\tat io.airbyte.data.services.impls.data.JobServiceDataImpl.listJobs(JobServiceDataImpl.kt:40)",
"\tat io.airbyte.commons.server.handlers.JobHistoryHandler.listJobsFor(JobHistoryHandler.java:160)",
"\tat io.airbyte.server.apis.JobsApiController.lambda$listJobsFor$12(JobsApiController.java:179)",
"\tat io.airbyte.server.apis.ApiHelper.execute(ApiHelper.java:28)",
"\tat io.airbyte.server.apis.JobsApiController.listJobsFor(JobsApiController.java:179)",
"\tat io.airbyte.server.apis.$JobsApiController$Definition$Exec.dispatch(Unknown Source)",
"\tat io.micronaut.context.AbstractExecutableMethodsDefinition$DispatchedExecutableMethod.invokeUnsafe(AbstractExecutableMethodsDefinition.java:461)",
"\tat io.micronaut.context.DefaultBeanContext$BeanContextUnsafeExecutionHandle.invokeUnsafe(DefaultBeanContext.java:4350)",
"\tat io.micronaut.web.router.AbstractRouteMatch.execute(AbstractRouteMatch.java:272)",
"\tat io.micronaut.web.router.DefaultUriRouteMatch.execute(DefaultUriRouteMatch.java:38)",
"\tat io.micronaut.http.server.RouteExecutor.executeRouteAndConvertBody(RouteExecutor.java:498)",
"\tat io.micronaut.http.server.RouteExecutor.lambda$callRoute$5(RouteExecutor.java:475)",
"\tat io.micronaut.core.execution.ExecutionFlow.lambda$async$1(ExecutionFlow.java:87)",
"\tat io.micronaut.core.propagation.PropagatedContext.lambda$wrap$3(PropagatedContext.java:211)",
"\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)",
"\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)",
"\tat java.base/java.lang.Thread.run(Thread.java:1583)"
]
}
},
"stacktrace": "HttpError: errors.http.internalServerError\n at kve (<https://domain_name/assets/core-c2dfexp6pt.js:119:10572>)",
"userAgent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 Safari/537.36",
"featureFlags": {}
}```
It appears that `temporal_workflow_id` might be missing from the schema, as the system throws a `DataAccessException` at this point.
Has anyone encountered this issue or could offer guidance on resolving it? I’d appreciate any help or suggestions.
Thank you in advance!
<br>
---
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C021JANJ6TY/p1730104342639469) if you want
to access the original thread.
[Join the conversation on Slack](https://slack.airbyte.com)
<sub>
["internal-server-error", "missing-column", "temporal-workflow-id", "data-access-exception", "airbyte-helm-chart", "mysql-source", "postgresql-destination"]
</sub>