Source Postgres: java.lang.NoSuchMethodError: 'java.time.OffsetDateTime

  • Is this your first time deploying Airbyte?: No
  • OS Version / Instance: Ubuntu
  • Memory / Disk: 1GB / 16GB
  • Deployment: Kubernetes
  • Airbyte Version: v0.39.28-alpha
  • Source name/version: Postgres 11 on GCP Cloud SQL
  • Destination name/version: BigQuery
  • Step: Happens at the beginning of the sync
  • Description:

Syncing Postgres → BigQuery fails with the following error:

2022-06-28 13:47:07 source > 2022-06-28 13:47:07 INFO i.d.c.p.s.InitialSnapshotter(shouldSnapshot):34 - Taking initial snapshot for new datasource
2022-06-28 13:47:07 source > 2022-06-28 13:47:07 INFO i.d.c.p.PostgresSnapshotChangeEventSource(getSnapshottingTask):64 - According to the connector configuration data will be snapshotted
2022-06-28 13:47:07 source > 2022-06-28 13:47:07 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):87 - Snapshot step 1 - Preparing
2022-06-28 13:47:08 source > 2022-06-28 13:47:08 INFO i.d.p.s.AbstractSnapshotChangeEventSource(execute):88 - Snapshot - Final stage
2022-06-28 13:47:08 source > 2022-06-28 13:47:08 ERROR i.d.p.ErrorHandler(setProducerThrowable):35 - Producer failure
2022-06-28 13:47:08 source > java.lang.NoSuchMethodError: 'java.time.OffsetDateTime org.postgresql.jdbc.TimestampUtils.toOffsetDateTime(java.lang.String)'
2022-06-28 13:47:08 source > 	at io.debezium.connector.postgresql.connection.PostgresDefaultValueConverter.lambda$createDefaultValueMappers$23(PostgresDefaultValueConverter.java:169) ~[debezium-connector-postgres-1.9.2.Final.jar:1.9.2.Final]
2022-06-28 13:47:08 source > 	at io.debezium.connector.postgresql.connection.PostgresDefaultValueConverter.parseDefaultValue(PostgresDefaultValueConverter.java:77) ~[debezium-connector-postgres-1.9.2.Final.jar:1.9.2.Final]
2022-06-28 13:47:08 source > 	at io.debezium.relational.TableSchemaBuilder.lambda$addField$9(TableSchemaBuilder.java:391) ~[debezium-core-1.9.2.Final.jar:1.9.2.Final]
2022-06-28 13:47:08 source > 	at java.util.Optional.flatMap(Optional.java:289) ~[?:?]
2022-06-28 13:47:08 source > 	at io.debezium.relational.TableSchemaBuilder.addField(TableSchemaBuilder.java:391) ~[debezium-core-1.9.2.Final.jar:1.9.2.Final]
2022-06-28 13:47:08 source > 	at io.debezium.relational.TableSchemaBuilder.lambda$create$2(TableSchemaBuilder.java:147) ~[debezium-core-1.9.2.Final.jar:1.9.2.Final]
2022-06-28 13:47:08 source > 	at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183) ~[?:?]
2022-06-28 13:47:08 source > 	at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:179) ~[?:?]
2022-06-28 13:47:08 source > 	at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1625) ~[?:?]
2022-06-28 13:47:08 source > 	at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509) ~[?:?]
2022-06-28 13:47:08 source > 	at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?]
2022-06-28 13:47:08 source > 	at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150) ~[?:?]
2022-06-28 13:47:08 source > 	at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173) ~[?:?]
2022-06-28 13:47:08 source > 	at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]
2022-06-28 13:47:08 source > 	at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:596) ~[?:?]
2022-06-28 13:47:08 source > 	at io.debezium.relational.TableSchemaBuilder.create(TableSchemaBuilder.java:145) ~[debezium-core-1.9.2.Final.jar:1.9.2.Final]
2022-06-28 13:47:08 source > 	at io.debezium.relational.RelationalDatabaseSchema.buildAndRegisterSchema(RelationalDatabaseSchema.java:135) ~[debezium-core-1.9.2.Final.jar:1.9.2.Final]
2022-06-28 13:47:08 source > 	at io.debezium.relational.RelationalDatabaseSchema.refreshSchema(RelationalDatabaseSchema.java:209) ~[debezium-core-1.9.2.Final.jar:1.9.2.Final]
2022-06-28 13:47:08 source > 	at io.debezium.connector.postgresql.PostgresSchema.lambda$refreshSchemas$2(PostgresSchema.java:149) ~[debezium-connector-postgres-1.9.2.Final.jar:1.9.2.Final]
2022-06-28 13:47:08 source > 	at java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4706) ~[?:?]
2022-06-28 13:47:08 source > 	at java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1092) ~[?:?]
2022-06-28 13:47:08 source > 	at io.debezium.connector.postgresql.PostgresSchema.refreshSchemas(PostgresSchema.java:149) ~[debezium-connector-postgres-1.9.2.Final.jar:1.9.2.Final]
2022-06-28 13:47:08 source > 	at io.debezium.connector.postgresql.PostgresSchema.refresh(PostgresSchema.java:93) ~[debezium-connector-postgres-1.9.2.Final.jar:1.9.2.Final]
2022-06-28 13:47:08 source > 	at io.debezium.connector.postgresql.PostgresSnapshotChangeEventSource.connectionCreated(PostgresSnapshotChangeEventSource.java:92) ~[debezium-connector-postgres-1.9.2.Final.jar:1.9.2.Final]
2022-06-28 13:47:08 source > 	at io.debezium.relational.RelationalSnapshotChangeEventSource.doExecute(RelationalSnapshotChangeEventSource.java:94) ~[debezium-core-1.9.2.Final.jar:1.9.2.Final]
2022-06-28 13:47:08 source > 	at io.debezium.pipeline.source.AbstractSnapshotChangeEventSource.execute(AbstractSnapshotChangeEventSource.java:76) ~[debezium-core-1.9.2.Final.jar:1.9.2.Final]
2022-06-28 13:47:08 source > 	at io.debezium.pipeline.ChangeEventSourceCoordinator.doSnapshot(ChangeEventSourceCoordinator.java:155) ~[debezium-core-1.9.2.Final.jar:1.9.2.Final]
2022-06-28 13:47:08 source > 	at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:137) ~[debezium-core-1.9.2.Final.jar:1.9.2.Final]
2022-06-28 13:47:08 source > 	at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:109) ~[debezium-core-1.9.2.Final.jar:1.9.2.Final]
2022-06-28 13:47:08 source > 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?]
2022-06-28 13:47:08 source > 	at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
2022-06-28 13:47:08 source > 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?]
2022-06-28 13:47:08 source > 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
2022-06-28 13:47:08 source > 	at java.lang.Thread.run(Thread.java:833) [?:?]
2022-06-28 13:47:08 source > 2022-06-28 13:47:08 INFO i.d.p.ChangeEventSourceCoordinator(streamingConnected):234 - Connected metrics set to 'false'
2022-06-28 13:47:08 source > 2022-06-28 13:47:08 INFO i.d.e.EmbeddedEngine(run):846 - Stopping the task and engine
2022-06-28 13:47:08 source > 2022-06-28 13:47:08 INFO i.d.c.c.BaseSourceTask(stop):238 - Stopping down connector
2022-06-28 13:47:08 source > 2022-06-28 13:47:08 INFO i.d.j.JdbcConnection(lambda$doClose$3):956 - Connection gracefully closed
2022-06-28 13:47:08 source > 2022-06-28 13:47:08 INFO i.d.j.JdbcConnection(lambda$doClose$3):956 - Connection gracefully closed
2022-06-28 13:47:08 source > 2022-06-28 13:47:08 INFO i.a.i.d.i.DebeziumRecordPublisher(lambda$start$1):85 - Debezium engine shutdown.
2022-06-28 13:52:05 source > 2022-06-28 13:52:05 INFO i.a.i.d.i.DebeziumRecordIterator(computeNext):78 - Closing cause next is returned as null
2022-06-28 13:52:05 source > 2022-06-28 13:52:05 INFO i.d.e.EmbeddedEngine(stop):1047 - Stopping the embedded engine
2022-06-28 13:52:05 source > 2022-06-28 13:52:05 INFO i.a.i.s.r.AbstractDbSource(lambda$read$2):134 - Closing database connection pool.
2022-06-28 13:52:05 source > 2022-06-28 13:52:05 INFO c.z.h.HikariDataSource(close):350 - HikariPool-2 - Shutdown initiated...
2022-06-28 13:52:05 source > 2022-06-28 13:52:05 INFO c.z.h.HikariDataSource(close):352 - HikariPool-2 - Shutdown completed.
2022-06-28 13:52:05 source > 2022-06-28 13:52:05 INFO i.a.i.s.r.AbstractDbSource(lambda$read$2):136 - Closed database connection pool.
2022-06-28 13:52:05 source > 2022-06-28 13:52:05 ERROR i.a.i.b.AirbyteExceptionHandler(uncaughtException):26 - Something went wrong in the connector. See the logs for more details.

Looks to be related to Source Postgres: Debezium Upgrade introduces default values errors · Issue #13967 · airbytehq/airbyte · GitHub but leaving this here for visibility.

Team is working in the solution for this issue Felix. Any updates I’ll return to you.

1 Like

I fix was released, please upgrade connector Postgres to version 0.4.29

Hi there from the Community Assistance team.
We’re letting you know about an issue we discovered with the back-end process we use to handle topics and responses on the forum. If you experienced a situation where you posted the last message in a topic that did not receive any further replies, please open a new topic to continue the discussion. In addition, if you’re having a problem and find a closed topic on the subject, go ahead and open a new topic on it and we’ll follow up with you. We apologize for the inconvenience, and appreciate your willingness to work with us to provide a supportive community.