- Is this your first time deploying Airbyte?: Yes
- OS Version / Instance: Centos7
- Memory / Disk: 4Gb
- Deployment: Docker
- Airbyte Version: 0.39.20.alpha
- Destination name/version: cassandra / 0.1.2
- Step: The issue is happening during creating the destination
- Description: error occurs when click “setup the destination” .
2022-06-21 09:56:38 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.airbyte.integrations.destination.cassandra.CassandraCqlProvider.createTableIfNotExists(CassandraCqlProvider.java:75) ~[io.airbyte.airbyte-integrations.connectors-destination-cassandra-0.39.20-alpha.jar:?]
2022-06-21 09:56:38 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.airbyte.integrations.destination.cassandra.CassandraDestination.check(CassandraDestination.java:39) [io.airbyte.airbyte-integrations.connectors-destination-cassandra-0.39.20-alpha.jar:?]
2022-06-21 09:56:38 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:140) [io.airbyte.airbyte-integrations.bases-base-java-0.39.20-alpha.jar:?]
2022-06-21 09:56:38 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:107) [io.airbyte.airbyte-integrations.bases-base-java-0.39.20-alpha.jar:?]
2022-06-21 09:56:38 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.airbyte.integrations.destination.cassandra.CassandraDestination.main(CassandraDestination.java:25) [io.airbyte.airbyte-integrations.connectors-destination-cassandra-0.39.20-alpha.jar:?]
2022-06-21 09:56:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-21 09:56:40 ERROR i.a.i.d.c.CassandraDestination(check):50 - Error while deleting temp table table_438010665fa6465e8d9e484e7dcf7400 with reason:
2022-06-21 09:56:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - com.datastax.oss.driver.api.core.DriverTimeoutException: Query timed out after PT2S
2022-06-21 09:56:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - at com.datastax.oss.driver.api.core.DriverTimeoutException.copy(DriverTimeoutException.java:34) ~[java-driver-core-4.13.0.jar:?]
2022-06-21 09:56:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - at com.datastax.oss.driver.internal.core.util.concurrent.CompletableFutures.getUninterruptibly(CompletableFutures.java:149) ~[java-driver-core-4.13.0.jar:?]
2022-06-21 09:56:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - at com.datastax.oss.driver.internal.core.cql.CqlRequestSyncProcessor.process(CqlRequestSyncProcessor.java:53) ~[java-driver-core-4.13.0.jar:?]
2022-06-21 09:56:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - at com.datastax.oss.driver.internal.core.cql.CqlRequestSyncProcessor.process(CqlRequestSyncProcessor.java:30) ~[java-driver-core-4.13.0.jar:?]
2022-06-21 09:56:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - at com.datastax.oss.driver.internal.core.session.DefaultSession.execute(DefaultSession.java:230) ~[java-driver-core-4.13.0.jar:?]
2022-06-21 09:56:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - at com.datastax.oss.driver.api.core.cql.SyncCqlSession.execute(SyncCqlSession.java:54) ~[java-driver-core-4.13.0.jar:?]
2022-06-21 09:56:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.airbyte.integrations.destination.cassandra.CassandraCqlProvider.dropTableIfExists(CassandraCqlProvider.java:82) ~[io.airbyte.airbyte-integrations.connectors-destination-cassandra-0.39.20-alpha.jar:?]
2022-06-21 09:56:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.airbyte.integrations.destination.cassandra.CassandraDestination.check(CassandraDestination.java:48) [io.airbyte.airbyte-integrations.connectors-destination-cassandra-0.39.20-alpha.jar:?]
2022-06-21 09:56:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:140) [io.airbyte.airbyte-integrations.bases-base-java-0.39.20-alpha.jar:?]
2022-06-21 09:56:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:107) [io.airbyte.airbyte-integrations.bases-base-java-0.39.20-alpha.jar:?]
2022-06-21 09:56:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.airbyte.integrations.destination.cassandra.CassandraDestination.main(CassandraDestination.java:25) [io.airbyte.airbyte-integrations.connectors-destination-cassandra-0.39.20-alpha.jar:?]
2022-06-21 09:56:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-21 09:56:40 WARN c.d.o.d.i.c.u.Loggers(warnWithException):39 - [s0|/10.20.2.84:9042] Error while opening new channel (ConnectionInitException: [s0|id: 0xecf31f85, L:/10.20.2.72:57748 - R:/10.20.2.84:9042] Protocol initialization request, step 1 (STARTUP {CQL_VERSION=3.0.0, DRIVER_NAME=DataStax Java driver for Apache Cassandra(R), DRIVER_VERSION=4.13.0, CLIENT_ID=ae7e2902-81ee-449e-8f82-6314906682f6}): unexpected failure (com.datastax.oss.driver.api.core.connection.ClosedConnectionException: Lost connection to remote peer))
2022-06-21 09:56:43 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling..
Hi @liangfei, thanks for your post and welcome to the community. Could you post the full logs, if possible?
Also what source are you pulling data from? According to this stackoverflow post, you may be making more writes than the cluster can handle.
Hi @sajarin ,thanks for your reply. I just set up the cassandra destination without any sources. The following file is the full logs.
_airbyte-worker_logs.txt (10.6 KB)
Thanks for the reply @liangfei. I took the time to run a local instance of Airbyte with an dockerized instance of Cassandra but did not run into the same issue. My guess is that you might need to increase the client request timeout for your Cassandra instance but I am unsure if this will fix the problem.
You may want to set up a local instance of Cassandra and verify whether or not Airbyte is able to successfully connect to it. This would isolate the issue and determine whether Airbyte is at fault here or if it’s an issue with the Cassandra
Hi there from the Community Assistance team.
We’re letting you know about an issue we discovered with the back-end process we use to handle topics and responses on the forum. If you experienced a situation where you posted the last message in a topic that did not receive any further replies, please open a new topic to continue the discussion. In addition, if you’re having a problem and find a closed topic on the subject, go ahead and open a new topic on it and we’ll follow up with you. We apologize for the inconvenience, and appreciate your willingness to work with us to provide a supportive community.