Summary
Encountering error ‘Some streams were unsuccessful due to a source error’ after upgrading Airbyte to the latest version. Also, facing issues with destination process and airbyte-source gobbler.
Question
Hey Folks,
After upgrading the airbyte to latest version we are encountering the below error:
at io.airbyte.cdk.integrations.destination.async.AsyncStreamConsumer.close(AsyncStreamConsumer.kt:205) ~[airbyte-cdk-core-0.41.2.jar:?]
at kotlin.jdk7.AutoCloseableKt.closeFinally(AutoCloseableJVM.kt:46) ~[kotlin-stdlib-1.9.23.jar:1.9.23-release-779]
at io.airbyte.cdk.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.kt:209) [airbyte-cdk-core-0.41.2.jar:?]
at io.airbyte.cdk.integrations.base.IntegrationRunner.run(IntegrationRunner.kt:116) [airbyte-cdk-core-0.41.2.jar:?]
at io.airbyte.cdk.integrations.base.adaptive.AdaptiveDestinationRunner$Runner.run(AdaptiveDestinationRunner.kt:68) [airbyte-cdk-core-0.41.2.jar:?]
at io.airbyte.integrations.destination.snowflake.SnowflakeDestinationKt.main(SnowflakeDestination.kt:351) [io.airbyte.airbyte-integrations.connectors-destination-snowflake.jar:?]
Stack Trace: io.airbyte.commons.exceptions.TransientErrorException: Some streams were unsuccessful due to a source error: [io.airbyte.protocol.models.v0.StreamDescriptor@3c81cd82[name=images,namespace=twistlock_saas,additionalProperties={}], io.airbyte.protocol.models.v0.StreamDescriptor@111c229c[name=registry,namespace=twistlock_saas,additionalProperties={}], io.airbyte.protocol.models.v0.StreamDescriptor@49cb3881[name=containers,namespace=twistlock_saas,additionalProperties={}], io.airbyte.protocol.models.v0.StreamDescriptor@1a14fdf0[name=hosts,namespace=twistlock_saas,additionalProperties={}]]
at io.airbyte.cdk.integrations.destination.async.AsyncStreamConsumer.close(AsyncStreamConsumer.kt:205)
at kotlin.jdk7.AutoCloseableKt.closeFinally(AutoCloseableJVM.kt:46)
at io.airbyte.cdk.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.kt:209)
at io.airbyte.cdk.integrations.base.IntegrationRunner.run(IntegrationRunner.kt:116)
at io.airbyte.cdk.integrations.base.adaptive.AdaptiveDestinationRunner$Runner.run(AdaptiveDestinationRunner.kt:68)
at io.airbyte.integrations.destination.snowflake.SnowflakeDestinationKt.main(SnowflakeDestination.kt:351)
2024-07-16 19:41:39 platform > readFromDestination: exception caught
java.lang.IllegalStateException: Destination process is still alive, cannot retrieve exit value.
at com.google.common.base.Preconditions.checkState(Preconditions.java:515) ~[guava-33.2.0-jre.jar:?]
at io.airbyte.workers.internal.DefaultAirbyteDestination.getExitValue(DefaultAirbyteDestination.java:210) ~[io.airbyte-airbyte-commons-worker-0.63.7.jar:?]
at io.airbyte.workers.general.BufferedReplicationWorker.readFromDestination(BufferedReplicationWorker.java:492) ~[io.airbyte-airbyte-commons-worker-0.63.7.jar:?]
at io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsync$2(BufferedReplicationWorker.java:235) ~[io.airbyte-airbyte-commons-worker-0.63.7.jar:?]
at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
at java.base/java.lang.Thread.run(Thread.java:1583) [?:?]
2024-07-16 19:41:39 platform > readFromDestination: done. (writeToDestFailed:true, dest.isFinished:false)
2024-07-16 19:42:39 platform > airbyte-source gobbler IOException: Stream closed. Typically happens when cancelling a job.
2024-07-16 19:42:39 platform > Closing StateCheckSumCountEventHandler```
<br>
---
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C021JANJ6TY/p1721194557454229) if you want
to access the original thread.
[Join the conversation on Slack](https://slack.airbyte.com)
<sub>
["error", "upgrading", "airbyte", "latest-version", "streams", "source-error", "destination-process", "airbyte-source-gobbler"]
</sub>