Summary
The user is facing an error ‘Source process exited with non-zero exit code 3’ when trying to move data from MS SQL to S3 Bucket using Airbyte deployed on Kubernetes. The error seems to be related to the source process termination with a non-zero exit code.
Question
Hi all,
When Using Airbyte to move data from MS SQL to S3 Bucket , It worked well for few days sync & everything was perfect but now it’s throwing error "Source process exited with non-zero exit code 3 "
Can anyone help me with this error , We have deployed airbyte on Kubernetes , Helm chart version :- 0.48.8
2024-06-12 03:50:09 INFO i.a.w.p.KubePodProcess(close):787 - (pod: data-science-airbyte / source-mssql-read-640-2-vdvet) - Closed all resources for pod
2024-06-12 03:50:09 INFO i.a.w.g.BufferedReplicationWorker(readFromSource):346 - readFromSource: source exception
io.airbyte.workers.internal.exception.SourceException: Source process exited with non-zero exit code 3
at io.airbyte.workers.general.BufferedReplicationWorker.readFromSource(BufferedReplicationWorker.java:343) ~[io.airbyte-airbyte-commons-worker-0.50.28.jar:?]
at io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsyncWithHeartbeatCheck$3(BufferedReplicationWorker.java:236) ~[io.airbyte-airbyte-commons-worker-0.50.28.jar:?]
at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
at java.lang.Thread.run(Thread.java:1589) ~[?:?]
2024-06-12 03:50:09 INFO i.a.w.g.BufferedReplicationWorker(readFromSource):356 - readFromSource: done. (source.isFinished:true, fromSource.isClosed:false)
2024-06-12 03:50:09 INFO i.a.w.g.BufferedReplicationWorker(writeToDestination):428 - writeToDestination: done. (forDest.isDone:true, isDestRunning:true)
2024-06-12 03:50:10 INFO i.a.w.p.KubePodProcess(close):787 - (pod: data-science-airbyte / destination-s3-write-640-2-fkegs) - Closed all resources for pod
2024-06-12 03:50:10 INFO i.a.w.g.BufferedReplicationWorker(readFromDestination):464 - readFromDestination: done. (writeToDestFailed:false, dest.isFinished:true)
2024-06-12 03:50:12 ERROR i.a.w.t.s.a.AppendToAttemptLogActivityImpl(log):54 - Failing job: 640, reason: Job failed after too many retries for connection 609ee8fe-3a96-4eec-bf43-7d89826eec64
2024-06-12 03:50:08 source > Terminating due to java.lang.OutOfMemoryError: Java heap space
2024-06-12 03:50:09 destination > INFO main i.a.c.i.b.IntegrationRunner$Companion(consumeWriteStream$io_airbyte_airbyte_cdk_java_airbyte_cdk_airbyte_cdk_core):445 Finished buffered read of input stream
2024-06-12 03:50:09 destination > INFO main i.a.c.i.b.FailureTrackingAirbyteMessageConsumer(close):74 Airbyte message consumer: succeeded.
2024-06-12 03:50:09 destination > INFO main i.a.c.i.d.b.BufferedStreamConsumer(close):262 executing on success close procedure.
2024-06-12 03:50:09 destination > INFO main i.a.c.i.d.r.SerializedBufferingStrategy(flushAllBuffers):126 Flushing all 0 current buffers (0 bytes in total)
2024-06-12 03:50:09 destination > INFO main i.a.c.i.b.IntegrationRunner(runInternal):267 Completed integration: io.airbyte.integrations.destination.s3.S3Destination
2024-06-12 03:50:09 destination > INFO main i.a.c.i.b.a.AdaptiveDestinationRunner$Runner(run):70 Completed destination: io.airbyte.integrations.destination.s3.S3Destination```
<br>
---
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C021JANJ6TY/p1718180270278399) if you want
to access the original thread.
[Join the conversation on Slack](https://slack.airbyte.com)
<sub>
["error", "source-process", "non-zero-exit-code", "MS-SQL", "S3-Bucket", "Airbyte", "Kubernetes", "Helm-chart"]
</sub>