Facing NullPointerException error in Airbyte worker

Slack Knowledge Base Q&A Platform Questions
, , , ,
1

Summary

Workers fail every night due to java.lang.NullPointerException in Airbyte worker causing connections to fail. Restarting worker daily is the current workaround. Issue was previously fixed but has resurfaced.


Question

Hi team, we are using 0.50.33 and we are still facing this issue also. All our connections fail every night because of this error java.lang.NullPointerException: Cannot invoke "java.lang.Integer.intValue()" because the return value of "io.airbyte.workers.process.KubePortManagerSingleton.take()" is null.
Can someone help us ? Our only workaround now is to restart the worker everyday, we saw that this was fixed before https://github.com/airbytehq/airbyte/issues/24277 but it doesn’t seem to be the case anymore.

Here is the stacktrace :

2023-12-27 03:46:17 ERROR i.a.w.g.DefaultCheckConnectionWorker(run):133 - Unexpected error while checking connection: 
io.airbyte.workers.exception.WorkerException: Failed to create pod for check step
        at io.airbyte.workers.process.KubeProcessFactory.create(KubeProcessFactory.java:188) ~[io.airbyte-airbyte-commons-worker-0.50.33.jar:?]
        at io.airbyte.workers.process.AirbyteIntegrationLauncher.check(AirbyteIntegrationLauncher.java:143) ~[io.airbyte-airbyte-commons-worker-0.50.33.jar:?]
        at io.airbyte.workers.general.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:71) ~[io.airbyte-airbyte-commons-worker-0.50.33.jar:?]
        at io.airbyte.workers.general.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:44) ~[io.airbyte-airbyte-commons-worker-0.50.33.jar:?]
        at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:135) ~[io.airbyte-airbyte-workers-0.50.33.jar:?]
        at io.airbyte.workers.temporal.check.connection.CheckConnectionActivityImpl.lambda$runWithJobOutput$1(CheckConnectionActivityImpl.java:136) ~[io.airbyte-airbyte-workers-0.50.33.jar:?]
        at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:314) ~[io.airbyte-airbyte-commons-temporal-0.50.33.jar:?]```

<br>

---

This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C021JANJ6TY/p1703669963334059) if you want to access the original thread.

[Join the conversation on Slack](https://slack.airbyte.com)

<sub>
["nullpointerexception", "airbyte-worker", "connection-failure", "restart-worker", "issue-24277"]
</sub>