Summary
Encountered error ‘Stream load failed because of unknown exception’ while trying to load data to StarRocks destination in Airbyte custom connector. The issue seems to be related to a NullPointerException in the stream loader.
Question
Hi,
Was working on the custom connector for starrocks in airbyte.
Tried to load some data to the starrocks destination.
But was getting the error: Additional Failure Information: io.airbyte.integrations.destination.starrocks.exception.StreamLoadFailException: Stream load failed because of unknown exception
Putting the last error logs here:
at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:186) ~[io.airbyte.airbyte-integrations.bases-base-java-0.50.13.jar:?]
at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:123) ~[io.airbyte.airbyte-integrations.bases-base-java-0.50.13.jar:?]
at io.airbyte.integrations.destination.starrocks.StarRocksDestination.main(StarRocksDestination.java:51) ~[io.airbyte.airbyte-integrations.connectors-destination-starrocks-0.50.13.jar:?]
Caused by: java.lang.NullPointerException: Cannot invoke "io.airbyte.integrations.destination.starrocks.StreamLoadResponse$StreamLoadResponseBody.getStatus()" because "streamLoadBody" is null
at io.airbyte.integrations.destination.starrocks.DefaultStreamLoader.send(DefaultStreamLoader.java:132) ~[io.airbyte.airbyte-integrations.connectors-destination-starrocks-0.50.13.jar:?]
... 8 more
Stack Trace: io.airbyte.integrations.destination.starrocks.exception.StreamLoadFailException: Stream load failed because of unknown exception, db: src_google_sheet, table: _airbyte_tmp_ghz_suppliers, label: airbyte__airbyte_tmp_ghz_suppliers_338ca6f4-de79-4516-b6f8-8c34f6b56caa1709547045049
at io.airbyte.integrations.destination.starrocks.DefaultStreamLoader.send(DefaultStreamLoader.java:166)
at io.airbyte.integrations.destination.starrocks.StarRocksBufferedConsumerFactory.lambda$recordWriterFunction$2(StarRocksBufferedConsumerFactory.java:100)
at io.airbyte.integrations.destination.record_buffer.InMemoryRecordBufferingStrategy.flushAllBuffers(InMemoryRecordBufferingStrategy.java:87)
at io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer.close(BufferedStreamConsumer.java:291)
at io.airbyte.integrations.base.FailureTrackingAirbyteMessageConsumer.close(FailureTrackingAirbyteMessageConsumer.java:82)
at io.airbyte.integrations.base.Destination$ShimToSerializedAirbyteMessageConsumer.close(Destination.java:95)
at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:186)
at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:123)
at io.airbyte.integrations.destination.starrocks.StarRocksDestination.main(StarRocksDestination.java:51)
Caused by: java.lang.NullPointerException: Cannot invoke "io.airbyte.integrations.destination.starrocks.StreamLoadResponse$StreamLoadResponseBody.getStatus()" because "streamLoadBody" is null
at io.airbyte.integrations.destination.starrocks.DefaultStreamLoader.send(DefaultStreamLoader.java:132)
...```
P.S: Found the issue being raised here: <https://github.com/StarRocks/starrocks/issues/41560>
<br>
---
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C021JANJ6TY/p1709547311511259) if you want to access the original thread.
[Join the conversation on Slack](https://slack.airbyte.com)
<sub>
["error", "loading-data", "starrocks-destination", "airbyte-custom-connector", "null-pointer-exception"]
</sub>