Error connecting JSON source in Airbyte platform

Slack Knowledge Base Q&A Platform Questions
, , , ,
1

Summary

Error message indicates an internal error in the Airbyte platform while trying to connect a JSON source. Stacktrace shows failure in the ‘RunWithJobOutput’ activity. Confluence source with Pinecone database is working.


Question

Hi everyone ! I have a strange error. I’m trying to connect a JSON source and I have this error :

Failure origin: airbyte_platform

Stacktrace
io.temporal.failure.ActivityFailure: Activity with activityType='RunWithJobOutput' failed: 'Activity task failed'. scheduledEventId=12, startedEventId=13, activityId=e549238e-e0e1-360a-8f7c-be89cb99a10d, identity='1@22e4b3bd1bc8', retryState=RETRY_STATE_MAXIMUM_ATTEMPTS_REACHED
	at java.base/java.lang.Thread.getStackTrace(Thread.java:2450)
	at io.temporal.internal.sync.ActivityStubBase.execute(ActivityStubBase.java:49)
	at io.temporal.internal.sync.ActivityInvocationHandler.lambda$getActivityFunc$0(ActivityInvocationHandler.java:83)
	at io.temporal.internal.sync.ActivityInvocationHandlerBase.invoke(ActivityInvocationHandlerBase.java:60)
	at jdk.proxy2/jdk.proxy2.$Proxy103.runWithJobOutput(Unknown Source)
	at io.airbyte.workers.temporal.check.connection.CheckConnectionWorkflowImpl.run(CheckConnectionWorkflowImpl.java:55)
	at CheckConnectionWorkflowImplProxy.run$accessor$x8m9QyEz(Unknown Source)
	at CheckConnectionWorkflowImplProxy$auxiliary$YXvI3xeF.call(Unknown Source)
	at io.airbyte.micronaut.temporal.TemporalActivityStubInterceptor.execute(TemporalActivityStubInterceptor.java:79)
	at CheckConnectionWorkflowImplProxy.run(Unknown Source)```
I already have a confluense source working with a pinecone database.

<br>

---

This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C021JANJ6TY/p1722006440361239) if you want 
to access the original thread.

[Join the conversation on Slack](https://slack.airbyte.com)

<sub>
["error", "json-source", "airbyte-platform", "internal-error", "confluence-source", "pinecone-database"]
</sub>
2

Are there any errors higher than that in the sync logs?

3

Nope, this line is the first one :
io.temporal.failure.ActivityFailure: Activity with activityType='RunWithJobOutput' failed: 'Activity task failed'. scheduledEventId=12, startedEventId=13, activityId=39adfefd-b714-36bb-a13b-8338da66e311, identity='1@22e4b3bd1bc8', retryState=RETRY_STATE_MAXIMUM_ATTEMPTS_REACHED

4

Oh. I just tried with another source (github), and I have the same error :confused:

5

hm, that doesn’t seem right. What version are you on? And where are you deployed?

6

0.63.6
I’m on a droplet on digitalocean.

7

you might want to check the container logs and see if there’s anything more detailed in there

8

Yep. How can I give you that ? :slightly_smiling_face:

9

The log from the airbyte-server container ?

10

I tried docker logs airbyte-server > server.log
But the last error doesn’t look related to the source connection

WARNING: [Channel<1>: (airbyte-temporal:7233)] Failed to resolve name. status=Status{code=UNAVAILABLE, description=Unable to resolve host airbyte-temporal, cause=java.lang.RuntimeException: java.net.UnknownHostException: airbyte-temporal: Temporary failure in name resolution
	at io.grpc.internal.DnsNameResolver.resolveAddresses(DnsNameResolver.java:223)
	at io.grpc.internal.DnsNameResolver.doResolve(DnsNameResolver.java:282)
	at io.grpc.grpclb.GrpclbNameResolver.doResolve(GrpclbNameResolver.java:63)
	at io.grpc.internal.DnsNameResolver$Resolve.run(DnsNameResolver.java:318)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
	at java.base/java.lang.Thread.run(Thread.java:1583)
Caused by: java.net.UnknownHostException: airbyte-temporal: Temporary failure in name resolution
	at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method)
	at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Inet4AddressImpl.java:43)
	at java.base/java.net.InetAddress$PlatformResolver.lookupByName(InetAddress.java:1211)
	at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1828)
	at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:1139)
	at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1818)
	at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1688)
	at io.grpc.internal.DnsNameResolver$JdkAddressResolver.resolveAddress(DnsNameResolver.java:632)
	at io.grpc.internal.DnsNameResolver.resolveAddresses(DnsNameResolver.java:219)
	... 6 more
}```
11

hm, is he temporal container failing/restarting? that could cause other things to fail since it handles a lot of state operations

12

What I did is stop the containers, run the upgrade and start them again. It seems that it’s working again. Thanks for your help !

13

nice, that’s a weird one. glad it’s working for you now though!