Azure Storage Account inaccessible - Failed to resolve URL after 2 queries

nbl22 · April 7, 2022, 7:05pm

Is this your first time deploying Airbyte?: Yes
OS Version / Instance: Ubuntu/docker
Memory / Disk: 16GB
Deployment: Docker
Airbyte Version: 0.35.64-alpha
Source name/version:
Destination name/version: Azure Blob Storage 0.1.3
Step: Creating the connection
Description: I’m trying out airbyte using the docker repo and trying to land some data into an Azure storage account. I’m getting the following error when trying to set up the destination. I’ve confirmed the storage account is accessible from a different computer on the same network, so the storage account should be accessible. Not sure how else to troubleshoot this issue.

Caused by: java.net.UnknownHostException: failed to resolve ‘XXXXX.blob.core.windows.net’ after 2 queries

Full log:

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.channel.AbstractChannelHandlerContext.invokeFlush(AbstractChannelHandlerContext.java:742) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.channel.AbstractChannelHandlerContext.flush(AbstractChannelHandlerContext.java:728) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.channel.DefaultChannelPipeline.flush(DefaultChannelPipeline.java:967) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.channel.AbstractChannel.flush(AbstractChannel.java:254) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.resolver.dns.DnsNameResolver.flushQueries(DnsNameResolver.java:1207) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.resolver.dns.DnsResolveContext.internalResolve(DnsResolveContext.java:357) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.resolver.dns.DnsResolveContext.resolve(DnsResolveContext.java:211) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.resolver.dns.DnsNameResolver.doResolveAllUncached0(DnsNameResolver.java:1108) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.resolver.dns.DnsNameResolver.access$600(DnsNameResolver.java:90) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.resolver.dns.DnsNameResolver$6.run(DnsNameResolver.java:1087) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:384) ~[netty-transport-native-epoll-4.1.65.Final-linux-x86_64.jar:4.1.65.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at java.lang.Thread.run(Thread.java:833) ~[?:?]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - Caused by: io.netty.resolver.dns.DnsNameResolverException: [/[2001:4860:4860:0:0:0:0:8844]:53] failed to send a query via UDP (no stack trace available)

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - Caused by: io.netty.channel.unix.Errors$NativeIoException: sendToAddress(..) failed: Network is unreachable

2022-04-07 17:55:28 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling...

marcosmarxm · April 7, 2022, 8:28pm

@nbl22 please upload the log file

nbl22 · April 8, 2022, 3:07am

Attached and output here. Thanks!

2022-04-07 19:36:43 e[32mINFOe[m i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/4148e1c0-f45c-4afa-a96f-829492bf7c2f/0/logs.log
2022-04-07 19:36:43 e[32mINFOe[m i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.35.64-alpha
2022-04-07 19:36:43 e[32mINFOe[m i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-azure-blob-storage:0.1.3 exists...
2022-04-07 19:36:43 e[32mINFOe[m i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-azure-blob-storage:0.1.3 was found locally.
2022-04-07 19:36:43 e[32mINFOe[m i.a.w.p.DockerProcessFactory(create):106 - Creating docker job ID: 4148e1c0-f45c-4afa-a96f-829492bf7c2f
2022-04-07 19:36:43 e[32mINFOe[m i.a.w.p.DockerProcessFactory(create):158 - Preparing command: docker run --rm --init -i -w /data/4148e1c0-f45c-4afa-a96f-829492bf7c2f/0 --log-driver none --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-azure-blob-storage:0.1.3 -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.35.64-alpha -e WORKER_JOB_ID=4148e1c0-f45c-4afa-a96f-829492bf7c2f airbyte/destination-azure-blob-storage:0.1.3 check --config source_config.json
2022-04-07 19:36:44 e[1;31mERRORe[m i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Class path contains multiple SLF4J bindings.
2022-04-07 19:36:44 e[1;31mERRORe[m i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-04-07 19:36:44 e[1;31mERRORe[m i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-04-07 19:36:44 e[1;31mERRORe[m i.a.c.i.LineGobbler(voidCall):82 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2022-04-07 19:36:44 e[1;31mERRORe[m i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2022-04-07 19:36:45 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-04-07 19:36:45 e[32mINFOe[m i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json}
2022-04-07 19:36:45 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-04-07 19:36:45 e[32mINFOe[m i.a.i.b.IntegrationRunner(runInternal):105 - Running integration: io.airbyte.integrations.destination.azure_blob_storage.AzureBlobStorageDestination
2022-04-07 19:36:45 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-04-07 19:36:45 e[32mINFOe[m i.a.i.b.IntegrationRunner(runInternal):106 - Command: CHECK
2022-04-07 19:36:45 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-04-07 19:36:45 e[32mINFOe[m i.a.i.b.IntegrationRunner(runInternal):107 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'}
2022-04-07 19:36:46 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-04-07 19:36:46 e[33mWARNe[m c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-04-07 19:36:46 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-04-07 19:36:46 e[33mWARNe[m c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-04-07 19:36:46 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-04-07 19:36:46 e[32mINFOe[m i.a.i.d.a.AzureBlobStorageFormatConfigs(getAzureBlobStorageFormatConfig):21 - Azure Blob Storage format config: {"format_type":"CSV","flattening":"No flattening"}
2022-04-07 19:36:48 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-04-07 19:36:48 e[33mWARNe[m i.n.r.d.DefaultDnsServerAddressStreamProvider(<clinit>):101 - Default DNS servers: [/[2001:4860:4860:0:0:0:0:8888]:53, /[2001:4860:4860:0:0:0:0:8844]:53] (Google Public DNS as a fallback)
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-04-07 19:37:32 e[1;31mERRORe[m i.a.i.d.a.AzureBlobStorageDestination(check):38 - Exception attempting to access the azure blob storage bucket: 
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - reactor.core.Exceptions$ReactiveException: java.net.UnknownHostException: failed to resolve 'XXXXXX.blob.core.windows.net' after 2 queries 
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at reactor.core.Exceptions.propagate(Exceptions.java:392) ~[reactor-core-3.4.6.jar:3.4.6]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at reactor.core.publisher.BlockingSingleSubscriber.blockingGet(BlockingSingleSubscriber.java:97) ~[reactor-core-3.4.6.jar:3.4.6]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at reactor.core.publisher.Mono.block(Mono.java:1703) ~[reactor-core-3.4.6.jar:3.4.6]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at com.azure.storage.common.implementation.StorageImplUtils.blockWithOptionalTimeout(StorageImplUtils.java:128) ~[azure-storage-common-12.12.0.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at com.azure.storage.blob.BlobContainerClient.existsWithResponse(BlobContainerClient.java:228) ~[azure-storage-blob-12.12.0.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at com.azure.storage.blob.BlobContainerClient.exists(BlobContainerClient.java:211) ~[azure-storage-blob-12.12.0.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.destination.azure_blob_storage.AzureBlobStorageConnectionChecker.initTestContainerAndBlob(AzureBlobStorageConnectionChecker.java:63) ~[io.airbyte.airbyte-integrations.connectors-destination-azure-blob-storage-0.35.27-alpha.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.destination.azure_blob_storage.AzureBlobStorageConnectionChecker.attemptWriteAndDelete(AzureBlobStorageConnectionChecker.java:50) ~[io.airbyte.airbyte-integrations.connectors-destination-azure-blob-storage-0.35.27-alpha.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.destination.azure_blob_storage.AzureBlobStorageDestination.check(AzureBlobStorageDestination.java:35) [io.airbyte.airbyte-integrations.connectors-destination-azure-blob-storage-0.35.27-alpha.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:122) [io.airbyte.airbyte-integrations.bases-base-java-0.35.27-alpha.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:89) [io.airbyte.airbyte-integrations.bases-base-java-0.35.27-alpha.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.destination.azure_blob_storage.AzureBlobStorageDestination.main(AzureBlobStorageDestination.java:27) [io.airbyte.airbyte-integrations.connectors-destination-azure-blob-storage-0.35.27-alpha.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	Suppressed: java.lang.Exception: #block terminated with an error
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 		at reactor.core.publisher.BlockingSingleSubscriber.blockingGet(BlockingSingleSubscriber.java:99) ~[reactor-core-3.4.6.jar:3.4.6]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 		at reactor.core.publisher.Mono.block(Mono.java:1703) ~[reactor-core-3.4.6.jar:3.4.6]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 		at com.azure.storage.common.implementation.StorageImplUtils.blockWithOptionalTimeout(StorageImplUtils.java:128) ~[azure-storage-common-12.12.0.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 		at com.azure.storage.blob.BlobContainerClient.existsWithResponse(BlobContainerClient.java:228) ~[azure-storage-blob-12.12.0.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 		at com.azure.storage.blob.BlobContainerClient.exists(BlobContainerClient.java:211) ~[azure-storage-blob-12.12.0.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 		at io.airbyte.integrations.destination.azure_blob_storage.AzureBlobStorageConnectionChecker.initTestContainerAndBlob(AzureBlobStorageConnectionChecker.java:63) ~[io.airbyte.airbyte-integrations.connectors-destination-azure-blob-storage-0.35.27-alpha.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 		at io.airbyte.integrations.destination.azure_blob_storage.AzureBlobStorageConnectionChecker.attemptWriteAndDelete(AzureBlobStorageConnectionChecker.java:50) ~[io.airbyte.airbyte-integrations.connectors-destination-azure-blob-storage-0.35.27-alpha.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 		at io.airbyte.integrations.destination.azure_blob_storage.AzureBlobStorageDestination.check(AzureBlobStorageDestination.java:35) [io.airbyte.airbyte-integrations.connectors-destination-azure-blob-storage-0.35.27-alpha.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 		at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:122) [io.airbyte.airbyte-integrations.bases-base-java-0.35.27-alpha.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 		at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:89) [io.airbyte.airbyte-integrations.bases-base-java-0.35.27-alpha.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 		at io.airbyte.integrations.destination.azure_blob_storage.AzureBlobStorageDestination.main(AzureBlobStorageDestination.java:27) [io.airbyte.airbyte-integrations.connectors-destination-azure-blob-storage-0.35.27-alpha.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - Caused by: java.net.UnknownHostException: failed to resolve 'XXXXXX.blob.core.windows.net' after 2 queries 
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsResolveContext.finishResolve(DnsResolveContext.java:1013) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsResolveContext.tryToFinishResolve(DnsResolveContext.java:966) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsResolveContext.query(DnsResolveContext.java:414) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsResolveContext.access$600(DnsResolveContext.java:63) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsResolveContext$2.operationComplete(DnsResolveContext.java:463) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:578) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:571) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:550) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:491) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:616) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:609) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:117) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsQueryContext.tryFailure(DnsQueryContext.java:225) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsQueryContext.onQueryWriteCompletion(DnsQueryContext.java:162) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsQueryContext.access$200(DnsQueryContext.java:42) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsQueryContext$3.operationComplete(DnsQueryContext.java:154) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsQueryContext$3.operationComplete(DnsQueryContext.java:151) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:578) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:552) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:491) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:616) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:609) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:117) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.internal.PromiseNotificationUtil.tryFailure(PromiseNotificationUtil.java:64) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.ChannelOutboundBuffer.safeFail(ChannelOutboundBuffer.java:723) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.ChannelOutboundBuffer.remove0(ChannelOutboundBuffer.java:308) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.ChannelOutboundBuffer.remove(ChannelOutboundBuffer.java:288) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.epoll.EpollDatagramChannel.doWrite(EpollDatagramChannel.java:353) ~[netty-transport-native-epoll-4.1.65.Final-linux-x86_64.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.AbstractChannel$AbstractUnsafe.flush0(AbstractChannel.java:953) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.flush0(AbstractEpollChannel.java:557) ~[netty-transport-native-epoll-4.1.65.Final-linux-x86_64.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.AbstractChannel$AbstractUnsafe.flush(AbstractChannel.java:917) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.DefaultChannelPipeline$HeadContext.flush(DefaultChannelPipeline.java:1372) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.AbstractChannelHandlerContext.invokeFlush0(AbstractChannelHandlerContext.java:750) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.AbstractChannelHandlerContext.invokeFlush(AbstractChannelHandlerContext.java:742) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.AbstractChannelHandlerContext.flush(AbstractChannelHandlerContext.java:728) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.DefaultChannelPipeline.flush(DefaultChannelPipeline.java:967) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.AbstractChannel.flush(AbstractChannel.java:254) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsNameResolver.flushQueries(DnsNameResolver.java:1207) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsResolveContext.internalResolve(DnsResolveContext.java:357) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsResolveContext.resolve(DnsResolveContext.java:211) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsNameResolver.doResolveAllUncached0(DnsNameResolver.java:1108) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsNameResolver.access$600(DnsNameResolver.java:90) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsNameResolver$6.run(DnsNameResolver.java:1087) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:384) ~[netty-transport-native-epoll-4.1.65.Final-linux-x86_64.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at java.lang.Thread.run(Thread.java:833) ~[?:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - Caused by: io.netty.resolver.dns.DnsNameResolverException: [/[2001:4860:4860:0:0:0:0:8844]:53] failed to send a query via UDP (no stack trace available)
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - Caused by: io.netty.channel.unix.Errors$NativeIoException: sendToAddress(..) failed: Network is unreachable
2022-04-07 19:37:33 e[32mINFOe[m i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling...

logs-ab9683ad-331d-4edb-94af-655cb3e8a5dd.txt (22.6 KB)

nbl22 · April 12, 2022, 3:01am

So I noticed this is throwing an error related to DNS. I’m running a DNS server from another Docker container and perhaps there is some issue with the way I have Airbyte configured for my environment? I did a straight pull from the Airbyte github docker repo and did not modify anything before using docker-compose to spin up the containers. I am able to hit the PokeAPI as a test but not the Azure Storage Account.

nbl22 · April 12, 2022, 3:55am

I am, however, also seeing these lines in the output when I keep the “docker-compose up” terminal open, so I’m not totally sure.

airbyte-worker      | 2022-04-12 03:53:43 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Class path contains multiple SLF4J bindings.
airbyte-worker      | 2022-04-12 03:53:43 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
airbyte-worker      | 2022-04-12 03:53:43 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
airbyte-worker      | 2022-04-12 03:53:43 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
airbyte-worker      | 2022-04-12 03:53:43 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]

nbl22 · April 13, 2022, 4:02am

So I believe the issue was with the host machine’s DNS settings or lack thereof. I tracked down the netplan config file where my ethernet adapter settings were specified (/etc/netplan/*.yml) and there were no entries for nameservers. I updated the file to specify my router IP address as the DNS server which is set up to forward DNS requests back to the the docker host so the container hosting the DNS server can resolve the requests.

/etc/netplan/*.yml

network:
    ethernets:
        enp2s0:
            addresses: []
            dhcp4: true
            nameservers:
                addresses: [192.168.1.1]
    version: 2

I also added the DNS entry to the docker daemon.json

/etc/docker/daemon.json

{
   "dns": [ "192.168.1.1" ]
}

then I restarted the docker service

sudo systemctl restart docker

I’m not sure which of these updates fixed the issue but requests seem to be getting resolved correctly!

marcosmarxm · May 2, 2022, 11:24pm

Sorry the long delay to reply you @nbl22 did you solve the issue? Need any assistance here?

marcosmarxm · July 13, 2022, 12:00am

Hi there from the Community Assistance team.
We’re letting you know about an issue we discovered with the back-end process we use to handle topics and responses on the forum. If you experienced a situation where you posted the last message in a topic that did not receive any further replies, please open a new topic to continue the discussion. In addition, if you’re having a problem and find a closed topic on the subject, go ahead and open a new topic on it and we’ll follow up with you. We apologize for the inconvenience, and appreciate your willingness to work with us to provide a supportive community.

Topic		Replies	Views
Issues connecting to Azure Synapse Connector Questions & Issues connectors	5	854	October 21, 2022
Unknown error occurred while setting up connection 0.40.27 Connector Questions & Issues docker , connectors	2	551	January 12, 2023
Unable to get image error Connector Questions & Issues docker , getting-started , connectors	18	4517	January 5, 2023
Unclear Error Message Connector Questions & Issues data-loading	3	221	July 20, 2022
Airbyte error on startup with docker-compose Platform, Deploy & Infra Issues deploy	3	1589	January 4, 2023

Azure Storage Account inaccessible - Failed to resolve URL after 2 queries

Related topics