Azure Storage Account inaccessible - Failed to resolve URL after 2 queries

  • Is this your first time deploying Airbyte?: Yes
  • OS Version / Instance: Ubuntu/docker
  • Memory / Disk: 16GB
  • Deployment: Docker
  • Airbyte Version: 0.35.64-alpha
  • Source name/version:
  • Destination name/version: Azure Blob Storage 0.1.3
  • Step: Creating the connection
  • Description: I’m trying out airbyte using the docker repo and trying to land some data into an Azure storage account. I’m getting the following error when trying to set up the destination. I’ve confirmed the storage account is accessible from a different computer on the same network, so the storage account should be accessible. Not sure how else to troubleshoot this issue.

Caused by: java.net.UnknownHostException: failed to resolve ‘XXXXX.blob.core.windows.net’ after 2 queries

Full log:

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.channel.AbstractChannelHandlerContext.invokeFlush(AbstractChannelHandlerContext.java:742) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.channel.AbstractChannelHandlerContext.flush(AbstractChannelHandlerContext.java:728) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.channel.DefaultChannelPipeline.flush(DefaultChannelPipeline.java:967) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.channel.AbstractChannel.flush(AbstractChannel.java:254) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.resolver.dns.DnsNameResolver.flushQueries(DnsNameResolver.java:1207) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.resolver.dns.DnsResolveContext.internalResolve(DnsResolveContext.java:357) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.resolver.dns.DnsResolveContext.resolve(DnsResolveContext.java:211) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.resolver.dns.DnsNameResolver.doResolveAllUncached0(DnsNameResolver.java:1108) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.resolver.dns.DnsNameResolver.access$600(DnsNameResolver.java:90) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.resolver.dns.DnsNameResolver$6.run(DnsNameResolver.java:1087) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:384) ~[netty-transport-native-epoll-4.1.65.Final-linux-x86_64.jar:4.1.65.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - at java.lang.Thread.run(Thread.java:833) ~[?:?]

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - Caused by: io.netty.resolver.dns.DnsNameResolverException: [/[2001:4860:4860:0:0:0:0:8844]:53] failed to send a query via UDP (no stack trace available)

2022-04-07 17:55:28 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - Caused by: io.netty.channel.unix.Errors$NativeIoException: sendToAddress(..) failed: Network is unreachable

2022-04-07 17:55:28 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling...

@nbl22 please upload the log file

Attached and output here. Thanks!

2022-04-07 19:36:43 e[32mINFOe[m i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/4148e1c0-f45c-4afa-a96f-829492bf7c2f/0/logs.log
2022-04-07 19:36:43 e[32mINFOe[m i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.35.64-alpha
2022-04-07 19:36:43 e[32mINFOe[m i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-azure-blob-storage:0.1.3 exists...
2022-04-07 19:36:43 e[32mINFOe[m i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-azure-blob-storage:0.1.3 was found locally.
2022-04-07 19:36:43 e[32mINFOe[m i.a.w.p.DockerProcessFactory(create):106 - Creating docker job ID: 4148e1c0-f45c-4afa-a96f-829492bf7c2f
2022-04-07 19:36:43 e[32mINFOe[m i.a.w.p.DockerProcessFactory(create):158 - Preparing command: docker run --rm --init -i -w /data/4148e1c0-f45c-4afa-a96f-829492bf7c2f/0 --log-driver none --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-azure-blob-storage:0.1.3 -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.35.64-alpha -e WORKER_JOB_ID=4148e1c0-f45c-4afa-a96f-829492bf7c2f airbyte/destination-azure-blob-storage:0.1.3 check --config source_config.json
2022-04-07 19:36:44 e[1;31mERRORe[m i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Class path contains multiple SLF4J bindings.
2022-04-07 19:36:44 e[1;31mERRORe[m i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-04-07 19:36:44 e[1;31mERRORe[m i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-04-07 19:36:44 e[1;31mERRORe[m i.a.c.i.LineGobbler(voidCall):82 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2022-04-07 19:36:44 e[1;31mERRORe[m i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2022-04-07 19:36:45 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-04-07 19:36:45 e[32mINFOe[m i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json}
2022-04-07 19:36:45 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-04-07 19:36:45 e[32mINFOe[m i.a.i.b.IntegrationRunner(runInternal):105 - Running integration: io.airbyte.integrations.destination.azure_blob_storage.AzureBlobStorageDestination
2022-04-07 19:36:45 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-04-07 19:36:45 e[32mINFOe[m i.a.i.b.IntegrationRunner(runInternal):106 - Command: CHECK
2022-04-07 19:36:45 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-04-07 19:36:45 e[32mINFOe[m i.a.i.b.IntegrationRunner(runInternal):107 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'}
2022-04-07 19:36:46 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-04-07 19:36:46 e[33mWARNe[m c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-04-07 19:36:46 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-04-07 19:36:46 e[33mWARNe[m c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-04-07 19:36:46 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-04-07 19:36:46 e[32mINFOe[m i.a.i.d.a.AzureBlobStorageFormatConfigs(getAzureBlobStorageFormatConfig):21 - Azure Blob Storage format config: {"format_type":"CSV","flattening":"No flattening"}
2022-04-07 19:36:48 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-04-07 19:36:48 e[33mWARNe[m i.n.r.d.DefaultDnsServerAddressStreamProvider(<clinit>):101 - Default DNS servers: [/[2001:4860:4860:0:0:0:0:8888]:53, /[2001:4860:4860:0:0:0:0:8844]:53] (Google Public DNS as a fallback)
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-04-07 19:37:32 e[1;31mERRORe[m i.a.i.d.a.AzureBlobStorageDestination(check):38 - Exception attempting to access the azure blob storage bucket: 
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - reactor.core.Exceptions$ReactiveException: java.net.UnknownHostException: failed to resolve 'XXXXXX.blob.core.windows.net' after 2 queries 
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at reactor.core.Exceptions.propagate(Exceptions.java:392) ~[reactor-core-3.4.6.jar:3.4.6]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at reactor.core.publisher.BlockingSingleSubscriber.blockingGet(BlockingSingleSubscriber.java:97) ~[reactor-core-3.4.6.jar:3.4.6]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at reactor.core.publisher.Mono.block(Mono.java:1703) ~[reactor-core-3.4.6.jar:3.4.6]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at com.azure.storage.common.implementation.StorageImplUtils.blockWithOptionalTimeout(StorageImplUtils.java:128) ~[azure-storage-common-12.12.0.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at com.azure.storage.blob.BlobContainerClient.existsWithResponse(BlobContainerClient.java:228) ~[azure-storage-blob-12.12.0.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at com.azure.storage.blob.BlobContainerClient.exists(BlobContainerClient.java:211) ~[azure-storage-blob-12.12.0.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.destination.azure_blob_storage.AzureBlobStorageConnectionChecker.initTestContainerAndBlob(AzureBlobStorageConnectionChecker.java:63) ~[io.airbyte.airbyte-integrations.connectors-destination-azure-blob-storage-0.35.27-alpha.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.destination.azure_blob_storage.AzureBlobStorageConnectionChecker.attemptWriteAndDelete(AzureBlobStorageConnectionChecker.java:50) ~[io.airbyte.airbyte-integrations.connectors-destination-azure-blob-storage-0.35.27-alpha.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.destination.azure_blob_storage.AzureBlobStorageDestination.check(AzureBlobStorageDestination.java:35) [io.airbyte.airbyte-integrations.connectors-destination-azure-blob-storage-0.35.27-alpha.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:122) [io.airbyte.airbyte-integrations.bases-base-java-0.35.27-alpha.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:89) [io.airbyte.airbyte-integrations.bases-base-java-0.35.27-alpha.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.destination.azure_blob_storage.AzureBlobStorageDestination.main(AzureBlobStorageDestination.java:27) [io.airbyte.airbyte-integrations.connectors-destination-azure-blob-storage-0.35.27-alpha.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	Suppressed: java.lang.Exception: #block terminated with an error
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 		at reactor.core.publisher.BlockingSingleSubscriber.blockingGet(BlockingSingleSubscriber.java:99) ~[reactor-core-3.4.6.jar:3.4.6]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 		at reactor.core.publisher.Mono.block(Mono.java:1703) ~[reactor-core-3.4.6.jar:3.4.6]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 		at com.azure.storage.common.implementation.StorageImplUtils.blockWithOptionalTimeout(StorageImplUtils.java:128) ~[azure-storage-common-12.12.0.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 		at com.azure.storage.blob.BlobContainerClient.existsWithResponse(BlobContainerClient.java:228) ~[azure-storage-blob-12.12.0.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 		at com.azure.storage.blob.BlobContainerClient.exists(BlobContainerClient.java:211) ~[azure-storage-blob-12.12.0.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 		at io.airbyte.integrations.destination.azure_blob_storage.AzureBlobStorageConnectionChecker.initTestContainerAndBlob(AzureBlobStorageConnectionChecker.java:63) ~[io.airbyte.airbyte-integrations.connectors-destination-azure-blob-storage-0.35.27-alpha.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 		at io.airbyte.integrations.destination.azure_blob_storage.AzureBlobStorageConnectionChecker.attemptWriteAndDelete(AzureBlobStorageConnectionChecker.java:50) ~[io.airbyte.airbyte-integrations.connectors-destination-azure-blob-storage-0.35.27-alpha.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 		at io.airbyte.integrations.destination.azure_blob_storage.AzureBlobStorageDestination.check(AzureBlobStorageDestination.java:35) [io.airbyte.airbyte-integrations.connectors-destination-azure-blob-storage-0.35.27-alpha.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 		at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:122) [io.airbyte.airbyte-integrations.bases-base-java-0.35.27-alpha.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 		at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:89) [io.airbyte.airbyte-integrations.bases-base-java-0.35.27-alpha.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 		at io.airbyte.integrations.destination.azure_blob_storage.AzureBlobStorageDestination.main(AzureBlobStorageDestination.java:27) [io.airbyte.airbyte-integrations.connectors-destination-azure-blob-storage-0.35.27-alpha.jar:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - Caused by: java.net.UnknownHostException: failed to resolve 'XXXXXX.blob.core.windows.net' after 2 queries 
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsResolveContext.finishResolve(DnsResolveContext.java:1013) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsResolveContext.tryToFinishResolve(DnsResolveContext.java:966) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsResolveContext.query(DnsResolveContext.java:414) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsResolveContext.access$600(DnsResolveContext.java:63) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsResolveContext$2.operationComplete(DnsResolveContext.java:463) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:578) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:571) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:550) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:491) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:616) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:609) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:117) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsQueryContext.tryFailure(DnsQueryContext.java:225) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsQueryContext.onQueryWriteCompletion(DnsQueryContext.java:162) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsQueryContext.access$200(DnsQueryContext.java:42) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsQueryContext$3.operationComplete(DnsQueryContext.java:154) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsQueryContext$3.operationComplete(DnsQueryContext.java:151) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:578) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:552) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:491) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:616) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:609) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:117) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.internal.PromiseNotificationUtil.tryFailure(PromiseNotificationUtil.java:64) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.ChannelOutboundBuffer.safeFail(ChannelOutboundBuffer.java:723) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.ChannelOutboundBuffer.remove0(ChannelOutboundBuffer.java:308) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.ChannelOutboundBuffer.remove(ChannelOutboundBuffer.java:288) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.epoll.EpollDatagramChannel.doWrite(EpollDatagramChannel.java:353) ~[netty-transport-native-epoll-4.1.65.Final-linux-x86_64.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.AbstractChannel$AbstractUnsafe.flush0(AbstractChannel.java:953) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.flush0(AbstractEpollChannel.java:557) ~[netty-transport-native-epoll-4.1.65.Final-linux-x86_64.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.AbstractChannel$AbstractUnsafe.flush(AbstractChannel.java:917) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.DefaultChannelPipeline$HeadContext.flush(DefaultChannelPipeline.java:1372) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.AbstractChannelHandlerContext.invokeFlush0(AbstractChannelHandlerContext.java:750) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.AbstractChannelHandlerContext.invokeFlush(AbstractChannelHandlerContext.java:742) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.AbstractChannelHandlerContext.flush(AbstractChannelHandlerContext.java:728) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.DefaultChannelPipeline.flush(DefaultChannelPipeline.java:967) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.AbstractChannel.flush(AbstractChannel.java:254) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsNameResolver.flushQueries(DnsNameResolver.java:1207) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsResolveContext.internalResolve(DnsResolveContext.java:357) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsResolveContext.resolve(DnsResolveContext.java:211) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsNameResolver.doResolveAllUncached0(DnsNameResolver.java:1108) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsNameResolver.access$600(DnsNameResolver.java:90) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.resolver.dns.DnsNameResolver$6.run(DnsNameResolver.java:1087) ~[netty-resolver-dns-4.1.63.Final.jar:4.1.63.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:384) ~[netty-transport-native-epoll-4.1.65.Final-linux-x86_64.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at java.lang.Thread.run(Thread.java:833) ~[?:?]
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - Caused by: io.netty.resolver.dns.DnsNameResolverException: [/[2001:4860:4860:0:0:0:0:8844]:53] failed to send a query via UDP (no stack trace available)
2022-04-07 19:37:32 e[32mINFOe[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - Caused by: io.netty.channel.unix.Errors$NativeIoException: sendToAddress(..) failed: Network is unreachable
2022-04-07 19:37:33 e[32mINFOe[m i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling...

logs-ab9683ad-331d-4edb-94af-655cb3e8a5dd.txt (22.6 KB)

So I noticed this is throwing an error related to DNS. I’m running a DNS server from another Docker container and perhaps there is some issue with the way I have Airbyte configured for my environment? I did a straight pull from the Airbyte github docker repo and did not modify anything before using docker-compose to spin up the containers. I am able to hit the PokeAPI as a test but not the Azure Storage Account.

I am, however, also seeing these lines in the output when I keep the “docker-compose up” terminal open, so I’m not totally sure.

airbyte-worker      | 2022-04-12 03:53:43 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Class path contains multiple SLF4J bindings.
airbyte-worker      | 2022-04-12 03:53:43 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
airbyte-worker      | 2022-04-12 03:53:43 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
airbyte-worker      | 2022-04-12 03:53:43 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
airbyte-worker      | 2022-04-12 03:53:43 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]

So I believe the issue was with the host machine’s DNS settings or lack thereof. I tracked down the netplan config file where my ethernet adapter settings were specified (/etc/netplan/*.yml) and there were no entries for nameservers. I updated the file to specify my router IP address as the DNS server which is set up to forward DNS requests back to the the docker host so the container hosting the DNS server can resolve the requests.

/etc/netplan/*.yml

network:
    ethernets:
        enp2s0:
            addresses: []
            dhcp4: true
            nameservers:
                addresses: [192.168.1.1]
    version: 2

I also added the DNS entry to the docker daemon.json

/etc/docker/daemon.json

{
   "dns": [ "192.168.1.1" ]
}

then I restarted the docker service

sudo systemctl restart docker

I’m not sure which of these updates fixed the issue but requests seem to be getting resolved correctly!

Sorry the long delay to reply you @nbl22 did you solve the issue? Need any assistance here?