Troubleshooting Datadog integration with Airbyte deployment using Helm and GCS instead of Minio

Slack Knowledge Base Q&A Connector Questions
, , , ,
1

Summary

The user is facing issues with the Datadog integration on their Airbyte deployment using Helm with GCS instead of Minio. They are not seeing job-specific metrics and encountering a warning related to missing stats for a job and attempt.


Question

Hi guys, we’re trying to get the datadog integration working on our airbyte deployment. We’re currently using argocd to deploy so it’s doing a helm template before applying which has led to some issues. We’re seing some metrcis, but not job specific ones. We’re using gcs instead of minio so i’m not sure if there’s additonal configs

2024-11-14 21:39:52 WARN i.a.c.s.h.h.StatsAggregationHelper(hydrateWithStats):150 - Missing stats for job 2187 attempt 0

Also we’re on the 1.1.0 version of the helm chart.

Any help or pointing in the right direction would be awesome


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["datadog-integration", "airbyte-deployment", "helm", "gcs", "minio", "metrics", "warning", "job-specific", "1.1.0"]
2

We’re also noticing that the metrics-server is giving out these warning errors, but i’m not sure what it’d be hoping to find at localhost

2024-11-14 23:09:19 WARN i.m.s.r.u.Loggers$Slf4JLogger(warn):299 - [8722bf60, L:/127.0.0.1:47731 - R:localhost/127.0.0.1:8125] An exception has been observed post termination, use DEBUG level to see the full stack: java.net.PortUnreachableException: recvAddress(..) failed: Connection refused

3

<@U081F8QD6BS> did you find a solution to this problem?

4

<@U07DH2PNA11> not yet, still seeing this error even after setting our metrics to be datadog. I reached out and created this issue on github. Since I think the major issue might be on the server

https://github.com/airbytehq/airbyte/issues/48503#issuecomment-2483989283