Error synchronizing data from Netsuite to Redshift

Summary

Encountered an error while trying to synchronize data from Netsuite to Redshift using Airbyte Cloud. The error message indicates a failure to find output files from the connector within a timeout period.


Question

Hello everyone,

We want to synchronise data from Netsuite to redshift but I hit the following error while trying the airbyte cloud option :

2024-07-11 13:44:58 INFO i.a.c.i.LineGobbler(voidCall):165 -
2024-07-11 13:44:49 INFO i.a.w.l.c.WorkloadApiClient(claim):76 - Claimed: true for 4f2f093d-ce44-4121-8118-9d13b7bfccd0_438ee4cd-7d7e-458b-8eae-069d27cf6e02_0_discover via API for prod-dataplane-gcp-us-west3-0
2024-07-11 13:44:49 INFO i.a.w.l.p.s.m.Stage(apply):39 - APPLY Stage: CHECK_STATUS — (workloadId = 4f2f093d-ce44-4121-8118-9d13b7bfccd0_438ee4cd-7d7e-458b-8eae-069d27cf6e02_0_discover) — (dataplaneId = prod-dataplane-gcp-us-west3-0)
2024-07-11 13:44:49 INFO i.a.w.l.p.s.CheckStatusStage(applyStage):59 - No pod found running for workload 4f2f093d-ce44-4121-8118-9d13b7bfccd0_438ee4cd-7d7e-458b-8eae-069d27cf6e02_0_discover
2024-07-11 13:44:49 INFO i.a.w.l.p.s.m.Stage(apply):39 - APPLY Stage: BUILD — (workloadId = 4f2f093d-ce44-4121-8118-9d13b7bfccd0_438ee4cd-7d7e-458b-8eae-069d27cf6e02_0_discover) — (dataplaneId = prod-dataplane-gcp-us-west3-0)
2024-07-11 13:44:50 INFO i.a.w.l.p.s.m.Stage(apply):39 - APPLY Stage: MUTEX — (workloadId = 4f2f093d-ce44-4121-8118-9d13b7bfccd0_438ee4cd-7d7e-458b-8eae-069d27cf6e02_0_discover) — (dataplaneId = prod-dataplane-gcp-us-west3-0)
2024-07-11 13:44:50 INFO i.a.w.l.p.s.EnforceMutexStage(applyStage):50 - No mutex key specified for workload: 4f2f093d-ce44-4121-8118-9d13b7bfccd0_438ee4cd-7d7e-458b-8eae-069d27cf6e02_0_discover. Continuing...
2024-07-11 13:44:50 INFO i.a.w.l.p.s.m.Stage(apply):39 - APPLY Stage: LAUNCH — (workloadId = 4f2f093d-ce44-4121-8118-9d13b7bfccd0_438ee4cd-7d7e-458b-8eae-069d27cf6e02_0_discover) — (dataplaneId = prod-dataplane-gcp-us-west3-0)
2024-07-11 13:44:54 INFO i.a.w.l.c.WorkloadApiClient(updateStatusToLaunched):61 - Attempting to update workload: 4f2f093d-ce44-4121-8118-9d13b7bfccd0_438ee4cd-7d7e-458b-8eae-069d27cf6e02_0_discover to LAUNCHED.
2024-07-11 13:44:54 INFO i.a.w.l.p.h.SuccessHandler(accept):60 - Pipeline completed for workload: 4f2f093d-ce44-4121-8118-9d13b7bfccd0_438ee4cd-7d7e-458b-8eae-069d27cf6e02_0_discover.
2024-07-11 13:44:58 INFO i.a.c.i.LineGobbler(voidCall):165 - ----- START DISCOVER -----
2024-07-11 13:44:58 INFO i.a.c.i.LineGobbler(voidCall):165 -
2024-07-11 13:53:58 WARN i.a.c.ConnectorWatcher(run):69 - Failed to find output files from connector within timeout 9. Is the connector still running?
2024-07-11 13:53:58 INFO i.a.c.ConnectorWatcher(failWorkload):262 - Failing workload 4f2f093d-ce44-4121-8118-9d13b7bfccd0_438ee4cd-7d7e-458b-8eae-069d27cf6e02_0_discover.
2024-07-11 13:53:59 INFO i.a.c.ConnectorWatcher(exitFileNotFound):193 - Deliberately exiting process with code 2.```
Is anyone aware of this issue ?
Thanks in advance :pray:

<br>

---

This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C021JANJ6TY/p1720706888259659) if you want 
to access the original thread.

[Join the conversation on Slack](https://slack.airbyte.com)

<sub>
["error", "synchronize-data", "netsuite", "redshift", "airbyte-cloud", "connector", "output-files", "timeout"]
</sub>