Main thread is existing with active children non-daemon threads

  • Is this your first time deploying Airbyte: No
  • OS Version / Instance: EC2 m5.4xlarge
  • Memory / Disk: 64Gb / EFS
  • Deployment: Docker
  • Airbyte Version: 0.35.64-alpha
  • Source name/version: SurveyMonkey (0.1.7)
  • Destination name/version: Snowflake (0.4.24)
  • Step: On Sync
  • Description: main thread is exiting while children non-daemon threads from a connector are still active

Looking to confirm if this is a concerning error as our Airbyte instance crashes infrequently and often after connecting survey monkey / troubleshooting this connector.

logs-15012.txt (43.1 KB)

@danieldiamond this repeats every time you run the connection?

yes. Response stream is set to incremental. The two subsequent syncs (pulling one response), both syncs show this error

This is a warning some threads didn’t finished in the right time. The sync is finishing properly or is failing? You’re the first reporting this exception so far, but I’ll ask the connector team to see if we can identify the root cause of it.

The sync completes successfully but appear to be missing records

Sorry the long delay @danieldiamond.
Do you have a number comparison between the missing records 5%, 10 from 1000 records?