Main thread is existing with active children non-daemon threads

  • Is this your first time deploying Airbyte: No
  • OS Version / Instance: EC2 m5.4xlarge
  • Memory / Disk: 64Gb / EFS
  • Deployment: Docker
  • Airbyte Version: 0.35.64-alpha
  • Source name/version: SurveyMonkey (0.1.7)
  • Destination name/version: Snowflake (0.4.24)
  • Step: On Sync
  • Description: main thread is exiting while children non-daemon threads from a connector are still active

Looking to confirm if this is a concerning error as our Airbyte instance crashes infrequently and often after connecting survey monkey / troubleshooting this connector.

logs-15012.txt (43.1 KB)

@danieldiamond this repeats every time you run the connection?

yes. Response stream is set to incremental. The two subsequent syncs (pulling one response), both syncs show this error

This is a warning some threads didn’t finished in the right time. The sync is finishing properly or is failing? You’re the first reporting this exception so far, but I’ll ask the connector team to see if we can identify the root cause of it.

The sync completes successfully but appear to be missing records

Sorry the long delay @danieldiamond.
Do you have a number comparison between the missing records 5%, 10 from 1000 records?

Hi there from the Community Assistance team.
We’re letting you know about an issue we discovered with the back-end process we use to handle topics and responses on the forum. If you experienced a situation where you posted the last message in a topic that did not receive any further replies, please open a new topic to continue the discussion. In addition, if you’re having a problem and find a closed topic on the subject, go ahead and open a new topic on it and we’ll follow up with you. We apologize for the inconvenience, and appreciate your willingness to work with us to provide a supportive community.