Summary
The user is facing issues with the MongoDB source connector while trying to connect to a MongoDB Atlas Sharded Cluster. The latest version only supports replica set, while an older version that supports sharded cluster is throwing an error related to ‘allowDiskUse: true’ option.
Question
Hi All, Has anyone here successfully used mongodb source connector with MongoDB Atlas Sharded Cluster? Did some testing and attempted to use. But the latest version (1.2.15) doesn’t work with sharded cluster - only supports replica set. While the older version (0.2.5) can work with sharded cluster but getting the following error but I don’t know how to pass option ‘allowDiskUse: true’
“AirbyteExceptionHandler(uncaughtException):26 Something went wrong in the connector. See the logs for more details. com.mongodb.MongoCommandException: Command failed with error 292 (QueryExceededMemoryLimitNoDiskUseAllowed): ‘PlanExecutor error during aggregation :: caused by :: Sort exceeded memory limit of 104857600 bytes, but did not opt in to external sorting.’'”
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.