Failed to fetch schema in MongoDB Datasource

  • Is this your first time deploying Airbyte?: Yes
  • Memory / Disk: you can use something like 16Gb / 25 Gb and 6 vCPU
  • Deployment: Docker on Local Mac M1 Macbook pro
  • Airbyte Version: 0.39.21-alpha
  • Source name/version: Mongodb 0.1.15
  • Destination name/version: Redshift 0.3.10
  • Step: The issue is happening during sync
  • Description: Remove this with the description of your problem.

Hello everyone,

So I’m trying to ingest from mongodb datasource and when I try to sync the error show related to fetch schema.

airbyte-worker | 2022-06-20 22:11:47 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 22:11:47 ERROR i.a.i.b.AirbyteExceptionHandler(uncaughtException):26 - Something went wrong in the connector. See the logs for more details.
airbyte-worker | 2022-06-20 22:11:47 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - com.mongodb.MongoCommandException: Command failed with error 148 (ReadConcernMajorityNotEnabled): ‘Majority read concern requested, but server was not started with --enableMajorityReadConcern.’ on server 54.212.76.103:27017. The full response is {“ok”: 0.0, “errmsg”: “Majority read concern requested, but server was not started with --enableMajorityReadConcern.”, “code”: 148, “codeName”: “ReadConcernMajorityNotEnabled”}

Im really dont know what is the problem, Im using for example panoply.io and I dont have any configuration additional in the source.

error.log (96.3 KB)

Thanks a lot for your help !

Hey could ou check the resources (CPU/RAM) if there a peak could you increase them and try again?

Hi @harshith this is my actual configuration in docker

Do you think I need another configuration?

Yeah could you increase the resources and try again. For reference: https://docs.airbyte.com/operator-guides/scaling-airbyte

Perfect, Im going to increase with this new configuration

Sure let us know if you see the same error again