Error with Mongodb collection - Illegal base64 character

Summary

The user is experiencing an issue with a MongoDB collection where an illegal base64 character ‘2e’ is causing an IllegalArgumentException. They have tried to search for the character in the keys using a Python script but couldn’t find any. They are seeking ideas on what might be causing this.


Question

Hi all,
I’m having an issue with one of Mongodb collections, it is throwing this error
java.lang.IllegalArgumentException: Illegal base64 character 2e

the following snippet show more info

2024-08-03 04:15:37 source > ERROR main i.a.i.s.m.MongoDbSource(read):163 Unable to perform sync read operation. java.lang.IllegalArgumentException: Illegal base64 character 2e
at java.base/java.util.Base64$Decoder.decode0(Base64.java:852) ~[?:?]
at java.base/java.util.Base64$Decoder.decode(Base64.java:570) ~[?:?]
at java.base/java.util.Base64$Decoder.decode(Base64.java:593) ~[?:?]
at io.airbyte.integrations.source.mongodb.state.IdType.parseBinaryIdString(IdType.java:111) ~[io.airbyte.airbyte-integrations.connectors-source-mongodb-v2.jar:?]
at io.airbyte.integrations.source.mongodb.MongoDbInitialLoadRecordIterator.lambda$buildFilter$2(MongoDbInitialLoadRecordIterator.java:131) ~[io.airbyte.airbyte-integrations.connectors-source-mongodb-v2.jar:?]

I tried to check all documents with a python script searching for dot charachter (‘2e’) in the keys but couldn’t find any

Do you have any ideas whats happening ?



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["mongodb-collection", "illegal-base64-character", "java-exception", "python-script"]

Github Issue reporting the problem: https://github.com/airbytehq/airbyte/issues/43304

<@U07DBP5CFK7> it looks someone from the Java connector team is investigating the problem.