I have created a source connector based on source-github connector.
Specifically, I am reusing schema files. Everything has been working just fine until an update to version above 0.38 (or so). I know this works just fine in 0.37.1.
So the error I get is as follows:
Additional Failure Information: java.lang.RuntimeException: com.networknt.schema.JsonSchemaException: #/properties/user/$ref: Reference user.json cannot be resolved
The primary schema file which is being used by the stream is comments.json (i’ve stripped out a few fields which are irrelevant, so this is not too big of a post) and is as follows:
{
"$schema": "http://json-schema.org/draft-07/schema#",
"type": "object",
"properties": {
"repository": {
"type": ["string"]
},
"organization": {
"type": ["null", "string"]
},
"id": {
"type": ["null", "integer"]
},
"node_id": {
"type": ["null", "string"]
},
"user": {
"$ref": "user.json"
}
}
}
user.json is sitting in subdirectory shared/ and looks like this: (I’ve stripped some fields out to make it easier to read)
{
"type": ["null", "object"],
"properties": {
"repository": {
"type": ["string"]
},
"organization": {
"type": ["null", "string"]
},
"login": {
"type": ["null", "string"]
},
"id": {
"type": ["null", "integer"]
},
"node_id": {
"type": ["null", "string"]
},
"avatar_url": {
"type": ["null", "string"]
},
"gravatar_id": {
"type": ["null", "string"]
},
"url": {
"type": ["null", "string"]
},
"html_url": {
"type": ["null", "string"]
} "type": ["null", "string"]
}
}
From the official json schema validator site:
https://json-schema.org/understanding-json-schema/structuring.html#ref
It talks about usage of $id. Your github schema files do not have $id entries. Maybe some magic is happening in the background?!
In short, I keep getting that json schema validation error and cannot run my connections.
Can someone help? It seems like a big issue.
Thank you
but I have created a separate post for the ID error.