We want to understand whether Airbyte is the right fit for our infrastructure. Currently, we are using singer with a custom scheduler.
I’m trying to develop Airbyte destination that can do the following:
- Access JSON Schema of any incoming data, and convert it into Avro Schema
- Make requests to our API to make metadata checking
- Convert incoming data into Avro Record from Avro Schema in the first step
- Send Avro Record to our API
The question is, can I develop this destination in Java? Or do I need to use Python CDK? Our project is built in Java so it’s preferable.