Hi, I am quite new to Airbyte and I appreciate any pointers.
For my project, I’m currently developing a CleverTap source connector. For my implementation, I’m only reading from CleverTap API to get events in raw json format. Since my target destination only take in events instead of tables, I’m having trouble setting up transformation for the data (raw json) coming in.
My current solution is only to expose a few config options for users to fill in and modify certain field names. I implemented this in my source connector. But by doing this, it won’t have the scalability if users want to modify 20 fields.
My question is how would you suggest approaching transformation/normalization for this event-based connectors like this?
Thank you for your time!