Summary
The user is facing an issue with the newer version of Airbyte where the raw data option for normalization is missing, causing their connector to not work. They are seeking a solution for this problem.
Question
I have an older version of airbyte in prod: 0.42 which provides me raw data option on normalization inside transformation tab, the newer version don’t has this option, but also my connector wont work without this option, how can i solve this?
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.
Join the conversation on Slack
["older-version", "newer-version", "raw-data-option", "normalization", "connector"]
On the Destination, under Advanced, there’s an option for Disable Final Tables which I believe will do what you want. You then access the raw (note: non-deduplicated, you need to do this yourself!) tables under airbyte_internal (or whatever you’ve renamed the raw table dataset name to—and I would recommend renaming it if you’re disabling final tables).
You can see some notes on the schema https://docs.airbyte.com/using-airbyte/core-concepts/typing-deduping#raw-destination-table-name-airbyte_internalraw_public__users-airbyte_internalraw_namespace__stream|here, but the main thing you’re probably interested in is _airbyte_data which is where the raw JSON lives.
Thanks for the info Justin!