It seems like something that should work. I modified the “Namespace Custom Format” and it works. But I do not want to erase the past data nor create another table.
I’d like to know if there is something like a config file I could delete or modify to have the same effect. The spreadsheets I’m loading don’t matter that much but I do not want to erase the Zendesk data which connector has the same problem (Redshift destination).
in really you cannot revert back
because new desitnation-redshift 0.3.32 converted you table _airbyte_raw_name field _airbyte_data to redshfit SUPER type (from VARCHAR)
if you downgrade back destination-redshift you will only add some mess to your system
Given this answer I talked with my team over possible solutions. I think we are going to reset from scratch during the weekend since it’s the simpler solution.
On the airbyte_workspace:/data directory. I can give it if you still require it for something, however I would have to delete some data as I saw it has some credentials and stuff like that inside the .tar file.
if it possible to would be cool to get /data to try to understand the source of this problem.
/data contains a lot of logs related to sync and normalization.
Yes you are right /data contains credentials in destination_config.json
this file must be removed before compression of archive.