When using airbyte to read csv files on s3 bucket into snowflake, am having following error : source > CSV parse error: Expected 10 columns, got 12
The problem is due to some rows having only 1 quote "
Is it possible to make airbyte ignore the quote " so it can successfully load?
I have tried replacing all quotes for empty space and it loaded successfully, but the problem is that, I have hundreds of files with this " issue, so won’t be possible to do it manually for each one
Hey @epalmeira,
Do you mind sharing a sample of your CSV file?
I think you could maybe overcome your problem by tweaking the double quote setting in the source connector. Also, feel free to check the available parameters here that you can pass to the Additional Reader Options (such as quoted_strings_can_be_null or include_columns).
Hey Augustin,
I have created a sample to share here. Thanks for the support (consider the file is .csv, i was not able to upload it as csv so converted it into txt)
sample_airbyte.txt (221 Bytes)
Hi there from the Community Assistance team.
We’re letting you know about an issue we discovered with the back-end process we use to handle topics and responses on the forum. If you experienced a situation where you posted the last message in a topic that did not receive any further replies, please open a new topic to continue the discussion. In addition, if you’re having a problem and find a closed topic on the subject, go ahead and open a new topic on it and we’ll follow up with you. We apologize for the inconvenience, and appreciate your willingness to work with us to provide a supportive community.
