Summary
The user is trying to upload multiple CSV files to a Redshift database using the File connector. They have successfully uploaded a single file but are facing issues when trying to transfer 3 files daily from their S3 bucket. They tried using the S3 connector with CSV configuration but encountered file layout issues not present when using the File connector.
Question
Can I use the File connector (CSV, JSON, Excel, Feather, Parquet) to upload a set of 3 CSV files to a Redshift database?
Uploading a single file worked for me, but I need to transfer 3 files daily, which are stored in my S3 bucket.
I tried using the S3 connector by adding the CSV configuration, but it seems the component is slightly different, and I’m facing file layout issues that I don’t encounter when using the File connector.
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.