Setting up Amazon S3 Source with files moved to Glacier storage class

Summary

When setting up a new Amazon S3 Source, encountering an error due to files being moved to Glacier storage class. User wants to skip these files and continue setting up the source.


Question

Hi! I’m trying to set up a new Amazon S3 Source but some of the files that match my pattern seem to have been moved to Glacier storage class so I’m getting
An error occurred (InvalidObjectState) when calling the GetObject operation: The operation is not valid for the object's storage class")
I am fine for the source to skip these files, but I can’t figure out how to get it to automatically skip these files and still let me set up the source. Thanks in advance for any help with this!



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.

Join the conversation on Slack

["amazon-s3-source", "glacier-storage-class", "skip-files"]