Alternative authentication to AWS access key for connections

Hello all,

Sorry if this is the wrong place to post this, but please feel free to redirect me.

We are planning on having a large number of connections from S3 to PostgreSQL. However, each source needs to be configured with an AWS access key ID and AWS secret access key. This could be complicated because if the keys were to change, we would need to edit every single connection.

Is there an alternative for authentication, such as through an IAM role?

Thank you in advance!

Hey @aobied,
This is a great question. We received a contribution a few months ago to support multiple authentication mechanisms for the S3 connector. Unfortunately, the PR did not make it to the finish line. Feel free to take it over and open a new one if you are ready for some python work.
I’m going to reach out to our connector team to check if this is on our roadmap.
An alternative I could suggest to manage multiple similar connections would be to use our CLI connections with the convenience of a script.