Hello all,
Sorry if this is the wrong place to post this, but please feel free to redirect me.
We are planning on having a large number of connections from S3 to PostgreSQL. However, each source needs to be configured with an AWS access key ID and AWS secret access key. This could be complicated because if the keys were to change, we would need to edit every single connection.
Is there an alternative for authentication, such as through an IAM role?
Thank you in advance!
Hey @aobied,
This is a great question. We received a contribution a few months ago to support multiple authentication mechanisms for the S3 connector. Unfortunately, the PR did not make it to the finish line. Feel free to take it over and open a new one if you are ready for some python work.
I’m going to reach out to our connector team to check if this is on our roadmap.
An alternative I could suggest to manage multiple similar connections would be to use our CLI connections with the convenience of a script.
Hi there from the Community Assistance team.
We’re letting you know about an issue we discovered with the back-end process we use to handle topics and responses on the forum. If you experienced a situation where you posted the last message in a topic that did not receive any further replies, please open a new topic to continue the discussion. In addition, if you’re having a problem and find a closed topic on the subject, go ahead and open a new topic on it and we’ll follow up with you. We apologize for the inconvenience, and appreciate your willingness to work with us to provide a supportive community.