Ash Berlin-Taylor created AIRFLOW-3291:
------------------------------------------

             Summary: Update S3KeySensor to not need s3:GetObject permissions
                 Key: AIRFLOW-3291
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-3291
             Project: Apache Airflow
          Issue Type: Improvement
            Reporter: Ash Berlin-Taylor


The S3KeySensor/S3Hook as it is currently written requires {{s3:GetObject}} 
permissions on the bucket (as it does a HeadObject API call) - it would be nice 
if it could use ListBucket instead as for our use case we don't really want 
Airflow reading the files as EMR does that for us.

This would be doable by changing the implemention of check_key_exists and 
check_wildcard_exists(?) to use list instead/only and not try to load the Key 
object.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to