Ash Berlin-Taylor created AIRFLOW-3291:
------------------------------------------
Summary: Update S3KeySensor to not need s3:GetObject permissions
Key: AIRFLOW-3291
URL: https://issues.apache.org/jira/browse/AIRFLOW-3291
Project: Apache Airflow
Issue Type: Improvement
Reporter: Ash Berlin-Taylor
The S3KeySensor/S3Hook as it is currently written requires {{s3:GetObject}}
permissions on the bucket (as it does a HeadObject API call) - it would be nice
if it could use ListBucket instead as for our use case we don't really want
Airflow reading the files as EMR does that for us.
This would be doable by changing the implemention of check_key_exists and
check_wildcard_exists(?) to use list instead/only and not try to load the Key
object.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)