Mark J Greene created HADOOP-10494: -------------------------------------- Summary: Ensure Jets3tFileSystemStore respects URI path for block files Key: HADOOP-10494 URL: https://issues.apache.org/jira/browse/HADOOP-10494 Project: Hadoop Common Issue Type: Improvement Components: fs Reporter: Mark J Greene Priority: Trivial
The Jets3tFileSystemStore will currently store all block files in the root of an S3 bucket. If you specify a path in your OutputFormat, those paths are created, and some of the supporting meta files are stored there, but all block files will reside in the root of the bucket. We tracked this down to this method here, which does not use the provided URI from the the job: https://github.com/apache/hadoop-common/blob/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/s3/Jets3tFileSystemStore.java#L381 -- This message was sent by Atlassian JIRA (v6.2#6252)