Mark J Greene created HADOOP-10494:
--------------------------------------

             Summary: Ensure Jets3tFileSystemStore respects URI path for block 
files
                 Key: HADOOP-10494
                 URL: https://issues.apache.org/jira/browse/HADOOP-10494
             Project: Hadoop Common
          Issue Type: Improvement
          Components: fs
            Reporter: Mark J Greene
            Priority: Trivial


The Jets3tFileSystemStore will currently store all block files in the root of 
an S3 bucket. If you specify a path in your OutputFormat, those paths are 
created, and some of the supporting meta files are stored there, but all block 
files will reside in the root of the bucket.

We tracked this down to this method here, which does not use the provided URI 
from the the job: 
https://github.com/apache/hadoop-common/blob/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/s3/Jets3tFileSystemStore.java#L381





--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to