[ https://issues.apache.org/jira/browse/HADOOP-6365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Allen Wittenauer resolved HADOOP-6365. -------------------------------------- Resolution: Fixed This looks fixed. > distributed cache doesn't work with HDFS and another file system > ---------------------------------------------------------------- > > Key: HADOOP-6365 > URL: https://issues.apache.org/jira/browse/HADOOP-6365 > Project: Hadoop Common > Issue Type: Bug > Components: filecache > Affects Versions: 0.20.1 > Environment: CentOS > Reporter: Marc Colosimo > Original Estimate: 0.5h > Remaining Estimate: 0.5h > > This is a continuation of http://issues.apache.org/jira/browse/HADOOP-5635 > (JIRA wouldn't let me edit that one). I found another issue with > DistributedCache using something besides HDFS. In my case I have TWO active > file systems, with HDFS being the default file system. > My fix includes two additional changes (from HADOOP-5635) to get it to work > with another filesystem scheme (plus the changes from the original patch). > I've tested this an it works with my code on HDFS with another filesystem. I > have similar changes to mapreduce.filecacheTaskDistributedCacheManager and > TrackerDistributedCacheManager (0.22.0). > Basically, URI.getPath() is called instead of URI.toString(). toString > returns the scheme plus path which is important in finding the file to copy > (getting the file system). Otherwise it searches the default file system (in > this case HDFS) for the file. -- This message was sent by Atlassian JIRA (v6.2#6252)