Abraham Elmahrek created HADOOP-10056:
-----------------------------------------
Summary: MiniMRClientClusterFactory in Hadoop 1.x forces local mode
Key: HADOOP-10056
URL: https://issues.apache.org/jira/browse/HADOOP-10056
Project: Hadoop Common
Issue Type: Bug
Affects Versions: 1.0.4
Reporter: Abraham Elmahrek
Noticed the following in the 1.x branches:
{code}
public class MiniMRClientClusterFactory {
public static MiniMRClientCluster create(Class<?> caller, int noOfNMs,
Configuration conf) throws IOException {
FileSystem fs = FileSystem.getLocal(new Configuration());
MiniMRCluster miniMRCluster = new MiniMRCluster(noOfNMs, fs.getUri()
.toString(), 1);
return new MiniMRClusterAdapter(miniMRCluster);
}
}
{code}
The 2.x branches allow you to set what hadoop configuration to use (and which
DFS cluster to connect to). For instance, in the Sqoop project we are using the
MiniDFSCluster in conjunction with the MiniMRCluster.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
