I have a Linux machine where I do not run namenode or tasktracker but
I have hadoop installed. I use this machine to submit jobs to the
cluster. I see that the moment I put /etc/hosts entry for my-namenode,
I get the following error:
foss...@cave:~/mcr-wordcount$ hadoop jar dist/mcr-wordcount-0.1.jar
com.fossist.examples.WordCountJob /fossist/inputs /fossist/output25
09/04/05 17:30:11 WARN mapred.JobClient: Use GenericOptionsParser for
parsing the arguments. Applications should implement Tool for the
same.
java.lang.IllegalArgumentException: Wrong FS:
hdfs://192.168.1.2:9000/tmp/hadoop-hadoop/mapred/system/job_200904042051_0032,
expected: hdfs://my-namenode:9000
at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:322)
at
org.apache.hadoop.hdfs.DistributedFileSystem.checkPath(DistributedFileSystem.java:92)
at
org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:148)
at
org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:222)
at
org.apache.hadoop.mapred.JobClient.configureCommandLineOptions(JobClient.java:605)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:788)
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1142)
at in.fossist.examples.WordCountJob.main(Unknown Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:165)
at org.apache.hadoop.mapred.JobShell.run(JobShell.java:54)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.mapred.JobShell.main(JobShell.java:68)
Since, I can not put the /etc/hosts mapping, I am unable to use the
Jetty pages of namenode and jobtracker as they often point to URLs
with domain names instead of IP addresses. Please help me in resolving
this issue.