Just to add, I had earlier installed Hadoop using debian package manager. And then uninstalled it and reinstalled by building the source code manually. Can that lead to problems. Because I can see that as per the old installation ;
echo $HADOOP_CONF_DIR /etc/hadoop Even after uninstalling, the output is the same On Sun, Apr 29, 2012 at 1:49 AM, maddy gulati <achilles....@gmail.com>wrote: > Folks, > > I am trying to set up a single node cluster for Hadoop ( version 1.0.1) on > Ubuntu 11.04. After configuring everything, I could not get all the > components to start. > > My installation directory for hadoop is /usr/local/hadoop > I followed the following tutorial for the setup : > http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/ > Below is the snapshot of my log file: > > mandeep@mandeep-System-Product-Name:/var/log/hadoop/mandeep$ cat > hadoop-mandeep-datanode-mandeep-System-Product-Name.log > 2012-04-29 01:29:37,240 INFO > org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG: > /************************************************************ > STARTUP_MSG: Starting DataNode > STARTUP_MSG: host = mandeep-System-Product-Name/127.0.1.1 > STARTUP_MSG: args = [] > STARTUP_MSG: version = 1.0.1 > STARTUP_MSG: build = > https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r > 1243785; compiled by 'hortonfo' on Tue Feb 14 08:15:38 UTC 2012 > ************************************************************/ > 2012-04-29 01:29:37,398 INFO > org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from > hadoop-metrics2.properties > 2012-04-29 01:29:37,446 INFO > org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source > MetricsSystem,sub=Stats registered. > 2012-04-29 01:29:37,449 INFO > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot > period at 10 second(s). > 2012-04-29 01:29:37,449 INFO > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system > started > 2012-04-29 01:29:37,583 INFO > org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi > registered. > 2012-04-29 01:29:37,586 WARN > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already > exists! > 2012-04-29 01:29:37,615 INFO org.apache.hadoop.util.NativeCodeLoader: > Loaded the native-hadoop library > 2012-04-29 01:29:37,701 ERROR > org.apache.hadoop.hdfs.server.datanode.DataNode: > java.lang.IllegalArgumentException: Does not contain a valid host:port > authority: file:/// > at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:162) > at > org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.java:198) > at > org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.java:228) > at > org.apache.hadoop.hdfs.server.namenode.NameNode.getServiceAddress(NameNode.java:222) > at > org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:337) > at > org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:299) > at > org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1582) > at > org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1521) > at > org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1539) > at > org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1665) > at > org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1682) > > 2012-04-29 01:29:37,718 INFO > org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG: > /************************************************************ > SHUTDOWN_MSG: Shutting down DataNode at mandeep-System-Product-Name/ > 127.0.1.1 > ************************************************************/ > 2012-04-29 01:33:26,907 INFO > org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG: > /************************************************************ > > > -- > Mandeep Singh Gulati > System Analyst | WorldWide Risk and Information Management > American Express India Pvt. Ltd. > Gurgaon, India > > -- Mandeep Singh Gulati System Analyst | WorldWide Risk and Information Management American Express India Pvt. Ltd. Gurgaon, India