Thanks Harsh. I figured out the issue. Added following environment variables :
====================================== export HADOOP_DEV_HOME=`pwd` export HADOOP_MAPRED_HOME=${HADOOP_DEV_HOME} export HADOOP_COMMON_HOME=${HADOOP_DEV_HOME} export HADOOP_HDFS_HOME=${HADOOP_DEV_HOME} export YARN_HOME=${HADOOP_DEV_HOME} export HADOOP_CONF_DIR=${HADOOP_DEV_HOME}/conf/ export YARN_CONF_DIR=~${HADOOP_DEV_HOME}/conf/ Then the format is working. ----- Original Message ----- From: Harsh J <ha...@cloudera.com> To: common-dev@hadoop.apache.org; Hai Huang <hhuang2...@yahoo.com> Cc: Sent: Friday, February 3, 2012 1:04:39 AM Subject: Re: Issue on formating the file system What is your dfs.namenode.name.dir configured to, in hdfs-site.xml? On Fri, Feb 3, 2012 at 10:57 AM, Hai Huang <hhuang2...@yahoo.com> wrote: > I am trying to format a filesystem (below) following the online doc > > > -------------------------------------------- > $ bin/hadoop namenode -format > -------------------------------------------- > > I got the following error message: > > -------------------------------------------- > DEPRECATED: Use of this script to execute hdfs command is deprecated. > Instead use the hdfs command for it. > .... > > Formatting using clusterid: CID-22948dd2-0f38-4ecb-a5ff-2d2e1d24285d > 12/02/02 21:17:26 ERROR namenode.NameNode: Exception in namenode join > java.lang.IllegalArgumentException: URI has an authority component > at java.io.File.<init>(File.java:385) > at > org.apache.hadoop.hdfs.server.namenode.NNStorage.getStorageDirectory(NNStorage.java:310) > at > org.apache.hadoop.hdfs.server.namenode.FSEditLog.init(FSEditLog.java:178) > at > org.apache.hadoop.hdfs.server.namenode.FSEditLog.<init>(FSEditLog.java:155) > at > org.apache.hadoop.hdfs.server.namenode.FSImage.<init>(FSImage.java:125) > at > org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:605) > at > org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:733) > at > org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:800) > 12/02/02 21:17:26 INFO namenode.NameNode: SHUTDOWN_MSG: > /************************************************************ > SHUTDOWN_MSG: Shutting down NameNode at localhost.localdomain/127.0.0.1 > ************************************************************/ > -------------------------------------------- > > Does anyone know this issue? > > I am using the hadoop built myself . The command ( $ bin/hadoop namenode > -format) is issed under the directory > > /hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT > > > Thanks, > > Haifegng -- Harsh J Customer Ops. Engineer Cloudera | http://tiny.cloudera.com/about