wenwupeng created HDFS-4458: ------------------------------- Summary: start balancer failed with "Failed to create file [/system/balancer.id]" if configure IP on fs.defaultFS Key: HDFS-4458 URL: https://issues.apache.org/jira/browse/HDFS-4458 Project: Hadoop HDFS Issue Type: Bug Components: balancer Affects Versions: 2.0.2-alpha Reporter: wenwupeng
start balancer failed with "Failed to create file [/system/balancer.id]" if configure IP on fs.defaultFS Note: configure fs.defaultFS with hostname can resolve this issue 2013-01-28 01:21:49,550 WARN org.apache.hadoop.hdfs.StateChange: DIR* NameSystem.startFile: Failed to create file [/system/balancer.id] for [DFSClient_NONMAPREDUCE_413051464_1] on client [10.111.57.222], because this file is already being created by [DFSClient_NONMAPREDUCE_-732728704_1] on [10.111.57.222] 2013-01-28 01:21:49,550 ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:root (auth:SIMPLE) cause:org.apache.hadoop.hdfs.protocol.AlreadyBeingCreatedException: Failed to create file [/system/balancer.id] for [DFSClient_NONMAPREDUCE_413051464_1] on client [10.111.57.222], because this file is already being created by [DFSClient_NONMAPREDUCE_-732728704_1] on [10.111.57.222] 2013-01-28 01:21:49,551 INFO org.apache.hadoop.ipc.Server: IPC Server handler 2 on 8020, call org.apache.hadoop.hdfs.protocol.ClientProtocol.create from 10.111.57.222:41630: error: org.apache.hadoop.hdfs.protocol.AlreadyBeingCreatedException: Failed to create file [/system/balancer.id] for [DFSClient_NONMAPREDUCE_413051464_1] on client [10.111.57.222], because this file is already being created by [DFSClient_NONMAPREDUCE_-732728704_1] on [10.111.57.222] org.apache.hadoop.hdfs.protocol.AlreadyBeingCreatedException: Failed to create file [/system/balancer.id] for [DFSClient_NONMAPREDUCE_413051464_1] on client [10.111.57.222], because this file is already being created by [DFSClient_NONMAPREDUCE_-732728704_1] on [10.111.57.222] at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.recoverLeaseInternal(FSNamesystem.java:2175) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInternal(FSNamesystem.java:1965) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInt(FSNamesystem.java:1878) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFile(FSNamesystem.java:1857) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.create(NameNodeRpcServer.java:407) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.create(ClientNamenodeProtocolServerSideTranslatorPB.java:208) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java:45831) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:454) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:910) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1694) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1690) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1367) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1688) 2013-01-28 01:21:49,567 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* NameSystem.allocateBlock: /system/balancer.id. BP-986428099-10.111.57.222-1359353997106 blk_-2102764247427435122_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[10.111.57.223:50010|RBW], ReplicaUnderConstruction[10.111.57.225:50010|RBW], ReplicaUnderConstruction[10.111.57.224:50010|RBW]]} 2013-01-28 01:21:49,865 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* addStoredBlock: blockMap updated: 10.111.57.224:50010 is added to blk_-2102764247427435122_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[10.111.57.223:50010|RBW], ReplicaUnderConstruction[10.111.57.225:50010|RBW], ReplicaUnderConstruction[10.111.57.224:50010|RBW]]} size 0 2013-01-28 01:21:49,868 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* addStoredBlock: blockMap updated: 10.111.57.225:50010 is added to blk_-2102764247427435122_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[10.111.57.223:50010|RBW], ReplicaUnderConstruction[10.111.57.225:50010|RBW], ReplicaUnderConstruction[10.111.57.224:50010|RBW]]} size 0 2013-01-28 01:21:49,871 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* addStoredBlock: blockMap updated: 10.111.57.223:50010 is added to blk_-2102764247427435122_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[10.111.57.223:50010|RBW], ReplicaUnderConstruction[10.111.57.225:50010|RBW], ReplicaUnderConstruction[10.111.57.224:50010|RBW]]} size 0 2013-01-28 01:21:49,874 INFO org.apache.hadoop.hdfs.StateChange: DIR* NameSystem.completeFile: file /system/balancer.id is closed by DFSClient_NONMAPREDUCE_-732728704_1 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira