See <https://builds.apache.org/job/Hadoop-Hdfs-trunk/2127/changes>
Changes:
[junping_du] YARN-3505 addendum: fix an issue in previous patch.
[jlowe] YARN-2421. RM still allocates containers to an app in the FINISHING
state. Contributed by Chang Li
[jing9] HDFS-8397. Refactor the error handling code in DataStreamer.
Contributed by Tsz Wo Nicholas Sze.
[wheat9] HDFS-8394. Move getAdditionalBlock() and related functionalities into
a separate class. Contributed by Haohui Mai.
[wheat9] HDFS-8403. Eliminate retries in
TestFileCreation#testOverwriteOpenForWrite. Contributed by Arpit Agarwal.
[xgong] YARN-3526. ApplicationMaster tracking URL is incorrectly redirected on
a QJM cluster. Contributed by Weiwei Yang
------------------------------------------
[...truncated 7874 lines...]
[exec] 2015-05-16 14:17:29,090 INFO mortbay.log (Slf4jLog.java:info(67))
- Started SelectChannelConnector@localhost:53879
[exec] 2015-05-16 14:17:29,219 INFO web.DatanodeHttpServer
(DatanodeHttpServer.java:start(150)) - Listening HTTP traffic on
/127.0.0.1:58050
[exec] 2015-05-16 14:17:29,221 INFO datanode.DataNode
(DataNode.java:startDataNode(1144)) - dnUserName = jenkins
[exec] 2015-05-16 14:17:29,221 INFO datanode.DataNode
(DataNode.java:startDataNode(1145)) - supergroup = supergroup
[exec] 2015-05-16 14:17:29,234 INFO ipc.CallQueueManager
(CallQueueManager.java:<init>(56)) - Using callQueue class
java.util.concurrent.LinkedBlockingQueue
[exec] 2015-05-16 14:17:29,235 INFO ipc.Server (Server.java:run(622)) -
Starting Socket Reader #1 for port 45799
[exec] 2015-05-16 14:17:29,242 INFO datanode.DataNode
(DataNode.java:initIpcServer(844)) - Opened IPC server at /127.0.0.1:45799
[exec] 2015-05-16 14:17:29,254 INFO datanode.DataNode
(BlockPoolManager.java:refreshNamenodes(149)) - Refresh request received for
nameservices: null
[exec] 2015-05-16 14:17:29,256 INFO datanode.DataNode
(BlockPoolManager.java:doRefreshNamenodes(194)) - Starting BPOfferServices for
nameservices: <default>
[exec] 2015-05-16 14:17:29,267 INFO datanode.DataNode
(BPServiceActor.java:run(791)) - Block pool <registering> (Datanode Uuid
unassigned) service to localhost/127.0.0.1:36592 starting to offer service
[exec] 2015-05-16 14:17:29,273 INFO ipc.Server (Server.java:run(852)) -
IPC Server Responder: starting
[exec] 2015-05-16 14:17:29,274 INFO ipc.Server (Server.java:run(692)) -
IPC Server listener on 45799: starting
[exec] 2015-05-16 14:17:29,487 INFO common.Storage
(Storage.java:tryLock(715)) - Lock on
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/in_use.lock>
acquired by nodename 21...@asf904.gq1.ygridcore.net
[exec] 2015-05-16 14:17:29,488 INFO common.Storage
(DataStorage.java:loadStorageDirectory(272)) - Storage directory
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1>
is not formatted for BP-2053080698-67.195.81.148-1431785847283
[exec] 2015-05-16 14:17:29,488 INFO common.Storage
(DataStorage.java:loadStorageDirectory(274)) - Formatting ...
[exec] 2015-05-16 14:17:29,529 INFO common.Storage
(BlockPoolSliceStorage.java:recoverTransitionRead(241)) - Analyzing storage
directories for bpid BP-2053080698-67.195.81.148-1431785847283
[exec] 2015-05-16 14:17:29,529 INFO common.Storage
(Storage.java:lock(675)) - Locking is disabled for
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current/BP-2053080698-67.195.81.148-1431785847283>
[exec] 2015-05-16 14:17:29,529 INFO common.Storage
(BlockPoolSliceStorage.java:loadStorageDirectory(158)) - Block pool storage
directory
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current/BP-2053080698-67.195.81.148-1431785847283>
is not formatted for BP-2053080698-67.195.81.148-1431785847283
[exec] 2015-05-16 14:17:29,530 INFO common.Storage
(BlockPoolSliceStorage.java:loadStorageDirectory(160)) - Formatting ...
[exec] 2015-05-16 14:17:29,530 INFO common.Storage
(BlockPoolSliceStorage.java:format(267)) - Formatting block pool
BP-2053080698-67.195.81.148-1431785847283 directory
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current/BP-2053080698-67.195.81.148-1431785847283/current>
[exec] 2015-05-16 14:17:29,532 INFO common.Storage
(Storage.java:tryLock(715)) - Lock on
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/in_use.lock>
acquired by nodename 21...@asf904.gq1.ygridcore.net
[exec] 2015-05-16 14:17:29,532 INFO common.Storage
(DataStorage.java:loadStorageDirectory(272)) - Storage directory
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2>
is not formatted for BP-2053080698-67.195.81.148-1431785847283
[exec] 2015-05-16 14:17:29,532 INFO common.Storage
(DataStorage.java:loadStorageDirectory(274)) - Formatting ...
[exec] 2015-05-16 14:17:29,568 INFO common.Storage
(BlockPoolSliceStorage.java:recoverTransitionRead(241)) - Analyzing storage
directories for bpid BP-2053080698-67.195.81.148-1431785847283
[exec] 2015-05-16 14:17:29,568 INFO common.Storage
(Storage.java:lock(675)) - Locking is disabled for
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current/BP-2053080698-67.195.81.148-1431785847283>
[exec] 2015-05-16 14:17:29,568 INFO common.Storage
(BlockPoolSliceStorage.java:loadStorageDirectory(158)) - Block pool storage
directory
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current/BP-2053080698-67.195.81.148-1431785847283>
is not formatted for BP-2053080698-67.195.81.148-1431785847283
[exec] 2015-05-16 14:17:29,568 INFO common.Storage
(BlockPoolSliceStorage.java:loadStorageDirectory(160)) - Formatting ...
[exec] 2015-05-16 14:17:29,568 INFO common.Storage
(BlockPoolSliceStorage.java:format(267)) - Formatting block pool
BP-2053080698-67.195.81.148-1431785847283 directory
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current/BP-2053080698-67.195.81.148-1431785847283/current>
[exec] 2015-05-16 14:17:29,570 INFO datanode.DataNode
(DataNode.java:initStorage(1405)) - Setting up storage:
nsid=1653879258;bpid=BP-2053080698-67.195.81.148-1431785847283;lv=-56;nsInfo=lv=-63;cid=testClusterID;nsid=1653879258;c=0;bpid=BP-2053080698-67.195.81.148-1431785847283;dnuuid=null
[exec] 2015-05-16 14:17:29,571 INFO datanode.DataNode
(DataNode.java:checkDatanodeUuid(1234)) - Generated and persisted new Datanode
UUID ce2c4b2a-7b5f-4550-b146-860f7611541b
[exec] 2015-05-16 14:17:29,593 INFO impl.FsDatasetImpl
(FsVolumeList.java:addVolume(305)) - Added new volume:
DS-ba22ea50-06a8-4d05-8de8-b3c108493729
[exec] 2015-05-16 14:17:29,593 INFO impl.FsDatasetImpl
(FsDatasetImpl.java:addVolume(393)) - Added volume -
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current,>
StorageType: DISK
[exec] 2015-05-16 14:17:29,593 INFO impl.FsDatasetImpl
(FsVolumeList.java:addVolume(305)) - Added new volume:
DS-5ba16e0d-5a9c-4283-baad-912081da0c8a
[exec] 2015-05-16 14:17:29,594 INFO impl.FsDatasetImpl
(FsDatasetImpl.java:addVolume(393)) - Added volume -
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current,>
StorageType: DISK
[exec] 2015-05-16 14:17:29,598 INFO impl.FsDatasetImpl
(FsDatasetImpl.java:registerMBean(2060)) - Registered FSDatasetState MBean
[exec] 2015-05-16 14:17:29,605 INFO datanode.DirectoryScanner
(DirectoryScanner.java:start(332)) - Periodic Directory Tree Verification scan
starting at 1431806550605 with interval 21600000
[exec] 2015-05-16 14:17:29,605 INFO impl.FsDatasetImpl
(FsDatasetImpl.java:addBlockPool(2508)) - Adding block pool
BP-2053080698-67.195.81.148-1431785847283
[exec] 2015-05-16 14:17:29,606 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(404)) - Scanning block pool
BP-2053080698-67.195.81.148-1431785847283 on volume
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current...>
[exec] 2015-05-16 14:17:29,607 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(404)) - Scanning block pool
BP-2053080698-67.195.81.148-1431785847283 on volume
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current...>
[exec] 2015-05-16 14:17:29,619 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(409)) - Time taken to scan block pool
BP-2053080698-67.195.81.148-1431785847283 on
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current>:
11ms
[exec] 2015-05-16 14:17:29,619 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(409)) - Time taken to scan block pool
BP-2053080698-67.195.81.148-1431785847283 on
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current>:
12ms
[exec] 2015-05-16 14:17:29,619 INFO impl.FsDatasetImpl
(FsVolumeList.java:addBlockPool(435)) - Total time to scan all replicas for
block pool BP-2053080698-67.195.81.148-1431785847283: 14ms
[exec] 2015-05-16 14:17:29,620 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(190)) - Adding replicas to map for block pool
BP-2053080698-67.195.81.148-1431785847283 on volume
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current...>
[exec] 2015-05-16 14:17:29,620 INFO impl.BlockPoolSlice
(BlockPoolSlice.java:readReplicasFromCache(688)) - Replica Cache file:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current/BP-2053080698-67.195.81.148-1431785847283/current/replicas>
doesn't exist
[exec] 2015-05-16 14:17:29,620 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(195)) - Time to add replicas to map for block pool
BP-2053080698-67.195.81.148-1431785847283 on volume
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current>:
0ms
[exec] 2015-05-16 14:17:29,620 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(190)) - Adding replicas to map for block pool
BP-2053080698-67.195.81.148-1431785847283 on volume
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current...>
[exec] 2015-05-16 14:17:29,621 INFO impl.BlockPoolSlice
(BlockPoolSlice.java:readReplicasFromCache(688)) - Replica Cache file:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current/BP-2053080698-67.195.81.148-1431785847283/current/replicas>
doesn't exist
[exec] 2015-05-16 14:17:29,621 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(195)) - Time to add replicas to map for block pool
BP-2053080698-67.195.81.148-1431785847283 on volume
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current>:
1ms
[exec] 2015-05-16 14:17:29,621 INFO impl.FsDatasetImpl
(FsVolumeList.java:getAllVolumesMap(221)) - Total time to add all replicas to
map: 2ms
[exec] 2015-05-16 14:17:29,623 INFO datanode.DataNode
(BPServiceActor.java:register(746)) - Block pool
BP-2053080698-67.195.81.148-1431785847283 (Datanode Uuid
ce2c4b2a-7b5f-4550-b146-860f7611541b) service to localhost/127.0.0.1:36592
beginning handshake with NN
[exec] 2015-05-16 14:17:29,628 INFO hdfs.MiniDFSCluster
(MiniDFSCluster.java:shouldWait(2316)) - dnInfo.length != numDataNodes
[exec] 2015-05-16 14:17:29,629 INFO hdfs.MiniDFSCluster
(MiniDFSCluster.java:waitActive(2268)) - Waiting for cluster to become active
[exec] 2015-05-16 14:17:29,634 INFO hdfs.StateChange
(DatanodeManager.java:registerDatanode(883)) - BLOCK* registerDatanode: from
DatanodeRegistration(127.0.0.1:33085,
datanodeUuid=ce2c4b2a-7b5f-4550-b146-860f7611541b, infoPort=58050,
infoSecurePort=0, ipcPort=45799,
storageInfo=lv=-56;cid=testClusterID;nsid=1653879258;c=0) storage
ce2c4b2a-7b5f-4550-b146-860f7611541b
[exec] 2015-05-16 14:17:29,635 INFO blockmanagement.DatanodeDescriptor
(DatanodeDescriptor.java:updateHeartbeatState(448)) - Number of failed storage
changes from 0 to 0
[exec] 2015-05-16 14:17:29,636 INFO net.NetworkTopology
(NetworkTopology.java:add(418)) - Adding a new node:
/default-rack/127.0.0.1:33085
[exec] 2015-05-16 14:17:29,641 INFO datanode.DataNode
(BPServiceActor.java:register(764)) - Block pool Block pool
BP-2053080698-67.195.81.148-1431785847283 (Datanode Uuid
ce2c4b2a-7b5f-4550-b146-860f7611541b) service to localhost/127.0.0.1:36592
successfully registered with NN
[exec] 2015-05-16 14:17:29,641 INFO datanode.DataNode
(BPServiceActor.java:offerService(625)) - For namenode
localhost/127.0.0.1:36592 using BLOCKREPORT_INTERVAL of 21600000msec
CACHEREPORT_INTERVAL of 10000msec Initial delay: 0msec; heartBeatInterval=3000
[exec] 2015-05-16 14:17:29,652 INFO blockmanagement.DatanodeDescriptor
(DatanodeDescriptor.java:updateHeartbeatState(448)) - Number of failed storage
changes from 0 to 0
[exec] 2015-05-16 14:17:29,652 INFO blockmanagement.DatanodeDescriptor
(DatanodeDescriptor.java:updateStorage(859)) - Adding new storage ID
DS-ba22ea50-06a8-4d05-8de8-b3c108493729 for DN 127.0.0.1:33085
[exec] 2015-05-16 14:17:29,653 INFO blockmanagement.DatanodeDescriptor
(DatanodeDescriptor.java:updateStorage(859)) - Adding new storage ID
DS-5ba16e0d-5a9c-4283-baad-912081da0c8a for DN 127.0.0.1:33085
[exec] 2015-05-16 14:17:29,662 INFO datanode.DataNode
(BPOfferService.java:updateActorStatesFromHeartbeat(511)) - Namenode Block pool
BP-2053080698-67.195.81.148-1431785847283 (Datanode Uuid
ce2c4b2a-7b5f-4550-b146-860f7611541b) service to localhost/127.0.0.1:36592
trying to claim ACTIVE state with txid=1
[exec] 2015-05-16 14:17:29,662 INFO datanode.DataNode
(BPOfferService.java:updateActorStatesFromHeartbeat(523)) - Acknowledging
ACTIVE Namenode Block pool BP-2053080698-67.195.81.148-1431785847283 (Datanode
Uuid ce2c4b2a-7b5f-4550-b146-860f7611541b) service to localhost/127.0.0.1:36592
[exec] 2015-05-16 14:17:29,674 INFO blockmanagement.BlockManager
(BlockManager.java:processReport(1816)) - Processing first storage report for
DS-ba22ea50-06a8-4d05-8de8-b3c108493729 from datanode
ce2c4b2a-7b5f-4550-b146-860f7611541b
[exec] 2015-05-16 14:17:29,674 INFO BlockStateChange
(BlockManager.java:processReport(1865)) - BLOCK* processReport: from storage
DS-ba22ea50-06a8-4d05-8de8-b3c108493729 node
DatanodeRegistration(127.0.0.1:33085,
datanodeUuid=ce2c4b2a-7b5f-4550-b146-860f7611541b, infoPort=58050,
infoSecurePort=0, ipcPort=45799,
storageInfo=lv=-56;cid=testClusterID;nsid=1653879258;c=0), blocks: 0,
hasStaleStorage: true, processing time: 1 msecs
[exec] 2015-05-16 14:17:29,674 INFO blockmanagement.BlockManager
(BlockManager.java:processReport(1816)) - Processing first storage report for
DS-5ba16e0d-5a9c-4283-baad-912081da0c8a from datanode
ce2c4b2a-7b5f-4550-b146-860f7611541b
[exec] 2015-05-16 14:17:29,675 INFO BlockStateChange
(BlockManager.java:processReport(1865)) - BLOCK* processReport: from storage
DS-5ba16e0d-5a9c-4283-baad-912081da0c8a node
DatanodeRegistration(127.0.0.1:33085,
datanodeUuid=ce2c4b2a-7b5f-4550-b146-860f7611541b, infoPort=58050,
infoSecurePort=0, ipcPort=45799,
storageInfo=lv=-56;cid=testClusterID;nsid=1653879258;c=0), blocks: 0,
hasStaleStorage: false, processing time: 1 msecs
[exec] 2015-05-16 14:17:29,691 INFO datanode.DataNode
(BPServiceActor.java:blockReport(490)) - Successfully sent block report
0xe694a77a61df32c3, containing 2 storage report(s), of which we sent 2. The
reports had 0 total blocks and used 1 RPC(s). This took 3 msec to generate and
26 msecs for RPC and NN processing. Got back one command: FinalizeCommand/5.
[exec] 2015-05-16 14:17:29,691 INFO datanode.DataNode
(BPOfferService.java:processCommandFromActive(693)) - Got finalize command for
block pool BP-2053080698-67.195.81.148-1431785847283
[exec] 2015-05-16 14:17:29,738 INFO hdfs.MiniDFSCluster
(MiniDFSCluster.java:waitActive(2299)) - Cluster is active
[exec] 2015-05-16 14:17:29,747 INFO hdfs.MiniDFSCluster
(MiniDFSCluster.java:shutdown(1728)) - Shutting down the Mini HDFS Cluster
[exec] 2015-05-16 14:17:29,748 INFO hdfs.MiniDFSCluster
(MiniDFSCluster.java:shutdownDataNodes(1773)) - Shutting down DataNode 0
[exec] 2015-05-16 14:17:29,748 WARN datanode.DirectoryScanner
(DirectoryScanner.java:shutdown(378)) - DirectoryScanner: shutdown has been
called
[exec] 2015-05-16 14:17:29,748 INFO datanode.DataNode
(DataXceiverServer.java:closeAllPeers(263)) - Closing all peers.
[exec] 2015-05-16 14:17:29,750 INFO mortbay.log (Slf4jLog.java:info(67))
- Stopped SelectChannelConnector@localhost:0
[exec] 2015-05-16 14:17:30,111 INFO ipc.Server (Server.java:stop(2569)) -
Stopping server on 45799
[exec] 2015-05-16 14:17:30,112 INFO ipc.Server (Server.java:run(724)) -
Stopping IPC Server listener on 45799
[exec] 2015-05-16 14:17:30,112 INFO ipc.Server (Server.java:run(857)) -
Stopping IPC Server Responder
[exec] 2015-05-16 14:17:30,112 WARN datanode.DataNode
(BPServiceActor.java:offerService(701)) - BPOfferService for Block pool
BP-2053080698-67.195.81.148-1431785847283 (Datanode Uuid
ce2c4b2a-7b5f-4550-b146-860f7611541b) service to localhost/127.0.0.1:36592
interrupted
[exec] 2015-05-16 14:17:30,113 WARN datanode.DataNode
(BPServiceActor.java:run(831)) - Ending block pool service for: Block pool
BP-2053080698-67.195.81.148-1431785847283 (Datanode Uuid
ce2c4b2a-7b5f-4550-b146-860f7611541b) service to localhost/127.0.0.1:36592
[exec] 2015-05-16 14:17:30,214 INFO datanode.DataNode
(BlockPoolManager.java:remove(102)) - Removed Block pool
BP-2053080698-67.195.81.148-1431785847283 (Datanode Uuid
ce2c4b2a-7b5f-4550-b146-860f7611541b)
[exec] 2015-05-16 14:17:30,214 INFO impl.FsDatasetImpl
(FsDatasetImpl.java:shutdownBlockPool(2518)) - Removing block pool
BP-2053080698-67.195.81.148-1431785847283
[exec] 2015-05-16 14:17:30,215 INFO impl.FsDatasetImpl
(FsDatasetImpl.java:run(2989)) - LazyWriter was interrupted, exiting
[exec] 2015-05-16 14:17:30,216 INFO impl.FsDatasetAsyncDiskService
(FsDatasetAsyncDiskService.java:shutdown(184)) - Shutting down all async disk
service threads
[exec] 2015-05-16 14:17:30,216 INFO impl.FsDatasetAsyncDiskService
(FsDatasetAsyncDiskService.java:shutdown(192)) - All async disk service threads
have been shut down
[exec] 2015-05-16 14:17:30,216 INFO impl.RamDiskAsyncLazyPersistService
(RamDiskAsyncLazyPersistService.java:shutdown(165)) - Shutting down all async
lazy persist service threads
[exec] 2015-05-16 14:17:30,216 INFO impl.RamDiskAsyncLazyPersistService
(RamDiskAsyncLazyPersistService.java:shutdown(172)) - All async lazy persist
service threads have been shut down
[exec] 2015-05-16 14:17:30,221 INFO datanode.DataNode
(DataNode.java:shutdown(1821)) - Shutdown complete.
[exec] 2015-05-16 14:17:30,221 INFO namenode.FSNamesystem
(FSNamesystem.java:stopActiveServices(1221)) - Stopping services started for
active state
[exec] 2015-05-16 14:17:30,221 INFO namenode.FSEditLog
(FSEditLog.java:endCurrentLogSegment(1291)) - Ending log segment 1
[exec] 2015-05-16 14:17:30,221 INFO namenode.FSNamesystem
(FSNamesystem.java:run(4405)) - LazyPersistFileScrubber was interrupted, exiting
[exec] 2015-05-16 14:17:30,222 INFO namenode.FSEditLog
(FSEditLog.java:printStatistics(698)) - Number of transactions: 2 Total time
for transactions(ms): 0 Number of transactions batched in Syncs: 0 Number of
syncs: 3 SyncTimes(ms): 1 2
[exec] 2015-05-16 14:17:30,223 INFO namenode.FSNamesystem
(FSNamesystem.java:run(4325)) - NameNodeEditLogRoller was interrupted, exiting
[exec] 2015-05-16 14:17:30,224 INFO namenode.FileJournalManager
(FileJournalManager.java:finalizeLogSegment(134)) - Finalizing edits file
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/name1/current/edits_inprogress_0000000000000000001>
->
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/name1/current/edits_0000000000000000001-0000000000000000002>
[exec] 2015-05-16 14:17:30,224 INFO namenode.FileJournalManager
(FileJournalManager.java:finalizeLogSegment(134)) - Finalizing edits file
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/name2/current/edits_inprogress_0000000000000000001>
->
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/name2/current/edits_0000000000000000001-0000000000000000002>
[exec] 2015-05-16 14:17:30,226 INFO ipc.Server (Server.java:stop(2569)) -
Stopping server on 36592
[exec] 2015-05-16 14:17:30,226 INFO ipc.Server (Server.java:run(724)) -
Stopping IPC Server listener on 36592
[exec] 2015-05-16 14:17:30,226 INFO ipc.Server (Server.java:run(857)) -
Stopping IPC Server Responder
[exec] 2015-05-16 14:17:30,226 INFO blockmanagement.BlockManager
(BlockManager.java:run(3686)) - Stopping ReplicationMonitor.
[exec] 2015-05-16 14:17:30,261 INFO namenode.FSNamesystem
(FSNamesystem.java:stopActiveServices(1221)) - Stopping services started for
active state
[exec] 2015-05-16 14:17:30,262 INFO namenode.FSNamesystem
(FSNamesystem.java:stopStandbyServices(1311)) - Stopping services started for
standby state
[exec] 2015-05-16 14:17:30,263 INFO mortbay.log (Slf4jLog.java:info(67))
- Stopped SelectChannelConnector@localhost:0
[exec] 2015-05-16 14:17:30,364 INFO impl.MetricsSystemImpl
(MetricsSystemImpl.java:stop(211)) - Stopping DataNode metrics system...
[exec] 2015-05-16 14:17:30,364 INFO impl.MetricsSystemImpl
(MetricsSystemImpl.java:stop(217)) - DataNode metrics system stopped.
[exec] 2015-05-16 14:17:30,365 INFO impl.MetricsSystemImpl
(MetricsSystemImpl.java:shutdown(601)) - DataNode metrics system shutdown
complete.
[echo] Finished test_native_mini_dfs
[INFO] Executed tasks
[INFO]
[INFO] --- maven-jar-plugin:2.5:jar (prepare-jar) @ hadoop-hdfs ---
[INFO] Building jar:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/hadoop-hdfs-3.0.0-SNAPSHOT.jar>
[INFO]
[INFO] --- maven-jar-plugin:2.5:test-jar (prepare-test-jar) @ hadoop-hdfs ---
[INFO] Building jar:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/hadoop-hdfs-3.0.0-SNAPSHOT-tests.jar>
[INFO]
[INFO] >>> maven-source-plugin:2.3:jar (default) @ hadoop-hdfs >>>
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- hadoop-maven-plugins:3.0.0-SNAPSHOT:protoc (compile-protoc) @
hadoop-hdfs ---
[INFO]
[INFO] <<< maven-source-plugin:2.3:jar (default) @ hadoop-hdfs <<<
[INFO]
[INFO] --- maven-source-plugin:2.3:jar (default) @ hadoop-hdfs ---
[INFO] Building jar:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/hadoop-hdfs-3.0.0-SNAPSHOT-sources.jar>
[INFO]
[INFO] >>> maven-source-plugin:2.3:test-jar (default) @ hadoop-hdfs >>>
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- hadoop-maven-plugins:3.0.0-SNAPSHOT:protoc (compile-protoc) @
hadoop-hdfs ---
[INFO]
[INFO] <<< maven-source-plugin:2.3:test-jar (default) @ hadoop-hdfs <<<
[INFO]
[INFO] --- maven-source-plugin:2.3:test-jar (default) @ hadoop-hdfs ---
[INFO] Building jar:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/hadoop-hdfs-3.0.0-SNAPSHOT-test-sources.jar>
[INFO]
[INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default) @ hadoop-hdfs ---
[INFO] Fork Value is true
[INFO] Done FindBugs Analysis....
[INFO]
[INFO] --- maven-dependency-plugin:2.2:copy (site) @ hadoop-hdfs ---
[INFO] Configured Artifact: jdiff:jdiff:1.0.9:jar
[INFO] Configured Artifact:
org.apache.hadoop:hadoop-annotations:3.0.0-SNAPSHOT:jar
[INFO] Configured Artifact: xerces:xercesImpl:2.11.0:jar
[INFO] Copying jdiff-1.0.9.jar to
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/jdiff.jar>
[INFO] Copying hadoop-annotations-3.0.0-SNAPSHOT.jar to
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/hadoop-annotations.jar>
[INFO] Copying xercesImpl-2.11.0.jar to
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/xerces.jar>
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (site) @ hadoop-hdfs ---
[INFO] Executing tasks
main:
[mkdir] Created dir:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/docs-src>
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Apache Hadoop HttpFS
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Apache Hadoop HDFS BookKeeper Journal
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Apache Hadoop HDFS-NFS
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Apache Hadoop HDFS Project 3.0.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-hdfs-project
---
[INFO] Deleting
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target>
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs-project
---
[INFO] Executing tasks
main:
[mkdir] Created dir:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target/test-dir>
[INFO] Executed tasks
[INFO]
[INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @
hadoop-hdfs-project ---
[INFO]
[INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @
hadoop-hdfs-project ---
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @
hadoop-hdfs-project ---
[INFO]
[INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @
hadoop-hdfs-project ---
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @
hadoop-hdfs-project ---
[INFO] Skipping javadoc generation
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project
---
[INFO]
[INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @
hadoop-hdfs-project ---
[INFO]
[INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @
hadoop-hdfs-project ---
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop HDFS Client ......................... SUCCESS [ 46.643 s]
[INFO] Apache Hadoop HDFS ................................ FAILURE [ 02:44 h]
[INFO] Apache Hadoop HttpFS .............................. SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED
[INFO] Apache Hadoop HDFS Project ........................ SUCCESS [ 0.070 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:45 h
[INFO] Finished at: 2015-05-16T14:19:55+00:00
[INFO] Final Memory: 68M/696M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-antrun-plugin:1.7:run (site) on project
hadoop-hdfs: An Ant BuildException has occured:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/src/main/docs>
does not exist.
[ERROR] around Ant part ...<copy
todir="<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/docs-src";>...>
@ 5:121 in
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/antrun/build-main.xml>
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-hdfs
Build step 'Execute shell' marked build as failure
Archiving artifacts
Sending artifact delta relative to Hadoop-Hdfs-trunk #2116
Archived 1 artifacts
Archive block size is 32768
Received 0 blocks and 362668 bytes
Compression is 0.0%
Took 27 sec
Recording test results
Updating HDFS-8394
Updating HDFS-8403
Updating HDFS-8397
Updating YARN-3505
Updating YARN-3526
Updating YARN-2421
