See <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/186/changes>
Changes:
[devaraj] MAPREDUCE-5708. Duplicate String.format in
[junping_du] YARN-3505. Node's Log Aggregation Report with SUCCEED should not
cached in RMApps. Contributed by Xuan Gong.
[cnauroth] HADOOP-11713. ViewFileSystem should support snapshot methods.
Contributed by Rakesh R.
[raviprak] YARN-1519. Check in container-executor if sysconf is implemented
before using it (Radim Kolar and Eric Payne via raviprak)
[vinodkv] Fixing MR intermediate spills. Contributed by Arun Suresh.
[vinodkv] Fixing HDFS state-store. Contributed by Arun Suresh.
[aajisaka] HDFS-8371. Fix test failure in TestHdfsConfigFields for spanreceiver
properties. Contributed by Ray Chiang.
[aajisaka] HDFS-8350. Remove old webhdfs.xml and other outdated documentation
stuff. Contributed by Brahma Reddy Battula.
[cnauroth] HADOOP-11960. Enable Azure-Storage Client Side logging. Contributed
by Dushyanth.
[vinayakumarb] HDFS-6888. Allow selectively audit logging ops (Contributed by
Chen He)
[devaraj] MAPREDUCE-6273. HistoryFileManager should check whether summaryFile
exists
------------------------------------------
[...truncated 8392 lines...]
[exec] 2015-05-15 14:43:34,019 INFO ipc.CallQueueManager
(CallQueueManager.java:<init>(56)) - Using callQueue class
java.util.concurrent.LinkedBlockingQueue
[exec] 2015-05-15 14:43:34,020 INFO ipc.Server (Server.java:run(622)) -
Starting Socket Reader #1 for port 52318
[exec] 2015-05-15 14:43:34,026 INFO datanode.DataNode
(DataNode.java:initIpcServer(844)) - Opened IPC server at /127.0.0.1:52318
[exec] 2015-05-15 14:43:34,036 INFO datanode.DataNode
(BlockPoolManager.java:refreshNamenodes(149)) - Refresh request received for
nameservices: null
[exec] 2015-05-15 14:43:34,038 INFO datanode.DataNode
(BlockPoolManager.java:doRefreshNamenodes(194)) - Starting BPOfferServices for
nameservices: <default>
[exec] 2015-05-15 14:43:34,048 INFO datanode.DataNode
(BPServiceActor.java:run(791)) - Block pool <registering> (Datanode Uuid
unassigned) service to localhost/127.0.0.1:54725 starting to offer service
[exec] 2015-05-15 14:43:34,053 INFO ipc.Server (Server.java:run(852)) -
IPC Server Responder: starting
[exec] 2015-05-15 14:43:34,054 INFO ipc.Server (Server.java:run(692)) -
IPC Server listener on 52318: starting
[exec] 2015-05-15 14:43:34,262 INFO common.Storage
(Storage.java:tryLock(715)) - Lock on
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/in_use.lock>
acquired by nodename 5...@asf903.gq1.ygridcore.net
[exec] 2015-05-15 14:43:34,263 INFO common.Storage
(DataStorage.java:loadStorageDirectory(272)) - Storage directory
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1>
is not formatted for BP-1670961032-67.195.81.147-1431701012003
[exec] 2015-05-15 14:43:34,263 INFO common.Storage
(DataStorage.java:loadStorageDirectory(274)) - Formatting ...
[exec] 2015-05-15 14:43:34,624 INFO common.Storage
(BlockPoolSliceStorage.java:recoverTransitionRead(241)) - Analyzing storage
directories for bpid BP-1670961032-67.195.81.147-1431701012003
[exec] 2015-05-15 14:43:34,626 INFO common.Storage
(Storage.java:lock(675)) - Locking is disabled for
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current/BP-1670961032-67.195.81.147-1431701012003>
[exec] 2015-05-15 14:43:34,627 INFO common.Storage
(BlockPoolSliceStorage.java:loadStorageDirectory(158)) - Block pool storage
directory
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current/BP-1670961032-67.195.81.147-1431701012003>
is not formatted for BP-1670961032-67.195.81.147-1431701012003
[exec] 2015-05-15 14:43:34,627 INFO common.Storage
(BlockPoolSliceStorage.java:loadStorageDirectory(160)) - Formatting ...
[exec] 2015-05-15 14:43:34,627 INFO common.Storage
(BlockPoolSliceStorage.java:format(267)) - Formatting block pool
BP-1670961032-67.195.81.147-1431701012003 directory
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current/BP-1670961032-67.195.81.147-1431701012003/current>
[exec] 2015-05-15 14:43:34,636 INFO common.Storage
(Storage.java:tryLock(715)) - Lock on
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/in_use.lock>
acquired by nodename 5...@asf903.gq1.ygridcore.net
[exec] 2015-05-15 14:43:34,636 INFO common.Storage
(DataStorage.java:loadStorageDirectory(272)) - Storage directory
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2>
is not formatted for BP-1670961032-67.195.81.147-1431701012003
[exec] 2015-05-15 14:43:34,636 INFO common.Storage
(DataStorage.java:loadStorageDirectory(274)) - Formatting ...
[exec] 2015-05-15 14:43:34,653 INFO common.Storage
(BlockPoolSliceStorage.java:recoverTransitionRead(241)) - Analyzing storage
directories for bpid BP-1670961032-67.195.81.147-1431701012003
[exec] 2015-05-15 14:43:34,654 INFO common.Storage
(Storage.java:lock(675)) - Locking is disabled for
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current/BP-1670961032-67.195.81.147-1431701012003>
[exec] 2015-05-15 14:43:34,654 INFO common.Storage
(BlockPoolSliceStorage.java:loadStorageDirectory(158)) - Block pool storage
directory
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current/BP-1670961032-67.195.81.147-1431701012003>
is not formatted for BP-1670961032-67.195.81.147-1431701012003
[exec] 2015-05-15 14:43:34,654 INFO common.Storage
(BlockPoolSliceStorage.java:loadStorageDirectory(160)) - Formatting ...
[exec] 2015-05-15 14:43:34,654 INFO common.Storage
(BlockPoolSliceStorage.java:format(267)) - Formatting block pool
BP-1670961032-67.195.81.147-1431701012003 directory
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current/BP-1670961032-67.195.81.147-1431701012003/current>
[exec] 2015-05-15 14:43:34,656 INFO datanode.DataNode
(DataNode.java:initStorage(1405)) - Setting up storage:
nsid=1740223438;bpid=BP-1670961032-67.195.81.147-1431701012003;lv=-56;nsInfo=lv=-63;cid=testClusterID;nsid=1740223438;c=0;bpid=BP-1670961032-67.195.81.147-1431701012003;dnuuid=null
[exec] 2015-05-15 14:43:34,657 INFO datanode.DataNode
(DataNode.java:checkDatanodeUuid(1234)) - Generated and persisted new Datanode
UUID 3e50d5cd-a6db-4803-9c38-cb5cfdae94ea
[exec] 2015-05-15 14:43:34,678 INFO impl.FsDatasetImpl
(FsVolumeList.java:addVolume(305)) - Added new volume:
DS-7d013852-5d2e-4114-9f2e-696bb2edc2ea
[exec] 2015-05-15 14:43:34,678 INFO impl.FsDatasetImpl
(FsDatasetImpl.java:addVolume(393)) - Added volume -
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current,>
StorageType: DISK
[exec] 2015-05-15 14:43:34,678 INFO impl.FsDatasetImpl
(FsVolumeList.java:addVolume(305)) - Added new volume:
DS-837db94e-19b9-475d-8e13-0f9e1540f120
[exec] 2015-05-15 14:43:34,679 INFO impl.FsDatasetImpl
(FsDatasetImpl.java:addVolume(393)) - Added volume -
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current,>
StorageType: DISK
[exec] 2015-05-15 14:43:34,692 INFO impl.FsDatasetImpl
(FsDatasetImpl.java:registerMBean(2060)) - Registered FSDatasetState MBean
[exec] 2015-05-15 14:43:34,701 INFO datanode.DirectoryScanner
(DirectoryScanner.java:start(332)) - Periodic Directory Tree Verification scan
starting at 1431722369701 with interval 21600000
[exec] 2015-05-15 14:43:34,701 INFO impl.FsDatasetImpl
(FsDatasetImpl.java:addBlockPool(2508)) - Adding block pool
BP-1670961032-67.195.81.147-1431701012003
[exec] 2015-05-15 14:43:34,702 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(404)) - Scanning block pool
BP-1670961032-67.195.81.147-1431701012003 on volume
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current...>
[exec] 2015-05-15 14:43:34,703 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(404)) - Scanning block pool
BP-1670961032-67.195.81.147-1431701012003 on volume
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current...>
[exec] 2015-05-15 14:43:34,726 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(409)) - Time taken to scan block pool
BP-1670961032-67.195.81.147-1431701012003 on
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current>:
23ms
[exec] 2015-05-15 14:43:34,727 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(409)) - Time taken to scan block pool
BP-1670961032-67.195.81.147-1431701012003 on
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current>:
23ms
[exec] 2015-05-15 14:43:34,727 INFO impl.FsDatasetImpl
(FsVolumeList.java:addBlockPool(435)) - Total time to scan all replicas for
block pool BP-1670961032-67.195.81.147-1431701012003: 25ms
[exec] 2015-05-15 14:43:34,728 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(190)) - Adding replicas to map for block pool
BP-1670961032-67.195.81.147-1431701012003 on volume
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current...>
[exec] 2015-05-15 14:43:34,729 INFO impl.BlockPoolSlice
(BlockPoolSlice.java:readReplicasFromCache(688)) - Replica Cache file:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current/BP-1670961032-67.195.81.147-1431701012003/current/replicas>
doesn't exist
[exec] 2015-05-15 14:43:34,729 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(195)) - Time to add replicas to map for block pool
BP-1670961032-67.195.81.147-1431701012003 on volume
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current>:
1ms
[exec] 2015-05-15 14:43:34,729 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(190)) - Adding replicas to map for block pool
BP-1670961032-67.195.81.147-1431701012003 on volume
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current...>
[exec] 2015-05-15 14:43:34,730 INFO impl.BlockPoolSlice
(BlockPoolSlice.java:readReplicasFromCache(688)) - Replica Cache file:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current/BP-1670961032-67.195.81.147-1431701012003/current/replicas>
doesn't exist
[exec] 2015-05-15 14:43:34,730 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(195)) - Time to add replicas to map for block pool
BP-1670961032-67.195.81.147-1431701012003 on volume
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current>:
1ms
[exec] 2015-05-15 14:43:34,731 INFO impl.FsDatasetImpl
(FsVolumeList.java:getAllVolumesMap(221)) - Total time to add all replicas to
map: 3ms
[exec] 2015-05-15 14:43:34,733 INFO datanode.DataNode
(BPServiceActor.java:register(746)) - Block pool
BP-1670961032-67.195.81.147-1431701012003 (Datanode Uuid
3e50d5cd-a6db-4803-9c38-cb5cfdae94ea) service to localhost/127.0.0.1:54725
beginning handshake with NN
[exec] 2015-05-15 14:43:34,735 INFO hdfs.MiniDFSCluster
(MiniDFSCluster.java:shouldWait(2316)) - dnInfo.length != numDataNodes
[exec] 2015-05-15 14:43:34,735 INFO hdfs.MiniDFSCluster
(MiniDFSCluster.java:waitActive(2268)) - Waiting for cluster to become active
[exec] 2015-05-15 14:43:34,742 INFO hdfs.StateChange
(DatanodeManager.java:registerDatanode(883)) - BLOCK* registerDatanode: from
DatanodeRegistration(127.0.0.1:54163,
datanodeUuid=3e50d5cd-a6db-4803-9c38-cb5cfdae94ea, infoPort=32814,
infoSecurePort=0, ipcPort=52318,
storageInfo=lv=-56;cid=testClusterID;nsid=1740223438;c=0) storage
3e50d5cd-a6db-4803-9c38-cb5cfdae94ea
[exec] 2015-05-15 14:43:34,742 INFO blockmanagement.DatanodeDescriptor
(DatanodeDescriptor.java:updateHeartbeatState(448)) - Number of failed storage
changes from 0 to 0
[exec] 2015-05-15 14:43:34,743 INFO net.NetworkTopology
(NetworkTopology.java:add(418)) - Adding a new node:
/default-rack/127.0.0.1:54163
[exec] 2015-05-15 14:43:34,747 INFO datanode.DataNode
(BPServiceActor.java:register(764)) - Block pool Block pool
BP-1670961032-67.195.81.147-1431701012003 (Datanode Uuid
3e50d5cd-a6db-4803-9c38-cb5cfdae94ea) service to localhost/127.0.0.1:54725
successfully registered with NN
[exec] 2015-05-15 14:43:34,747 INFO datanode.DataNode
(BPServiceActor.java:offerService(625)) - For namenode
localhost/127.0.0.1:54725 using BLOCKREPORT_INTERVAL of 21600000msec
CACHEREPORT_INTERVAL of 10000msec Initial delay: 0msec; heartBeatInterval=3000
[exec] 2015-05-15 14:43:34,758 INFO blockmanagement.DatanodeDescriptor
(DatanodeDescriptor.java:updateHeartbeatState(448)) - Number of failed storage
changes from 0 to 0
[exec] 2015-05-15 14:43:34,759 INFO blockmanagement.DatanodeDescriptor
(DatanodeDescriptor.java:updateStorage(859)) - Adding new storage ID
DS-7d013852-5d2e-4114-9f2e-696bb2edc2ea for DN 127.0.0.1:54163
[exec] 2015-05-15 14:43:34,759 INFO blockmanagement.DatanodeDescriptor
(DatanodeDescriptor.java:updateStorage(859)) - Adding new storage ID
DS-837db94e-19b9-475d-8e13-0f9e1540f120 for DN 127.0.0.1:54163
[exec] 2015-05-15 14:43:34,770 INFO datanode.DataNode
(BPOfferService.java:updateActorStatesFromHeartbeat(511)) - Namenode Block pool
BP-1670961032-67.195.81.147-1431701012003 (Datanode Uuid
3e50d5cd-a6db-4803-9c38-cb5cfdae94ea) service to localhost/127.0.0.1:54725
trying to claim ACTIVE state with txid=1
[exec] 2015-05-15 14:43:34,770 INFO datanode.DataNode
(BPOfferService.java:updateActorStatesFromHeartbeat(523)) - Acknowledging
ACTIVE Namenode Block pool BP-1670961032-67.195.81.147-1431701012003 (Datanode
Uuid 3e50d5cd-a6db-4803-9c38-cb5cfdae94ea) service to localhost/127.0.0.1:54725
[exec] 2015-05-15 14:43:34,783 INFO blockmanagement.BlockManager
(BlockManager.java:processReport(1816)) - Processing first storage report for
DS-7d013852-5d2e-4114-9f2e-696bb2edc2ea from datanode
3e50d5cd-a6db-4803-9c38-cb5cfdae94ea
[exec] 2015-05-15 14:43:34,784 INFO BlockStateChange
(BlockManager.java:processReport(1865)) - BLOCK* processReport: from storage
DS-7d013852-5d2e-4114-9f2e-696bb2edc2ea node
DatanodeRegistration(127.0.0.1:54163,
datanodeUuid=3e50d5cd-a6db-4803-9c38-cb5cfdae94ea, infoPort=32814,
infoSecurePort=0, ipcPort=52318,
storageInfo=lv=-56;cid=testClusterID;nsid=1740223438;c=0), blocks: 0,
hasStaleStorage: true, processing time: 0 msecs
[exec] 2015-05-15 14:43:34,784 INFO blockmanagement.BlockManager
(BlockManager.java:processReport(1816)) - Processing first storage report for
DS-837db94e-19b9-475d-8e13-0f9e1540f120 from datanode
3e50d5cd-a6db-4803-9c38-cb5cfdae94ea
[exec] 2015-05-15 14:43:34,785 INFO BlockStateChange
(BlockManager.java:processReport(1865)) - BLOCK* processReport: from storage
DS-837db94e-19b9-475d-8e13-0f9e1540f120 node
DatanodeRegistration(127.0.0.1:54163,
datanodeUuid=3e50d5cd-a6db-4803-9c38-cb5cfdae94ea, infoPort=32814,
infoSecurePort=0, ipcPort=52318,
storageInfo=lv=-56;cid=testClusterID;nsid=1740223438;c=0), blocks: 0,
hasStaleStorage: false, processing time: 0 msecs
[exec] 2015-05-15 14:43:34,805 INFO datanode.DataNode
(BPServiceActor.java:blockReport(490)) - Successfully sent block report
0xeb443a93f56584fc, containing 2 storage report(s), of which we sent 2. The
reports had 0 total blocks and used 1 RPC(s). This took 3 msec to generate and
31 msecs for RPC and NN processing. Got back one command: FinalizeCommand/5.
[exec] 2015-05-15 14:43:34,805 INFO datanode.DataNode
(BPOfferService.java:processCommandFromActive(693)) - Got finalize command for
block pool BP-1670961032-67.195.81.147-1431701012003
[exec] 2015-05-15 14:43:34,848 INFO hdfs.MiniDFSCluster
(MiniDFSCluster.java:waitActive(2299)) - Cluster is active
[exec] 2015-05-15 14:43:34,856 INFO hdfs.MiniDFSCluster
(MiniDFSCluster.java:shutdown(1728)) - Shutting down the Mini HDFS Cluster
[exec] 2015-05-15 14:43:34,856 INFO hdfs.MiniDFSCluster
(MiniDFSCluster.java:shutdownDataNodes(1773)) - Shutting down DataNode 0
[exec] 2015-05-15 14:43:34,857 INFO datanode.DataNode
(DataXceiverServer.java:closeAllPeers(263)) - Closing all peers.
[exec] 2015-05-15 14:43:34,856 WARN datanode.DirectoryScanner
(DirectoryScanner.java:shutdown(378)) - DirectoryScanner: shutdown has been
called
[exec] 2015-05-15 14:43:34,863 INFO mortbay.log (Slf4jLog.java:info(67))
- Stopped SelectChannelConnector@localhost:0
[exec] 2015-05-15 14:43:34,974 INFO ipc.Server (Server.java:stop(2569)) -
Stopping server on 52318
[exec] 2015-05-15 14:43:34,975 INFO ipc.Server (Server.java:run(724)) -
Stopping IPC Server listener on 52318
[exec] 2015-05-15 14:43:34,975 WARN datanode.DataNode
(BPServiceActor.java:offerService(701)) - BPOfferService for Block pool
BP-1670961032-67.195.81.147-1431701012003 (Datanode Uuid
3e50d5cd-a6db-4803-9c38-cb5cfdae94ea) service to localhost/127.0.0.1:54725
interrupted
[exec] 2015-05-15 14:43:34,975 WARN datanode.DataNode
(BPServiceActor.java:run(831)) - Ending block pool service for: Block pool
BP-1670961032-67.195.81.147-1431701012003 (Datanode Uuid
3e50d5cd-a6db-4803-9c38-cb5cfdae94ea) service to localhost/127.0.0.1:54725
[exec] 2015-05-15 14:43:34,976 INFO ipc.Server (Server.java:run(857)) -
Stopping IPC Server Responder
[exec] 2015-05-15 14:43:35,077 INFO datanode.DataNode
(BlockPoolManager.java:remove(102)) - Removed Block pool
BP-1670961032-67.195.81.147-1431701012003 (Datanode Uuid
3e50d5cd-a6db-4803-9c38-cb5cfdae94ea)
[exec] 2015-05-15 14:43:35,077 INFO impl.FsDatasetImpl
(FsDatasetImpl.java:shutdownBlockPool(2518)) - Removing block pool
BP-1670961032-67.195.81.147-1431701012003
[exec] 2015-05-15 14:43:35,081 INFO impl.FsDatasetImpl
(FsDatasetImpl.java:run(2989)) - LazyWriter was interrupted, exiting
[exec] 2015-05-15 14:43:35,081 INFO impl.FsDatasetAsyncDiskService
(FsDatasetAsyncDiskService.java:shutdown(184)) - Shutting down all async disk
service threads
[exec] 2015-05-15 14:43:35,081 INFO impl.FsDatasetAsyncDiskService
(FsDatasetAsyncDiskService.java:shutdown(192)) - All async disk service threads
have been shut down
[exec] 2015-05-15 14:43:35,082 INFO impl.RamDiskAsyncLazyPersistService
(RamDiskAsyncLazyPersistService.java:shutdown(165)) - Shutting down all async
lazy persist service threads
[exec] 2015-05-15 14:43:35,082 INFO impl.RamDiskAsyncLazyPersistService
(RamDiskAsyncLazyPersistService.java:shutdown(172)) - All async lazy persist
service threads have been shut down
[exec] 2015-05-15 14:43:35,086 INFO datanode.DataNode
(DataNode.java:shutdown(1821)) - Shutdown complete.
[exec] 2015-05-15 14:43:35,086 INFO namenode.FSNamesystem
(FSNamesystem.java:stopActiveServices(1222)) - Stopping services started for
active state
[exec] 2015-05-15 14:43:35,087 INFO namenode.FSNamesystem
(FSNamesystem.java:run(4782)) - LazyPersistFileScrubber was interrupted, exiting
[exec] 2015-05-15 14:43:35,087 INFO namenode.FSEditLog
(FSEditLog.java:endCurrentLogSegment(1291)) - Ending log segment 1
[exec] 2015-05-15 14:43:35,088 INFO namenode.FSNamesystem
(FSNamesystem.java:run(4702)) - NameNodeEditLogRoller was interrupted, exiting
[exec] 2015-05-15 14:43:35,088 INFO namenode.FSEditLog
(FSEditLog.java:printStatistics(698)) - Number of transactions: 2 Total time
for transactions(ms): 0 Number of transactions batched in Syncs: 0 Number of
syncs: 3 SyncTimes(ms): 1 1
[exec] 2015-05-15 14:43:35,089 INFO namenode.FileJournalManager
(FileJournalManager.java:finalizeLogSegment(134)) - Finalizing edits file
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/name1/current/edits_inprogress_0000000000000000001>
->
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/name1/current/edits_0000000000000000001-0000000000000000002>
[exec] 2015-05-15 14:43:35,090 INFO namenode.FileJournalManager
(FileJournalManager.java:finalizeLogSegment(134)) - Finalizing edits file
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/name2/current/edits_inprogress_0000000000000000001>
->
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/name2/current/edits_0000000000000000001-0000000000000000002>
[exec] 2015-05-15 14:43:35,093 INFO ipc.Server (Server.java:stop(2569)) -
Stopping server on 54725
[exec] 2015-05-15 14:43:35,093 INFO ipc.Server (Server.java:run(724)) -
Stopping IPC Server listener on 54725
[exec] 2015-05-15 14:43:35,093 INFO ipc.Server (Server.java:run(857)) -
Stopping IPC Server Responder
[exec] 2015-05-15 14:43:35,094 INFO blockmanagement.BlockManager
(BlockManager.java:run(3686)) - Stopping ReplicationMonitor.
[exec] 2015-05-15 14:43:35,138 INFO namenode.FSNamesystem
(FSNamesystem.java:stopActiveServices(1222)) - Stopping services started for
active state
[exec] 2015-05-15 14:43:35,139 INFO namenode.FSNamesystem
(FSNamesystem.java:stopStandbyServices(1312)) - Stopping services started for
standby state
[exec] 2015-05-15 14:43:35,140 INFO mortbay.log (Slf4jLog.java:info(67))
- Stopped SelectChannelConnector@localhost:0
[exec] 2015-05-15 14:43:35,241 INFO impl.MetricsSystemImpl
(MetricsSystemImpl.java:stop(211)) - Stopping DataNode metrics system...
[exec] 2015-05-15 14:43:35,242 INFO impl.MetricsSystemImpl
(MetricsSystemImpl.java:stop(217)) - DataNode metrics system stopped.
[exec] 2015-05-15 14:43:35,242 INFO impl.MetricsSystemImpl
(MetricsSystemImpl.java:shutdown(601)) - DataNode metrics system shutdown
complete.
[echo] Finished test_native_mini_dfs
[INFO] Executed tasks
[INFO]
[INFO] --- maven-jar-plugin:2.5:jar (prepare-jar) @ hadoop-hdfs ---
[INFO] Building jar:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/hadoop-hdfs-3.0.0-SNAPSHOT.jar>
[INFO]
[INFO] --- maven-jar-plugin:2.5:test-jar (prepare-test-jar) @ hadoop-hdfs ---
[INFO] Building jar:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/hadoop-hdfs-3.0.0-SNAPSHOT-tests.jar>
[INFO]
[INFO] >>> maven-source-plugin:2.3:jar (default) @ hadoop-hdfs >>>
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- hadoop-maven-plugins:3.0.0-SNAPSHOT:protoc (compile-protoc) @
hadoop-hdfs ---
[INFO]
[INFO] <<< maven-source-plugin:2.3:jar (default) @ hadoop-hdfs <<<
[INFO]
[INFO] --- maven-source-plugin:2.3:jar (default) @ hadoop-hdfs ---
[INFO] Building jar:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/hadoop-hdfs-3.0.0-SNAPSHOT-sources.jar>
[INFO]
[INFO] >>> maven-source-plugin:2.3:test-jar (default) @ hadoop-hdfs >>>
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- hadoop-maven-plugins:3.0.0-SNAPSHOT:protoc (compile-protoc) @
hadoop-hdfs ---
[INFO]
[INFO] <<< maven-source-plugin:2.3:test-jar (default) @ hadoop-hdfs <<<
[INFO]
[INFO] --- maven-source-plugin:2.3:test-jar (default) @ hadoop-hdfs ---
[INFO] Building jar:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/hadoop-hdfs-3.0.0-SNAPSHOT-test-sources.jar>
[INFO]
[INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default) @ hadoop-hdfs ---
[INFO] Fork Value is true
[java] Warnings generated: 1
[INFO] Done FindBugs Analysis....
[INFO]
[INFO] --- maven-dependency-plugin:2.2:copy (site) @ hadoop-hdfs ---
[INFO] Configured Artifact: jdiff:jdiff:1.0.9:jar
[INFO] Configured Artifact:
org.apache.hadoop:hadoop-annotations:3.0.0-SNAPSHOT:jar
[INFO] Configured Artifact: xerces:xercesImpl:2.11.0:jar
[INFO] Copying jdiff-1.0.9.jar to
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/jdiff.jar>
[INFO] Copying hadoop-annotations-3.0.0-SNAPSHOT.jar to
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/hadoop-annotations.jar>
[INFO] Copying xercesImpl-2.11.0.jar to
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/xerces.jar>
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (site) @ hadoop-hdfs ---
[INFO] Executing tasks
main:
[mkdir] Created dir:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/docs-src>
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Apache Hadoop HttpFS
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Apache Hadoop HDFS BookKeeper Journal
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Apache Hadoop HDFS-NFS
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Apache Hadoop HDFS Project 3.0.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-hdfs-project
---
[INFO] Deleting
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/target>
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs-project
---
[INFO] Executing tasks
main:
[mkdir] Created dir:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/target/test-dir>
[INFO] Executed tasks
[INFO]
[INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @
hadoop-hdfs-project ---
[INFO]
[INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @
hadoop-hdfs-project ---
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @
hadoop-hdfs-project ---
[INFO]
[INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @
hadoop-hdfs-project ---
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @
hadoop-hdfs-project ---
[INFO] Not executing Javadoc as the project is not a Java classpath-capable
package
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project
---
[INFO]
[INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @
hadoop-hdfs-project ---
[INFO]
[INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @
hadoop-hdfs-project ---
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop HDFS Client ......................... SUCCESS [ 48.212 s]
[INFO] Apache Hadoop HDFS ................................ FAILURE [ 02:58 h]
[INFO] Apache Hadoop HttpFS .............................. SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED
[INFO] Apache Hadoop HDFS Project ........................ SUCCESS [ 0.126 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:58 h
[INFO] Finished at: 2015-05-15T14:45:43+00:00
[INFO] Final Memory: 55M/267M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-antrun-plugin:1.7:run (site) on project
hadoop-hdfs: An Ant BuildException has occured:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/src/main/docs>
does not exist.
[ERROR] around Ant part ...<copy
todir="<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/docs-src";>...>
@ 5:127 in
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/antrun/build-main.xml>
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-hdfs
Build step 'Execute shell' marked build as failure
Archiving artifacts
Sending artifact delta relative to Hadoop-Hdfs-trunk-Java8 #175
Archived 1 artifacts
Archive block size is 32768
Received 0 blocks and 810490 bytes
Compression is 0.0%
Took 24 sec
Recording test results
Updating MAPREDUCE-5708
Updating HDFS-8371
Updating HADOOP-11713
Updating YARN-3505
Updating HADOOP-11960
Updating HDFS-8350
Updating HDFS-6888
Updating MAPREDUCE-6273
Updating YARN-1519
