[jira] Created: (HDFS-1620) FSConstants vs FsConstants
FSConstants vs FsConstants
---
Key: HDFS-1620
URL: https://issues.apache.org/jira/browse/HDFS-1620
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Tsz Wo (Nicholas), SZE
Priority: Minor
We have {{org.apache.hadoop.hdfs.protocol.*FSConstants*}} and
{{org.apache.hadoop.fs.*FsConstants*}}. Elegant or confused?
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Created: (HDFS-1621) Fix references to hadoop-common-${version} in build.xml
Fix references to hadoop-common-${version} in build.xml
---
Key: HDFS-1621
URL: https://issues.apache.org/jira/browse/HDFS-1621
Project: Hadoop HDFS
Issue Type: Bug
Reporter: Todd Lipcon
Assignee: Todd Lipcon
Similar to MAPREDUCE-2315, we should fix any references to the hadoop common
jar that use ${version} instead of ${hadoop-common.version}.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
Hadoop-Hdfs-trunk - Build # 578 - Still Failing
See https://hudson.apache.org/hudson/job/Hadoop-Hdfs-trunk/578/
###
## LAST 60 LINES OF THE CONSOLE
###
[...truncated 662998 lines...]
[junit] at
org.apache.hadoop.fi.DataTransferTestUtil$SleepAction.run(DataTransferTestUtil.java:1)
[junit] at
org.apache.hadoop.fi.FiTestUtil$ActionContainer.run(FiTestUtil.java:116)
[junit] at
org.apache.hadoop.hdfs.server.datanode.BlockReceiverAspects.ajc$before$org_apache_hadoop_hdfs_server_datanode_BlockReceiverAspects$7$b9c2bffe(BlockReceiverAspects.aj:193)
[junit] at
org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:445)
[junit] at
org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:633)
[junit] at
org.apache.hadoop.hdfs.server.datanode.DataXceiver.opWriteBlock(DataXceiver.java:390)
[junit] at
org.apache.hadoop.hdfs.protocol.DataTransferProtocol$Receiver.opWriteBlock(DataTransferProtocol.java:389)
[junit] at
org.apache.hadoop.hdfs.protocol.DataTransferProtocol$Receiver.processOp(DataTransferProtocol.java:331)
[junit] at
org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:130)
[junit] at java.lang.Thread.run(Thread.java:619)
[junit] Caused by: java.lang.InterruptedException: sleep interrupted
[junit] at java.lang.Thread.sleep(Native Method)
[junit] at org.apache.hadoop.fi.FiTestUtil.sleep(FiTestUtil.java:80)
[junit] ... 11 more
[junit] 2011-02-10 12:47:13,695 INFO datanode.DataNode
(DataNode.java:shutdown(786)) - Waiting for threadgroup to exit, active threads
is 0
[junit] 2011-02-10 12:47:13,709 INFO datanode.DataBlockScanner
(DataBlockScanner.java:run(622)) - Exiting DataBlockScanner thread.
[junit] 2011-02-10 12:47:13,795 INFO datanode.DataNode
(DataNode.java:run(1460)) - DatanodeRegistration(127.0.0.1:51219,
storageID=DS-1434452765-127.0.1.1-51219-1297342022685, infoPort=48801,
ipcPort=37337):Finishing DataNode in:
FSDataset{dirpath='/grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build-fi/test/data/dfs/data/data1/current/finalized,/grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build-fi/test/data/dfs/data/data2/current/finalized'}
[junit] 2011-02-10 12:47:13,795 INFO ipc.Server (Server.java:stop(1610)) -
Stopping server on 37337
[junit] 2011-02-10 12:47:13,796 INFO datanode.DataNode
(DataNode.java:shutdown(786)) - Waiting for threadgroup to exit, active threads
is 0
[junit] 2011-02-10 12:47:13,796 INFO datanode.FSDatasetAsyncDiskService
(FSDatasetAsyncDiskService.java:shutdown(133)) - Shutting down all async disk
service threads...
[junit] 2011-02-10 12:47:13,796 INFO datanode.FSDatasetAsyncDiskService
(FSDatasetAsyncDiskService.java:shutdown(142)) - All async disk service threads
have been shut down.
[junit] 2011-02-10 12:47:13,797 WARN datanode.FSDatasetAsyncDiskService
(FSDatasetAsyncDiskService.java:shutdown(130)) - AsyncDiskService has already
shut down.
[junit] 2011-02-10 12:47:13,898 WARN namenode.FSNamesystem
(FSNamesystem.java:run(2847)) - ReplicationMonitor thread received
InterruptedException.java.lang.InterruptedException: sleep interrupted
[junit] 2011-02-10 12:47:13,899 INFO namenode.FSEditLog
(FSEditLog.java:printStatistics(559)) - Number of transactions: 6 Total time
for transactions(ms): 2Number of transactions batched in Syncs: 0 Number of
syncs: 3 SyncTimes(ms): 4 4
[junit] 2011-02-10 12:47:13,898 WARN namenode.DecommissionManager
(DecommissionManager.java:run(70)) - Monitor interrupted:
java.lang.InterruptedException: sleep interrupted
[junit] 2011-02-10 12:47:13,900 INFO ipc.Server (Server.java:stop(1610)) -
Stopping server on 37835
[junit] 2011-02-10 12:47:13,900 INFO ipc.Server (Server.java:run(1443)) -
IPC Server handler 0 on 37835: exiting
[junit] 2011-02-10 12:47:13,901 INFO ipc.Server (Server.java:run(1443)) -
IPC Server handler 9 on 37835: exiting
[junit] 2011-02-10 12:47:13,901 INFO ipc.Server (Server.java:run(475)) -
Stopping IPC Server listener on 37835
[junit] 2011-02-10 12:47:13,901 INFO ipc.Server (Server.java:run(675)) -
Stopping IPC Server Responder
[junit] 2011-02-10 12:47:13,901 INFO ipc.Server (Server.java:run(1443)) -
IPC Server handler 8 on 37835: exiting
[junit] 2011-02-10 12:47:13,901 INFO ipc.Server (Server.java:run(1443)) -
IPC Server handler 3 on 37835: exiting
[junit] 2011-02-10 12:47:13,901 INFO ipc.Server (Server.java:run(1443)) -
IPC Server handler 5 on 37835: exiting
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 36.823 sec
[junit] 2011-02-10 12:47:13,901 INFO ipc.Server (Server.java:run(1443)) -
IPC Server handler 6 on 37835: exiting
[junit] 2011-02-10 12:47:13,902 INFO ipc.Server (Server.java:run(1443))
[jira] Created: (HDFS-1622) Update TestDFSUpgradeFromImage to test batch hardlink improvment
Update TestDFSUpgradeFromImage to test batch hardlink improvment Key: HDFS-1622 URL: https://issues.apache.org/jira/browse/HDFS-1622 Project: Hadoop HDFS Issue Type: Improvement Reporter: Hairong Kuang Matt has done a great job in HDFS-1443 that uses batch link command to improve datanode upgrade performance. However TestDFSUpgradeImage upgrades from an image layout of -7 which is too old to test the batch feature. We need to update this test to use a more recent layout. -- This message is automatically generated by JIRA. - For more information on JIRA, see: http://www.atlassian.com/software/jira
Hadoop-Hdfs-22-branch - Build # 22 - Still Failing
See https://hudson.apache.org/hudson/job/Hadoop-Hdfs-22-branch/22/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 2906 lines...] [junit] Running org.apache.hadoop.hdfs.TestDFSClientRetries [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 43.019 sec [junit] Running org.apache.hadoop.hdfs.TestDFSPermission [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 17.339 sec [junit] Running org.apache.hadoop.hdfs.TestDFSRemove [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 14.454 sec [junit] Running org.apache.hadoop.hdfs.TestDFSStartupVersions [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 19.253 sec [junit] Running org.apache.hadoop.hdfs.TestDFSUpgrade [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 27.149 sec [junit] Running org.apache.hadoop.hdfs.TestDFSUtil [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.17 sec [junit] Running org.apache.hadoop.hdfs.TestDatanodeBlockScanner [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 97.15 sec [junit] Running org.apache.hadoop.hdfs.TestDatanodeConfig [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 2.451 sec [junit] Running org.apache.hadoop.hdfs.TestDatanodeDeath [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 129.106 sec [junit] Running org.apache.hadoop.hdfs.TestDatanodeRegistration [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 3.808 sec [junit] Running org.apache.hadoop.hdfs.TestDecommission [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 32.382 sec [junit] Running org.apache.hadoop.hdfs.TestDeprecatedKeys [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.257 sec [junit] Running org.apache.hadoop.hdfs.TestDfsOverAvroRpc [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 3.394 sec [junit] Running org.apache.hadoop.hdfs.TestFileAppend4 [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 9.728 sec [junit] Running org.apache.hadoop.hdfs.TestFileConcurrentReader [junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 31.532 sec [junit] Running org.apache.hadoop.hdfs.TestFileCreation [junit] Tests run: 12, Failures: 0, Errors: 0, Time elapsed: 47.992 sec [junit] Running org.apache.hadoop.hdfs.TestFileCreationClient [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 9.609 sec [junit] Running org.apache.hadoop.hdfs.TestFileCreationDelete [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 12.825 sec [junit] Running org.apache.hadoop.hdfs.TestFileCreationEmpty [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 8.136 sec [junit] Running org.apache.hadoop.hdfs.TestHDFSFileSystemContract [junit] Tests run: 28, Failures: 0, Errors: 0, Time elapsed: 35.695 sec [junit] Running org.apache.hadoop.hdfs.TestHFlush [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 19.144 sec [junit] Running org.apache.hadoop.hdfs.TestHftpFileSystem [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 2.738 sec [junit] Running org.apache.hadoop.hdfs.TestInjectionForSimulatedStorage [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 14.365 sec [junit] Running org.apache.hadoop.hdfs.TestLargeBlock [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 44.525 sec [junit] Running org.apache.hadoop.hdfs.TestLeaseRecovery2 Build timed out. Aborting [FINDBUGS] Skipping publisher since build result is FAILURE Publishing Javadoc Archiving artifacts Recording test results Recording fingerprints Publishing Clover coverage report... No Clover report will be published due to a Build Failure Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## 1 tests failed. FAILED: TEST-org.apache.hadoop.hdfs.TestLeaseRecovery2.xml. Error Message: Stack Trace: Test report file /grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-22-branch/trunk/build/test/TEST-org.apache.hadoop.hdfs.TestLeaseRecovery2.xml was length 0
[jira] Resolved: (HDFS-875) NameNode incorretly handles corrupt replicas
[ https://issues.apache.org/jira/browse/HDFS-875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved HDFS-875. -- Resolution: Duplicate Resolving as duplicate of HDFS-900. Feel free to reopen if there is more work needed. > NameNode incorretly handles corrupt replicas > > > Key: HDFS-875 > URL: https://issues.apache.org/jira/browse/HDFS-875 > Project: Hadoop HDFS > Issue Type: Bug > Components: name-node >Affects Versions: 0.21.0, 0.22.0 >Reporter: Hairong Kuang >Priority: Blocker > Fix For: 0.22.0 > > > I reviewed how NameNode handles corrupt replicas as part of work on HDFS-145. > Comparing to releases prior to 0.21, NameNode now does a good job identifying > corrupt replicas, but it seems to me there are two flaws how it handles the > corrupt replicas: > 1. NameNode does not add corrupt replicas to the block locations as what > NameNode does before; > 2. If the corruption is caused by generation stamp mismatch or state > mismatch, the wrong GS and state do not get put in corruptReplicasMap. > Therefore it may lead to the deletion of the wrong replica. -- This message is automatically generated by JIRA. - For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Resolved: (HDFS-1496) TestStorageRestore is failing after HDFS-903 fix
[ https://issues.apache.org/jira/browse/HDFS-1496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved HDFS-1496. --- Resolution: Fixed Fixed by HDFS-1602. > TestStorageRestore is failing after HDFS-903 fix > > > Key: HDFS-1496 > URL: https://issues.apache.org/jira/browse/HDFS-1496 > Project: Hadoop HDFS > Issue Type: Bug > Components: test >Affects Versions: 0.22.0, 0.23.0 >Reporter: Konstantin Boudnik >Assignee: Hairong Kuang >Priority: Blocker > Fix For: 0.22.0 > > Attachments: HDFS-1496.sh, HDFS-1496.sh, HDFS-1496.sh > > > TestStorageRestore seems to be failing after HDFS-903 commit. Running git > bisect confirms it. -- This message is automatically generated by JIRA. - For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Created: (HDFS-1623) High Availability Framework for HDFS NN
High Availability Framework for HDFS NN --- Key: HDFS-1623 URL: https://issues.apache.org/jira/browse/HDFS-1623 Project: Hadoop HDFS Issue Type: New Feature Reporter: Sanjay Radia Assignee: Sanjay Radia -- This message is automatically generated by JIRA. - For more information on JIRA, see: http://www.atlassian.com/software/jira
