[jira] [Reopened] (HDFS-2287) TestParallelRead has a small off-by-one bug

[ https://issues.apache.org/jira/browse/HDFS-2287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko reopened HDFS-2287: --- Second assert need to be fixed. > TestParallelRead has a small off-by-one

[jira] [Created] (HDFS-2592) HA: Balancer support for HA namenodes

HA: Balancer support for HA namenodes - Key: HDFS-2592 URL: https://issues.apache.org/jira/browse/HDFS-2592 Project: Hadoop HDFS Issue Type: Sub-task Components: balancer, ha Affects Versions

[jira] [Created] (HDFS-2591) HA: MiniDFSCluster support to mix and match federation with HA

HA: MiniDFSCluster support to mix and match federation with HA -- Key: HDFS-2591 URL: https://issues.apache.org/jira/browse/HDFS-2591 Project: Hadoop HDFS Issue Type: Sub-task

RE: Blocks are getting corrupted under very high load

Thanks Todd. Finally we also started suspecting in that angle. Planned to take the file details before reboot and after reboot. With the above analysis i can confirm, whether the same issue or not. One more thing to notice is that the difference between reboot time and last replica finalization

[jira] [Created] (HDFS-2590) Some links in WebHDFS forrest doc do not work

Some links in WebHDFS forrest doc do not work - Key: HDFS-2590 URL: https://issues.apache.org/jira/browse/HDFS-2590 Project: Hadoop HDFS Issue Type: Bug Reporter: Tsz Wo (Nicholas), SZE

[jira] [Reopened] (HDFS-1084) TestDFSShell fails in trunk.

[ https://issues.apache.org/jira/browse/HDFS-1084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko reopened HDFS-1084: --- > TestDFSShell fails in trunk. > > > Key:

[jira] [Resolved] (HDFS-1496) TestStorageRestore is failing after HDFS-903 fix

[ https://issues.apache.org/jira/browse/HDFS-1496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved HDFS-1496. --- Resolution: Duplicate > TestStorageRestore is failing after HDFS-903 fix > ---

[jira] [Resolved] (HDFS-1084) TestDFSShell fails in trunk.

[ https://issues.apache.org/jira/browse/HDFS-1084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved HDFS-1084. --- Resolution: Duplicate > TestDFSShell fails in trunk. > ---

[jira] [Reopened] (HDFS-1496) TestStorageRestore is failing after HDFS-903 fix

[ https://issues.apache.org/jira/browse/HDFS-1496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko reopened HDFS-1496: --- > TestStorageRestore is failing after HDFS-903 fix > -

[jira] [Resolved] (HDFS-1617) CLONE to COMMON - Batch the calls in DataStorage to FileUtil.createHardLink(), so we call it once per directory instead of once per file

[ https://issues.apache.org/jira/browse/HDFS-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved HDFS-1617. --- Resolution: Duplicate > CLONE to COMMON - Batch the calls in DataStorage to > Fil

[jira] [Reopened] (HDFS-1617) CLONE to COMMON - Batch the calls in DataStorage to FileUtil.createHardLink(), so we call it once per directory instead of once per file

[ https://issues.apache.org/jira/browse/HDFS-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko reopened HDFS-1617: --- > CLONE to COMMON - Batch the calls in DataStorage to > FileUtil.createHardLink(), so

[jira] [Resolved] (HDFS-2577) HA: NN fails to start since it tries to start secret manager in safemode

[ https://issues.apache.org/jira/browse/HDFS-2577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-2577. --- Resolution: Fixed Fix Version/s: HA branch (HDFS-1623) Hadoop Flags: Reviewed > HA: NN

Re: Blocks are getting corrupted under very high load

On Wed, Nov 23, 2011 at 1:23 AM, Uma Maheswara Rao G wrote: > Yes, Todd,  block after restart is small and  genstamp also lesser. >   Here complete machine reboot happend. The boards are configured like, if it > is not getting any CPU cycles  for 480secs, it will reboot himself. >  kernal.hung_ta

Hadoop-Hdfs-22-branch - Build # 113 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-22-branch/113/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 2190 lines...] ivy-resolve-common: ivy-retrieve-comm

[jira] [Resolved] (HDFS-2587) Add WebHDFS apt doc

[ https://issues.apache.org/jira/browse/HDFS-2587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-2587. -- Resolution: Fixed Fix Version/s: 0.23.1 0.24.0 Had

[jira] [Created] (HDFS-2589) unnecessary hftp token fetch and renewal thread

unnecessary hftp token fetch and renewal thread --- Key: HDFS-2589 URL: https://issues.apache.org/jira/browse/HDFS-2589 Project: Hadoop HDFS Issue Type: Bug Components: security Affec

[jira] [Resolved] (HDFS-2588) hdfs jsp pages missing DOCTYPE

[ https://issues.apache.org/jira/browse/HDFS-2588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-2588. -- Resolution: Fixed Fix Version/s: 0.23.1 0.20.205.1 Hadoop Flags: Reviewed

[jira] [Created] (HDFS-2588) hdfs jsp pages missing DOCTYPE

hdfs jsp pages missing DOCTYPE -- Key: HDFS-2588 URL: https://issues.apache.org/jira/browse/HDFS-2588 Project: Hadoop HDFS Issue Type: Bug Components: scripts Reporter: Dave Vronay

Hadoop-Hdfs-trunk - Build # 872 - Still Unstable

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/872/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 10640 lines...] [INFO] ** FindBugsMojo execute ***

Jenkins build is still unstable: Hadoop-Hdfs-trunk #872

See

Hadoop-Hdfs-0.23-Build - Build # 85 - Failure

See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/85/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 12141 lines...] [INFO] xmlOutput is false [INFO]

Build failed in Jenkins: Hadoop-Hdfs-0.23-Build #85

See Changes: [acmurthy] Merge -c 1205260 from trunk to branch-0.23 to fix MAPREDUCE-3329. [acmurthy] Changing branch-0.23 to 0.23.1-SNAPSHOT. [mahadev] MAPREDUCE-3411. Performance Upgrade for jQuery (Jonathan Eagles via mahadev)

RE: Blocks are getting corrupted under very high load

Yes, Todd, block after restart is small and genstamp also lesser. Here complete machine reboot happend. The boards are configured like, if it is not getting any CPU cycles for 480secs, it will reboot himself. kernal.hung_task_timeout_secs = 480 sec. Due to this timeout, automatically reb

Re: Blocks are getting corrupted under very high load

I noticed that the reported block after restart is also much smaller than the block reported earlier. Any chance when your DN restarted it actually lost power? ie do you mean that just the DN JVM restarted, or that the whole machine crashed and restarted? On Tue, Nov 22, 2011 at 9:17 PM, Uma Mahe