Re: HDFS upgrade problem of fsImage

No. I don't do any upgrade before this. I just want to rolling upgrade HDFS to hadoop-2.2.0, any further ideas? Thanks. On Thu, Nov 21, 2013 at 1:28 PM, Vinayakumar B wrote: > Looks like you have already have upgraded cluster.. And you are trying to > upgrade one more time. > > > -Original

RE: HDFS upgrade problem of fsImage

Looks like you have already have upgraded cluster.. And you are trying to upgrade one more time. -Original Message- From: Azuryy Yu [mailto:azury...@gmail.com] Sent: 21 November 2013 09:49 To: hdfs-dev@hadoop.apache.org; u...@hadoop.apache.org Subject: HDFS upgrade problem of fsImage H

Re: Metrics2 code

Hey LiuLei, Gauges can go up and down, counters only go up. Snapshot doesn't actually reset anything, it's just a way for the metrics system to get an updated value. There aren't any time-based rolling metrics to my knowledge besides MutableQuantiles. Best, Andrew On Wed, Nov 20, 2013 at 7:34 P

HDFS upgrade problem of fsImage

Hi Dear, I have a small test cluster with hadoop-2.0x, and HA configuraded, but I want to upgrade to hadoop-2.2. I dont't want to stop cluster during upgrade, so my steps are: 1) on standby NN: hadoop-dameon.sh stop namenode 2) remove HA configuration in the conf 3) hadoop-daemon.sh start na

[jira] [Created] (HDFS-5543) fix narrow race condition in TestPathBasedCacheRequests

Colin Patrick McCabe created HDFS-5543: -- Summary: fix narrow race condition in TestPathBasedCacheRequests Key: HDFS-5543 URL: https://issues.apache.org/jira/browse/HDFS-5543 Project: Hadoop HDFS

Metrics2 code

I use cdh-4.3.1 version. I am reading the code about metrics2. There are COUNTER and GAUGE metric type in metrics v2. What is the difference between the two? There is @Metric MutableCounterLong bytesWritten attribute in DataNodeMetrics, which is used to statistics written bytes per second on D

[jira] [Created] (HDFS-5541) LIBHDFS questions and performance suggestions

Stephen Bovy created HDFS-5541: -- Summary: LIBHDFS questions and performance suggestions Key: HDFS-5541 URL: https://issues.apache.org/jira/browse/HDFS-5541 Project: Hadoop HDFS Issue Type: Impro

[jira] [Created] (HDFS-5542) Fix TODO and clean up the code in HDFS-2832.

Tsz Wo (Nicholas), SZE created HDFS-5542: Summary: Fix TODO and clean up the code in HDFS-2832. Key: HDFS-5542 URL: https://issues.apache.org/jira/browse/HDFS-5542 Project: Hadoop HDFS

[jira] [Created] (HDFS-5540) Fix TestBlocksWithNotEnoughRacks

Binglin Chang created HDFS-5540: --- Summary: Fix TestBlocksWithNotEnoughRacks Key: HDFS-5540 URL: https://issues.apache.org/jira/browse/HDFS-5540 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-5539) NFS gateway secuirty enhancement

Brandon Li created HDFS-5539: Summary: NFS gateway secuirty enhancement Key: HDFS-5539 URL: https://issues.apache.org/jira/browse/HDFS-5539 Project: Hadoop HDFS Issue Type: New Feature

[jira] [Created] (HDFS-5538) URLConnectionFactory should pick up the SSL related configuration by default

Haohui Mai created HDFS-5538: Summary: URLConnectionFactory should pick up the SSL related configuration by default Key: HDFS-5538 URL: https://issues.apache.org/jira/browse/HDFS-5538 Project: Hadoop HDFS

[jira] [Created] (HDFS-5537) Remove FileWithSnapshot interface

Jing Zhao created HDFS-5537: --- Summary: Remove FileWithSnapshot interface Key: HDFS-5537 URL: https://issues.apache.org/jira/browse/HDFS-5537 Project: Hadoop HDFS Issue Type: Sub-task Re

[jira] [Created] (HDFS-5536) Implement HTTP policy for Namenode and DataNode

Haohui Mai created HDFS-5536: Summary: Implement HTTP policy for Namenode and DataNode Key: HDFS-5536 URL: https://issues.apache.org/jira/browse/HDFS-5536 Project: Hadoop HDFS Issue Type: Sub-tas

[jira] [Created] (HDFS-5535) Umbrella jira for improved HDFS rolling upgrades

Nathan Roberts created HDFS-5535: Summary: Umbrella jira for improved HDFS rolling upgrades Key: HDFS-5535 URL: https://issues.apache.org/jira/browse/HDFS-5535 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-5534) change testUncachingBlocksBeforeCachingFinishes to use explicit synchronization rather than a delay

Colin Patrick McCabe created HDFS-5534: -- Summary: change testUncachingBlocksBeforeCachingFinishes to use explicit synchronization rather than a delay Key: HDFS-5534 URL: https://issues.apache.org/jira/browse/

[jira] [Resolved] (HDFS-5527) Fix TestUnderReplicatedBlocks on branch HDFS-2832

[ https://issues.apache.org/jira/browse/HDFS-5527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-5527. - Resolution: Fixed Fix Version/s: Heterogeneous Storage (HDFS-2832) Thanks for reviewing and

Re: issue about rpc activity metrics

The metrics system generates a number of different entries per in-code metrics object. For instance, the "SendHeartbeat" MutableRate will generate both "NumOps" and "AvgTime". Look in NameNodeMetrics.java for where these are updated. Best, Andrew On Tue, Nov 19, 2013 at 10:52 PM, ch huang wrot

Re: Next releases

Jason, I'm glad to see we are converging. I'll update the Roadmap wiki with details about major/minor/patch releases. Here is a straight-forward approach for now: I'll just roll contents of branch-2.2 as a 2.3-rc0 candidate right-away. This way we don't have to get embroiled in details of in

RE: is block pool on NN or DN?

This blog post should clear it up: http://hortonworks.com/blog/an-introduction-to-hdfs-federation/ -Original Message- From: ch huang [mailto:justlo...@gmail.com] Sent: Wednesday, November 20, 2013 12:26 AM To: hdfs-dev@hadoop.apache.org Subject: is block pool on NN or DN? hi,all:

Build failed in Jenkins: Hadoop-Hdfs-trunk #1588

See Changes: [bikas] YARN-744. Race condition in ApplicationMasterService.allocate .. It might process same allocate request twice resulting in additional containers getting allocated. (Omkar Vinit Joshi via bikas) [sandy] Move YAR

Hadoop-Hdfs-trunk - Build # 1588 - Failure

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1588/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 11782 lines...] [mkdir] Created dir: /home/jenkins/j

Hadoop-Hdfs-0.23-Build - Build # 796 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/796/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7892 lines...] [ERROR] location: class com.google.pro

Build failed in Jenkins: Hadoop-Hdfs-0.23-Build #796

See -- [...truncated 7699 lines...] [ERROR] symbol : class Parser [ERROR] location: package com.google.protobuf [ERROR]