Re: Is there any Namenode block scheduler which considers the block load

Anil, I actually moved your mail into hdfs-dev@ earlier and also responded. But anyway, re-posting since you perhaps did not notice it: The transfer thread load is definitely considered when building the DN replication pipeline. See the method ReplicationTargetChooser#isGoodTarget(…), which is ca

Review Request for HDFS-140

Hi, Provided the patch for HDFS-140. If you have some free time, can you please review it? HDFS-140 (When a file is deleted, its blocks remain in the blocksmap till the next block report from Datanode) It will give advantage in terms of memory usage at NN side. Thanks & Regards, Uma

[jira] [Created] (HDFS-2442) hdfs-test artifact doesn't include config file for cluster execution

hdfs-test artifact doesn't include config file for cluster execution Key: HDFS-2442 URL: https://issues.apache.org/jira/browse/HDFS-2442 Project: Hadoop HDFS Issue Type: Bu

Hadoop-Hdfs-22-branch - Build # 97 - Failure

See https://builds.apache.org/job/Hadoop-Hdfs-22-branch/97/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 3108 lines...] [delete] Deleting directory /home/je

[jira] [Resolved] (HDFS-1762) Allow TestHDFSCLI to be run against a cluster

[ https://issues.apache.org/jira/browse/HDFS-1762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik resolved HDFS-1762. -- Resolution: Fixed Fix Version/s: 0.22.0 Hadoop Flags: Reviewed I have commit

[jira] [Resolved] (HDFS-2301) Start/stop appropriate namenode internal services during transition to active and standby

[ https://issues.apache.org/jira/browse/HDFS-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-2301. --- Resolution: Fixed Hadoop Flags: Reviewed I committed the patch. > Start

[jira] [Created] (HDFS-2440) webhdfs open a file and send 0 or invalid bufferSize throws a 500 with xml content

webhdfs open a file and send 0 or invalid bufferSize throws a 500 with xml content -- Key: HDFS-2440 URL: https://issues.apache.org/jira/browse/HDFS-2440 Project: Hadoop

[jira] [Created] (HDFS-2439) webhdfs open an invalid path leads to a 500 which states a npe, we should return a 404 with appropriate error message

webhdfs open an invalid path leads to a 500 which states a npe, we should return a 404 with appropriate error message - Key: HDFS-2439 URL: https:/

[jira] [Created] (HDFS-2438) webhdfs setowner and send an empty value for owner returns a 200

webhdfs setowner and send an empty value for owner returns a 200 Key: HDFS-2438 URL: https://issues.apache.org/jira/browse/HDFS-2438 Project: Hadoop HDFS Issue Type: Bug Af

[jira] [Created] (HDFS-2437) webhdfs setowner does not set the group to new value

webhdfs setowner does not set the group to new value Key: HDFS-2437 URL: https://issues.apache.org/jira/browse/HDFS-2437 Project: Hadoop HDFS Issue Type: Bug Affects Versions: 0.20.205

[jira] [Resolved] (HDFS-2435) webhdfs able to set access and mod times of paths to a value in future

[ https://issues.apache.org/jira/browse/HDFS-2435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Gupta resolved HDFS-2435. --- Resolution: Invalid resolving it as invalid as i am able to the same using the touch command on linux

[jira] [Created] (HDFS-2436) webhdfs settimes api returns a 404 when called on a dir

webhdfs settimes api returns a 404 when called on a dir --- Key: HDFS-2436 URL: https://issues.apache.org/jira/browse/HDFS-2436 Project: Hadoop HDFS Issue Type: Bug Affects Versions: 0.

[jira] [Created] (HDFS-2435) webhdfs able to set access and mod times of paths to a value in future

webhdfs able to set access and mod times of paths to a value in future -- Key: HDFS-2435 URL: https://issues.apache.org/jira/browse/HDFS-2435 Project: Hadoop HDFS Issue Type

RE: Please subscribe me

Hi Anil, send mail to "hdfs-user-subscr...@hadoop.apache.org" for subscription. Please refer this link for more details. http://hadoop.apache.org/hdfs/mailing_lists.html Thanks Devaraj From: AnilKumar B [akumarb2...@gmail.com] Sent: Tuesday, October 11, 2

Please subscribe me

Please subscribe me. Thanks, B Anil Kumar.

Is there any Namenode block scheduler which considers the block load

Scenario: If I run huge number of jobs(all these jobs will use the same resources(input files)) on mini cluster(say 10-15 nodes), then every time namenode returning the first block of nearest data node. So in this case all the clients are trying to do read/write operations on same block. So is the

[jira] [Created] (HDFS-2434) TestNameNodeMetrics.testCorruptBlock fails intermittently

TestNameNodeMetrics.testCorruptBlock fails intermittently - Key: HDFS-2434 URL: https://issues.apache.org/jira/browse/HDFS-2434 Project: Hadoop HDFS Issue Type: Bug Components

[jira] [Created] (HDFS-2433) TestFileAppend4 fails intermittently

TestFileAppend4 fails intermittently Key: HDFS-2433 URL: https://issues.apache.org/jira/browse/HDFS-2433 Project: Hadoop HDFS Issue Type: Bug Components: data-node, name-node, test Affects V

Hadoop-Hdfs-0.23-Build - Build # 36 - Still Unstable

See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/36/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 9771 lines...] [INFO] [INFO] --- maven-antrun-plugin:

Jenkins build is still unstable: Hadoop-Hdfs-0.23-Build #36

See

Re: Is there any Namenode block scheduler which considers the block load

Anil, Moving this to hdfs-dev@. The transfer thread load is definitely considered when building the DN replication pipeline. See the method ReplicationTargetChooser#isGoodTarget(…), which is called during each type of choice (local node, local rack, remote rack or random). One part of its analysi

Build failed in Jenkins: Hadoop-Hdfs-trunk #827

See Changes: [mahadev] MAPREDUCE-3167. container-executor is not being packaged with the assembly target. (mahadev) [vinodkv] MAPREDUCE-3161. Improved some javadocs and fixed some typos in YARN. Contributed by Todd Lipcon. [atm] HD

Hadoop-Hdfs-trunk - Build # 827 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/827/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 10110 lines...] [INFO] Executed tasks [INFO] [INFO] --- m