Re: Please join me in welcoming the following people as committers to the Hadoop project

Congrats, all! On Wed, Jan 5, 2011 at 11:09 PM, Stack wrote: > Congrats lads. > St.Ack > > On Wed, Jan 5, 2011 at 7:40 PM, Ian Holsman wrote: > > On behalf of the Apache Hadoop PMC, I would like to extend a warm welcome > to the following people, > > who have all chosen to accept the role of co

Re: I am a new comer and have a question about HDFS code check out

Hi Min, look at the unit tests which make use of MiniDFSCluster -- you can run those in debug mode and step through the code, and they include a bunch of use cases. That's generally much easier than running all of the different services and debugging each separately. On Mon, Sep 13, 2010 at 9:30

[jira] Created: (HDFS-1323) Pool/share file channels for HDFS read

Reporter: Jay Booth Fix For: 0.20-append, 0.22.0 Currently, all reads in HDFS require opening and closing the underlying block/meta filechannels. We could pool these filechannels and save some system calls and other work. Since HDFS read requests can be satisfied by positioned reads

Re: HDFS Blockreport question

s with name node. > >> > >> I'm sorry for this silly question, but i am really lost at this point. > >> > >> Thanks for the patience. > >> > >> > >> > >> On Fri, Apr 2, 2010 at 2:11 AM, Alberich de megres > >> wrote: >

Re: HDFS Blockreport question

In DataNode: public DatanodeProtocol namenode It's not a reference to an actual namenode, it's a wrapper for a network protocol created by that RPC.waitForProxy call -- so when it calls namenode.blockReport, it's sending that information over RPC to the namenode instance over the network On Thu,

[jira] Created: (HDFS-918) Use single Selector and small thread pool to replace many instances of BlockSender for reads

Project: Hadoop HDFS Issue Type: Improvement Components: data-node Reporter: Jay Booth Fix For: 0.22.0 Currently, on read requests, the DataXCeiver server allocates a new thread per request, which must allocate its own buffers and leads to higher

Re: Question: how to run hadoop after the project split?

Yeah, I'm hitting the same issues, the patch problems weren't really an issue (same line for same line conflict on my checkout), but not having the webapp's sort of a pain. Looks like ant bin-package puts the webapps dir in HDFS_HOME/build/hadoop-hdfs-0.21.0-dev/webapps, while the daemon's expecti

[jira] Created: (HDFS-516) Low Latency distributed reads

Low Latency distributed reads - Key: HDFS-516 URL: https://issues.apache.org/jira/browse/HDFS-516 Project: Hadoop HDFS Issue Type: New Feature Reporter: Jay Booth Priority: Minor I