Re: Load balancing requests in HDFS

2011-10-18 Thread Uma Maheswara Rao G 72686
- Original Message - From: Bharath Ravi Date: Wednesday, October 19, 2011 8:16 am Subject: Re: Load balancing requests in HDFS To: common-dev@hadoop.apache.org > Thanks a lot Steve! > > ReplicationTargetChooser seems to address load balancing for initially > placing/laying out data, > bu

Re: Load balancing requests in HDFS

2011-10-18 Thread Bharath Ravi
Thanks a lot Steve! ReplicationTargetChooser seems to address load balancing for initially placing/laying out data, but it doesn't seem to do active load balancing for incoming requests to a datanode: or does it? Also, would you know if there are statistics on how effective over-replication is fo

[jira] [Resolved] (HADOOP-7649) TestMapredGroupMappingServiceRefresh and TestRefreshUserMappings fail after HADOOP-7625

2011-10-18 Thread Matt Foley (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HADOOP-7649. Resolution: Fixed Fix Version/s: (was: 0.20.206.0) > TestMapredGroupMappingServiceR

Re: Hadoop Tools Layout (was Re: DistCpV2 in 0.23)

2011-10-18 Thread Alejandro Abdelnur
Following up on this one, the hadoop-tools/ module is already in trunk, distcp v2 addition could start. Thanks. Alejandro On Mon, Sep 12, 2011 at 6:47 AM, Vinod Kumar Vavilapalli < vino...@hortonworks.com> wrote: > Alright, I think we've discussed enough on this and everybody seems to > agree >

[ANNOUNCEMENT] Hadoop 0.20.205.0 release

2011-10-18 Thread Matt Foley
On Friday 14 Oct, the Hadoop community voted ten to zero (including four PMC members voting in favor) to accept the release of Hadoop 0.20.205.0. The biggest feature of this release is that it merges the append/hsync/hflush features of branch-0.20-append, and security features of branch-0.20-secur

Re: Load balancing requests in HDFS

2011-10-18 Thread Steve Loughran
On 16/10/11 02:53, Bharath Ravi wrote: Hi all, I have a question about how HDFS load balances requests for files/blocks: HDFS currently distributes data blocks randomly, for balance. However, if certain files/blocks are more popular than others, some nodes might get an "unfair" number of reques

Re: Publishing maven snapshots for 0.23?

2011-10-18 Thread Steve Loughran
On 14/10/11 20:53, Todd Lipcon wrote: On Fri, Oct 14, 2011 at 12:39 PM, giridharan kesavan wrote: Todd, I like the idea of setting up commit builds for 23 branch; I can set this up. As I said on -general, I'd like some stable-ish pre-alpha artifacts for downstream projects to use, somethi

Build failed in Jenkins: Hadoop-Common-trunk #200

2011-10-18 Thread Apache Jenkins Server
See Changes: [acmurthy] MAPREDUCE-279. Adding a changelog to branch-0.23. [mahadev] MAPREDUCE-3197. TestMRClientService failing on building clean checkout of branch 0.23 (mahadev) [acmurthy] MAPREDUCE-3068. Added a whitelist of en