Build failed in Jenkins: Hadoop-Common-0.23-Build #74

2011-11-23 Thread Apache Jenkins Server
See Changes: [acmurthy] Merge -c 1205260 from trunk to branch-0.23 to fix MAPREDUCE-3329. [acmurthy] Changing branch-0.23 to 0.23.1-SNAPSHOT. [mahadev] MAPREDUCE-3411. Performance Upgrade for jQuery (Jonathan Eagles via mahade

RE: Blocks are getting corrupted under very high load

2011-11-23 Thread Uma Maheswara Rao G
Yes, Todd, block after restart is small and genstamp also lesser. Here complete machine reboot happend. The boards are configured like, if it is not getting any CPU cycles for 480secs, it will reboot himself. kernal.hung_task_timeout_secs = 480 sec. Due to this timeout, automatically reb

Hadoop metrics documentation

2011-11-23 Thread Paolo Rodeghiero
Hi to all the list, I'm doing my Master's Thesis on MapReduce and its implementation on Hadoop. I'm trying to validate a computational model using experimental results. To do so, I'm collecting metrics using metrics2. As I asked before on common-users, I can't find a proper documentation for

[jira] [Created] (HADOOP-7853) multiple javax security configurations cause conflicts

2011-11-23 Thread Daryn Sharp (Created) (JIRA)
multiple javax security configurations cause conflicts -- Key: HADOOP-7853 URL: https://issues.apache.org/jira/browse/HADOOP-7853 Project: Hadoop Common Issue Type: Bug Components

[jira] [Created] (HADOOP-7854) UGI getCurrentUser is not synchronized

2011-11-23 Thread Daryn Sharp (Created) (JIRA)
UGI getCurrentUser is not synchronized -- Key: HADOOP-7854 URL: https://issues.apache.org/jira/browse/HADOOP-7854 Project: Hadoop Common Issue Type: Bug Components: security Affects Versions:

[jira] [Resolved] (HADOOP-7831) ConcurrentModificationException in getCurrentUser()

2011-11-23 Thread Kihwal Lee (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-7831. Resolution: Duplicate Target Version/s: 0.20.205.1, 0.20.206.0 (was: 0.20.206.0, 0.20.20

Re: [ANNOUNCE] Intend to build a 0.20.205.1 candidate next Friday 11 Nov.

2011-11-23 Thread Jitendra Pandey
The trunk, 206 patches for HDFS-2246 have been committed. I think it makes sense to commit it to 205.1 as well for following reasons (most of it has already been mentioned) a) We intended this patch for 205, but couldn't finish in time. Now that 205.1 branch is still not cut, we could get this in.

Re: [ANNOUNCE] Intend to build a 0.20.205.1 candidate next Friday 11 Nov.

2011-11-23 Thread Suresh Srinivas
+1 for Jitendra's proposal. Additionally, most of the core of the code that this patch is based on has been tested and deployed in clusters at TrendMicro and Facebook. On Wed, Nov 23, 2011 at 11:10 AM, Jitendra Pandey wrote: > The trunk, 206 patches for HDFS-2246 have been committed. I think it

Re: [ANNOUNCE] Intend to build a 0.20.205.1 candidate next Friday 11 Nov.

2011-11-23 Thread Matt Foley
I really want this in 0.20.205.1, which will be Hadoop 1.0.0, because of its importance for good support of HBase. Jitendra, please merge it to branch-0.20-security-205. --Matt (wearing my Apache release manager hat) On Wed, Nov 23, 2011 at 11:14 AM, Suresh Srinivas wrote: > +1 for Jitendra's

Re: [ANNOUNCE] Intend to build a 0.20.205.1 candidate next Friday 11 Nov.

2011-11-23 Thread Eli Collins
Hey Matt, On the jira Jitendra referenced a 205.1 deadline. Where did you set or communicate that deadline? The last I saw on the lists (this thread) was that the 205.1 code freeze was Nov 11th. Thanks, Eli On Wed, Nov 23, 2011 at 2:56 PM, Matt Foley wrote: > I really want this in 0.20.205.1,

Re: Blocks are getting corrupted under very high load

2011-11-23 Thread Todd Lipcon
On Wed, Nov 23, 2011 at 1:23 AM, Uma Maheswara Rao G wrote: > Yes, Todd,  block after restart is small and  genstamp also lesser. >   Here complete machine reboot happend. The boards are configured like, if it > is not getting any CPU cycles  for 480secs, it will reboot himself. >  kernal.hung_ta

[jira] [Created] (HADOOP-7856) Improve DiskChecker javadocs

2011-11-23 Thread Eli Collins (Created) (JIRA)
Improve DiskChecker javadocs Key: HADOOP-7856 URL: https://issues.apache.org/jira/browse/HADOOP-7856 Project: Hadoop Common Issue Type: Bug Components: util Reporter: Eli Collins

[jira] [Created] (HADOOP-7855) Improve DiskChecker javadocs

2011-11-23 Thread Eli Collins (Created) (JIRA)
Improve DiskChecker javadocs Key: HADOOP-7855 URL: https://issues.apache.org/jira/browse/HADOOP-7855 Project: Hadoop Common Issue Type: Bug Components: util Reporter: Eli Collins

[jira] [Created] (HADOOP-7857) Encrypt hadoop files

2011-11-23 Thread Gabriel Eisbruch (Created) (JIRA)
Encrypt hadoop files Key: HADOOP-7857 URL: https://issues.apache.org/jira/browse/HADOOP-7857 Project: Hadoop Common Issue Type: New Feature Components: security Reporter: Gabriel Eisbruch

Re: Hadoop + MPI

2011-11-23 Thread Ralph Castain
FWIW: I can commit the OMPI part of your patch for you. The CCLA is intended to ensure that people realize the need to protect OMPI from "infection" due to code based on other licenses such as GPL. For people only offering a single patch, it often is too big a burden to get corporate approval of

Re: [ANNOUNCE] Intend to build a 0.20.205.1 candidate next Friday 11 Nov.

2011-11-23 Thread Matt Foley
Hi Eli, I said a couple weeks ago that I intended to cut 205.1 on Nov 11 -- that's the subject line of this thread :-) However, I got busy and did not make the 11/11/11 date, for which I apologize. In the meantime, a severe blocker bug, HADOOP-7853, has been found and fixed by folks at Yahoo, rel

[ANNOUNCE] Intend to build a 0.20.205.1 / 1.0.0 candidate this weekend

2011-11-23 Thread Matt Foley
Hi all, as noted in the previous thread, I apologize that I was not able to meet the Nov 11 deadline. I now intend to cut the 0.20.205.1 / 1.0.0 release candidate this weekend, no sooner than Sat 26 Nov 8:00am PST. Thank you, --Matt On Fri, Nov 4, 2011 at 5:56 PM, Matt Foley wrote: > Hi all, >

Re: Hadoop + MPI

2011-11-23 Thread Arun Murthy
Awesome, thanks to both you guys! It's very exciting to see this progress! Arun Sent from my iPhone On Nov 23, 2011, at 5:14 PM, Ralph Castain wrote: > FWIW: I can commit the OMPI part of your patch for you. The CCLA is intended > to ensure that people realize the need to protect OMPI from "i

Re: [ANNOUNCE] Intend to build a 0.20.205.1 candidate next Friday 11 Nov.

2011-11-23 Thread Roman Shaposhnik
Hi Matt, quick question: any reason we are ignoring multifilewc from hadoop examples? https://issues.apache.org/jira/browse/MAPREDUCE-3319 would be nice to fix it for 1.0 of Hadoop. Or at least disable. Thanks, Roman. On Wed, Nov 23, 2011 at 2:56 PM, Matt Foley wrote: > I really want this i

Re: [ANNOUNCE] Intend to build a 0.20.205.1 candidate next Friday 11 Nov.

2011-11-23 Thread Matt Foley
Hi Roman, Do you have a proposed patch? If so I would be happy to include it. Thanks, --Matt On Wed, Nov 23, 2011 at 5:14 PM, Roman Shaposhnik wrote: > Hi Matt, > > quick question: any reason we are ignoring multifilewc from hadoop > examples? > https://issues.apache.org/jira/browse/MAPREDUC

Re: [ANNOUNCE] Intend to build a 0.20.205.1 candidate next Friday 11 Nov.

2011-11-23 Thread Arun Murthy
On Nov 23, 2011, at 5:32 PM, Roman Shaposhnik wrote: > Hi Matt, > > quick question: any reason we are ignoring multifilewc from hadoop examples? > Roman - It isn't marked as a blocker nor is there a patch. Can you provide one? Arun > https://issues.apache.org/jira/browse/MAPREDUCE-3319 > > wo

Re: [ANNOUNCE] Intend to build a 0.20.205.1 candidate next Friday 11 Nov.

2011-11-23 Thread Arun C Murthy
On Nov 23, 2011, at 5:35 PM, Arun Murthy wrote: > On Nov 23, 2011, at 5:32 PM, Roman Shaposhnik wrote: > >> Hi Matt, >> >> quick question: any reason we are ignoring multifilewc from hadoop examples? >> > > Roman - It isn't marked as a blocker nor is there a patch. > Also, another way to ge

Re: [ANNOUNCE] Intend to build a 0.20.205.1 candidate next Friday 11 Nov.

2011-11-23 Thread Roman Shaposhnik
On Wed, Nov 23, 2011 at 5:40 PM, Arun C Murthy wrote: > Also, another way to get the RM's attention is to mark the 'Target Version' > along with the patch. Would be happy to do so. Wasn't sure what the proper protocol is. Sorry about that. As for the patch -- I'll add JIRA comments. Thanks, Rom

[jira] [Created] (HADOOP-7858) Drop some info logging to DEBUG level in IPC, metrics, and HTTP

2011-11-23 Thread Todd Lipcon (Created) (JIRA)
Drop some info logging to DEBUG level in IPC, metrics, and HTTP --- Key: HADOOP-7858 URL: https://issues.apache.org/jira/browse/HADOOP-7858 Project: Hadoop Common Issue Type: Improv

[jira] [Created] (HADOOP-7859) TestViewFsHdfs.testgetFileLinkStatus is failing an assert

2011-11-23 Thread Eli Collins (Created) (JIRA)
TestViewFsHdfs.testgetFileLinkStatus is failing an assert - Key: HADOOP-7859 URL: https://issues.apache.org/jira/browse/HADOOP-7859 Project: Hadoop Common Issue Type: Bug Comp

RE: Blocks are getting corrupted under very high load

2011-11-23 Thread Uma Maheswara Rao G
Thanks Todd. Finally we also started suspecting in that angle. Planned to take the file details before reboot and after reboot. With the above analysis i can confirm, whether the same issue or not. One more thing to notice is that the difference between reboot time and last replica finalization