Re: Rolling a Hadoop 0.20.2

2010-01-28 Thread Cosmin Lehene
HDFS-909 left us with a corrupted HDFS Cosmin On 1/28/10 4:14 AM, "Andrew Purtell" wrote: > So the list of HDFS issues for next 0.20.x or 0.21 most relevant to HBase > stability I have is: > >127 >200 (well, hflush) >630 >793 > > > Sound about right? Anything important I'm m

Re: [VOTE -- Round 2] Commit hdfs-630 to 0.21?

2010-01-22 Thread Cosmin Lehene
Steve, A DoS could not be done using excludedNodes. The blacklisting takes place only at DFSClientLevel. The NN will return a list of block locations that excludes the nodes the client decided. This list isn't persisted anywhere on the server. So if a client excludes the entire set of DNs other

Re: [VOTE -- Round 2] Commit hdfs-630 to 0.21?

2010-01-22 Thread Cosmin Lehene
+1 On 1/22/10 3:24 AM, "Andrew Purtell" wrote: > +1 > > This makes an observed big difference for stability of small/test clusters. > > I second Ryan's specific point about stability of small clusters being > important. > > - Andy > > > On Thu Jan 21st, 2010 2:46 PM PST Ryan Rawson wro

[jira] Created: (HDFS-909) Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log

2010-01-20 Thread Cosmin Lehene (JIRA)
/HDFS-909 Project: Hadoop HDFS Issue Type: Bug Components: name-node Affects Versions: 0.21.0, 0.22.0 Environment: CentOS Reporter: Cosmin Lehene Priority: Blocker Fix For: 0.21.0, 0.22.0 closing the edits log file

Hudson builds fail erratically

2010-01-18 Thread Cosmin Lehene
Hi, I keep getting different tests failing with each run on http://hudson.zones.apache.org/hudson/view/Hdfs/job/Hdfs-Patch-h5.grid.sp2.y ahoo.net/ For example builds 192 and 193 are applying the same patch however each fails differently: 192: org.apache.hadoop.fs.loadGenerator.TestLoadGenerator.

Re: Commit hdfs-630 to 0.21?

2009-12-15 Thread Cosmin Lehene
+1 Cosmin On 12/15/09 10:44 AM, "Lars George" wrote: > +1 > > Lars > > On Tue, Dec 15, 2009 at 8:53 AM, Jean-Daniel Cryans > wrote: > >> +1 for 0.21.0 >> >> J-D >> >> On Mon, Dec 14, 2009 at 11:30 PM, Andrew Purtell >> wrote: >>> +1 >>> >>> >>> On Sat, Dec 12, 2009 at 3:54 PM, stack

Hadoop coding style guideline

2009-11-20 Thread Cosmin Lehene
Hi, I was trying to make a patch and looking over the Hadoop guidelines for code at http://wiki.apache.org/hadoop/CodeReviewChecklist, trying to follow the conventions. Looking through code I found a few "patterns", however, these differ even in the same class sometimes. Here's a collection of