Re: Nodes Timing Out

2010-03-28 Thread James Golick
Oops, I was doing ulimit. ulimit -n returns 1024. On Sun, Mar 28, 2010 at 3:25 AM, Benoit Perroud wrote: > ulimit -n returns you unlimited ? > > > 2010/3/28 James Golick : > > unlimited > > > > On Sat, Mar 27, 2010 at 12:09 PM, Chris Goffinet > wrote: > >> > >> what's the ulimit set to? > >> -C

Re: Nodes Timing Out

2010-03-28 Thread Benoit Perroud
ulimit -n returns you unlimited ? 2010/3/28 James Golick : > unlimited > > On Sat, Mar 27, 2010 at 12:09 PM, Chris Goffinet wrote: >> >> what's the ulimit set to? >> -Chris >> On Mar 27, 2010, at 10:29 AM, James Golick wrote: >> >> Hey, >> I put our first cluster in to production (writing but no

Re: Nodes Timing Out

2010-03-28 Thread James Golick
unlimited On Sat, Mar 27, 2010 at 12:09 PM, Chris Goffinet wrote: > what's the ulimit set to? > > -Chris > > On Mar 27, 2010, at 10:29 AM, James Golick wrote: > > Hey, > > I put our first cluster in to production (writing but not reading) a couple > of days ago. Right now, it's got two pretty si

Re: Nodes Timing Out

2010-03-27 Thread Chris Goffinet
what's the ulimit set to? -Chris On Mar 27, 2010, at 10:29 AM, James Golick wrote: > Hey, > > I put our first cluster in to production (writing but not reading) a couple > of days ago. Right now, it's got two pretty sizeable nodes taking about 200 > writes per second each and virtually no rea

Re: Nodes Timing Out

2010-03-27 Thread James Golick
Nothing in the log. No CPU activity. I'll try to strace it and connect with jconsole next time it happens. On Sat, Mar 27, 2010 at 11:09 AM, Jonathan Ellis wrote: > anything interesting in the log? > > is there cpu activity? > > can you connect w/ jconsole? > > On Sat, Mar 27, 2010 at 12:29 PM,

Re: Nodes Timing Out

2010-03-27 Thread Jonathan Ellis
anything interesting in the log? is there cpu activity? can you connect w/ jconsole? On Sat, Mar 27, 2010 at 12:29 PM, James Golick wrote: > Hey, > I put our first cluster in to production (writing but not reading) a couple > of days ago. Right now, it's got two pretty sizeable nodes taking abo

Nodes Timing Out

2010-03-27 Thread James Golick
Hey, I put our first cluster in to production (writing but not reading) a couple of days ago. Right now, it's got two pretty sizeable nodes taking about 200 writes per second each and virtually no reads. Eventually, though, (and this has happened twice), both nodes seem to start timing out. If I