On Thu, Jun 20, 2013 at 7:27 PM, aaron morton <aa...@thelastpickle.com>wrote:
> nodetool compactionstats, gives > > pending tasks: 13120 > > If there are no errors in the log, I would say this is a bug. > This happened after the node ran out of file descriptors, so an edge case wouldn't surprise me. I've rebuilt the node (blown the data way and am running a nodetool rebuild). Do you think it's worth posting an issue, or not enough traceable evidence ? cheers > > Cheers > > ----------------- > Aaron Morton > Freelance Cassandra Consultant > New Zealand > > @aaronmorton > http://www.thelastpickle.com > > On 19/06/2013, at 11:41 AM, Franc Carter <franc.car...@sirca.org.au> > wrote: > > On Wed, Jun 19, 2013 at 9:34 AM, Bryan Talbot <btal...@aeriagames.com>wrote: > >> Manual compaction for LCS doesn't really do much. It certainly doesn't >> compact all those little files into bigger files. What makes you think >> that compactions are not occurring? >> > > Yeah, that's what I thought, however:- > > nodetool compactionstats, gives > > pending tasks: 13120 > Active compaction remaining time : n/a > > when I run nodetool compact in a loop the pending tasks goes down > gradually. > > This node also has vastly higher latencies (x10) than the other nodes. I > saw this with a previous CF than I 'manually compacted', and when the > pending tasks reached low numbers (stuck on 9) then latencies were back to > low milliseconds > > cheers > > >> -Bryan >> >> >> >> On Tue, Jun 18, 2013 at 3:59 PM, Franc Carter >> <franc.car...@sirca.org.au>wrote: >> >>> On Sat, Jun 15, 2013 at 11:49 AM, Franc Carter < >>> franc.car...@sirca.org.au> wrote: >>> >>>> On Sat, Jun 15, 2013 at 8:48 AM, Robert Coli <rc...@eventbrite.com>wrote: >>>> >>>>> On Wed, Jun 12, 2013 at 3:26 PM, Franc Carter < >>>>> franc.car...@sirca.org.au> wrote: >>>>> > We are running a test system with Leveled compaction on >>>>> Cassandra-1.2.4. >>>>> > While doing an initial load of the data one of the nodes ran out of >>>>> file >>>>> > descriptors and since then it hasn't been automatically compacting. >>>>> >>>>> You have (at least) two options : >>>>> >>>>> 1) increase file descriptors available to Cassandra with ulimit, if >>>>> possible >>>>> 2) increase the size of your sstables with levelled compaction, such >>>>> that you have fewer of them >>>>> >>>> >>>> Oops, I wasn't clear enough. >>>> >>>> I have increased the number of file descriptors and no longer have a >>>> file descriptor issue. However the node still doesn't compact >>>> automatically. If I run a 'nodetool compact' it will do a small amount of >>>> compaction and then stop. The Column Family is using LCS >>>> >>> >>> Any ideas on this - compaction is still not automatically running for >>> one of my nodes >>> >>> thanks >>> >>> >>>> >>>> cheers >>>> >>>> >>>>> >>>>> =Rob >>>>> >>>> >>>> >>>> >>>> -- >>>> *Franc Carter* | Systems architect | Sirca Ltd >>>> <marc.zianideferra...@sirca.org.au> >>>> franc.car...@sirca.org.au | www.sirca.org.au >>>> Tel: +61 2 8355 2514 >>>> Level 4, 55 Harrington St, The Rocks NSW 2000 >>>> PO Box H58, Australia Square, Sydney NSW 1215 >>>> >>>> >>> >>> >>> -- >>> *Franc Carter* | Systems architect | Sirca Ltd >>> <marc.zianideferra...@sirca.org.au> >>> franc.car...@sirca.org.au | www.sirca.org.au >>> Tel: +61 2 8355 2514 >>> Level 4, 55 Harrington St, The Rocks NSW 2000 >>> PO Box H58, Australia Square, Sydney NSW 1215 >>> >>> >> > > > -- > *Franc Carter* | Systems architect | Sirca Ltd > <marc.zianideferra...@sirca.org.au> > franc.car...@sirca.org.au | www.sirca.org.au > Tel: +61 2 8355 2514 > Level 4, 55 Harrington St, The Rocks NSW 2000 > PO Box H58, Australia Square, Sydney NSW 1215 > > > -- *Franc Carter* | Systems architect | Sirca Ltd <marc.zianideferra...@sirca.org.au> franc.car...@sirca.org.au | www.sirca.org.au Tel: +61 2 8355 2514 Level 4, 55 Harrington St, The Rocks NSW 2000 PO Box H58, Australia Square, Sydney NSW 1215
