RE: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-12-07 Thread Poziombka, Wade L
duh, sorry. That estimate is 2 TB would be 15 nodes rf = 3 From: Poziombka, Wade L [mailto:wade.l.poziom...@intel.com] Sent: Friday, December 07, 2012 7:15 AM To: user@cassandra.apache.org Subject: RE: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction. So if my calculations

RE: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-12-07 Thread Poziombka, Wade L
2 at 9:53 AM, Poziombka, Wade L mailto:wade.l.poziom...@intel.com>> wrote: "Having so much data on each node is a potential bad day." Is this discussed somewhere on the Cassandra documentation (limits, practices etc)? We are also trying to load up quite a lot of data and have hit

RE: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-12-06 Thread Poziombka, Wade L
"Having so much data on each node is a potential bad day." Is this discussed somewhere on the Cassandra documentation (limits, practices etc)? We are also trying to load up quite a lot of data and have hit memory issues (bloom filter etc.) in 1.0.10. I would like to read up on big data usage

RE: which high level Java client

2012-06-28 Thread Poziombka, Wade L
I use Pelops and have been very happy. In my opinion the interface is cleaner than that with Hector. I personally do like the serializer business. -Original Message- From: Radim Kolar [mailto:h...@filez.com] Sent: Thursday, June 28, 2012 5:06 AM To: user@cassandra.apache.org Subject: R

RE: Much more native memory used by Cassandra then the configured JVM heap size

2012-06-21 Thread Poziombka, Wade L
different jsvc process altogether. I wanted to make sure I set the record straight and not leave the idea out there that Cassandra may have a memory problem. Wade Poziombka Intel Americas, Inc. From: Poziombka, Wade L [mailto:wade.l.poziom...@intel.com] Sent: Wednesday, June 13, 2012 10:53

is this something to be concerned about - MUTATION message dropped

2012-06-14 Thread Poziombka, Wade L
INFO [ScheduledTasks:1] 2012-06-14 07:49:54,355 MessagingService.java (line 615) 15 MUTATION message dropped in last 5000ms It is at INFO level so I'm inclined to think not but is seems like whenever messages are dropped there may be some issue?

RE: Much more native memory used by Cassandra then the configured JVM heap size

2012-06-13 Thread Poziombka, Wade L
actually, this is without jna.jar. I will add and see if still have same issue From: Poziombka, Wade L Sent: Wednesday, June 13, 2012 10:53 AM To: user@cassandra.apache.org Subject: RE: Much more native memory used by Cassandra then the configured JVM heap size Seems like my only recourse is

RE: Much more native memory used by Cassandra then the configured JVM heap size

2012-06-13 Thread Poziombka, Wade L
Seems like my only recourse is to remove jna.jar and just take the performance/swapping pain? Obviously can't have the entire box lock up. I can provide a pmap etc. if needed. From: Poziombka, Wade L [mailto:wade.l.poziom...@intel.com] Sent: Wednesday, June 13, 2012 10:28 AM To:

RE: Much more native memory used by Cassandra then the configured JVM heap size

2012-06-13 Thread Poziombka, Wade L
I have experienced the same issue. The Java heap seems fine but eventually the OS runs out of heap. In my case it renders the entire box unusable without a hard reboot. Console shows: is there a way to limit the native heap usage? xfs invoked oom-killer: gfp_mask=0x201d2, order=0, oomkillad

RE: how to compact an index CF?

2012-06-08 Thread Poziombka, Wade L
er much looking I cannot see a way to actually do this? Is it automatic? From: Poziombka, Wade L Sent: Friday, June 08, 2012 2:22 PM To: 'user@cassandra.apache.org' Subject: how to compact an index CF? I have an index to a column IX in column family A. How would I go about compa

how to compact an index CF?

2012-06-08 Thread Poziombka, Wade L
I have an index to a column IX in column family A. How would I go about compacting that? I have tried nodetool compact keyspace A.IX But that complains "Unknown table/cf pair" I'm sure there must be some simple magic to make this happen. I just cannot tell what it is.

RE: memory issue on 1.1.0

2012-06-06 Thread Poziombka, Wade L
JNA setup correctly? (You should see a couple of log messages about it shortly after startup.) Truncate also performs a snapshot by default. On Wed, Jun 6, 2012 at 12:38 PM, Poziombka, Wade L mailto:wade.l.poziom...@intel.com>> wrote: However, after all the work I issued a truncate on t

RE: Cassandra not retrieving the complete data on 2 nodes

2012-06-06 Thread Poziombka, Wade L
what is your consistency level? From: Prakrati Agrawal [mailto:prakrati.agra...@mu-sigma.com] Sent: Wednesday, June 06, 2012 4:58 AM To: user@cassandra.apache.org Subject: RE: Cassandra not retrieving the complete data on 2 nodes Please anyone reply to my query Prakrati Agrawal | Developer - Big

my devious QA - how to recover with power lost situation

2012-06-05 Thread Poziombka, Wade L
They 1) setup a two node cluster and loaded 500K rows or something 2) add a third node, run nodetool move 3) while moving they pull the plug on the node Cassandra won't start with the exception below. Now, this is obviously a very exceptional situation but the question is posed

RE: memory issue on 1.1.0

2012-06-05 Thread Poziombka, Wade L
ndard, comparator_type:BytesType, column_metadata:[ColumnDef(name:75 73 65 43 6F 75 6E 74, validation_class:CounterColumnType)], default_validation_class:CounterColumnType, caching:keys_only) ]) -Original Message- From: Poziombka, Wade L [mailto:wade.l.poziom...@intel.com] Sent: Tuesday, Ju

RE: memory issue on 1.1.0

2012-06-05 Thread Poziombka, Wade L
nodes enter a nasty spiral of constant flushing, constant compactions, high heap usage, instability and high latency. On 2012-06-05, at 2:56 PM, Poziombka, Wade L wrote: > Alas, upgrading to 1.1.1 did not solve my issue. > > -Original Message- > From: Brandon Wi

RE: memory issue on 1.1.0

2012-06-05 Thread Poziombka, Wade L
-3741 -Brandon On Sun, Jun 3, 2012 at 6:12 PM, Poziombka, Wade L wrote: > Running a very write intensive (new column, delete old column etc.) process > and failing on memory.  Log file attached. > > Curiously when I add new data I have never seen this have in past sent > hundr

RE: memory issue on 1.1.0

2012-06-04 Thread Poziombka, Wade L
://issues.apache.org/jira/browse/CASSANDRA-3741 -Brandon On Sun, Jun 3, 2012 at 6:12 PM, Poziombka, Wade L wrote: > Running a very write intensive (new column, delete old column etc.) process > and failing on memory.  Log file attached. > > Curiously when I add new data I have nev

RE: memory issue on 1.1.0

2012-06-04 Thread Poziombka, Wade L
I have repeated the test on two quite large machines 12 core, 64 GB as5 boxes and still observed the problem. Interestingly about at the same point. Anything I can monitor... perhaps I'll hook the Yourkit profiler up to it to see if there is some kind of leak? Wade From: Poziombka, W

RE: memory issue on 1.1.0

2012-06-04 Thread Poziombka, Wade L
orton Freelance Developer @aaronmorton http://www.thelastpickle.com On 4/06/2012, at 11:12 AM, Poziombka, Wade L wrote: Running a very write intensive (new column, delete old column etc.) process and failing on memory. Log file attached. Curiously when I add new data I have never seen this have

RE: nodetool move 0 gets stuck in "moving" state forever

2012-05-31 Thread Poziombka, Wade L
Let me elaborate a bit. two node cluster node1 has token 0 node2 has token 85070591730234615865843651857942052864 node1 goes down perminently. do a nodetool move 0 on node2. monitor with ring... is in Moving state forever it seems. From: Poziombka, Wade L Sent: Tuesday, May 29, 2012 4:29

nodetool move 0 gets stuck in "moving" state forever

2012-05-29 Thread Poziombka, Wade L
If the node with token 0 dies and we just want it gone from the cluster we would do a nodetool move 0. Then we monitor using nodetool ring it seems to be stuck on Moving forever. Any ideas?

Re: Migrating a column family from one cluster to another

2012-05-18 Thread Poziombka, Wade L
How does counters affect this? Why would be different? Sent from my iPhone On May 18, 2012, at 15:40, "Rob Coli" wrote: > On Thu, May 17, 2012 at 9:37 AM, Bryan Fernandez > wrote: >> What would be the recommended >> approach to migrating a few column families from a six node cluster to a >