need help with choosing correct tokens for ByteOrderedPartitioner

2011-11-24 Thread Piavlo
Hi, We need help with choosing correct tokens for ByteOrderedPartitioner Originally the key where supposed to be member_id-mmdd but since we need to male rage scans on same member_id and varying date ranges mmdd we decided to use ByteOrderedPartitioner, so we need that same member wil

Re: need help with choosing correct tokens for ByteOrderedPartitioner

2011-11-28 Thread Piavlo
Anyone can help with this? Thanks On 11/24/2011 11:55 AM, Piavlo wrote: Hi, We need help with choosing correct tokens for ByteOrderedPartitioner Originally the key where supposed to be member_id-mmdd but since we need to male rage scans on same member_id and varying date ranges

Re: need help with choosing correct tokens for ByteOrderedPartitioner

2011-11-28 Thread Piavlo
ranges - then two md5(member_id1) & md5(member_id2) end up very close so using md5(member_id1)+mmdd & md5(member_id2)+mmdd will cause range overlaps with ByteOrderedPartitioner. Thanks Alex Le lundi 28 novembre 2011, Piavlo <mailto:lolitus...@gmail.com>> a écrit :

smart client proxy for cassandra

2012-03-25 Thread Piavlo
Hi, Is there any smart client proxy implementation for cassandra? I'd like to proxy short lived phpcassa connections through a smart proxy that will manage a pool of connections and be aware of current cluster state, bad/slow nodes etc... The java php libraries https://github.com/s7/scale7-pel

strange gossip messages after node reboot with different ip

2012-04-30 Thread Piavlo
Hi, We have a cassandra cluster in ec2. If i stop a node and start it - as a result the node ip changes. The node is recognised as NEW node and is declared as replacing the previous node with same token.(But this is the same node of course) In this specific case the node ip before stop/star

Re: strange gossip messages after node reboot with different ip

2012-04-30 Thread Piavlo
ttp://www.thelastpickle.com On 1/05/2012, at 3:09 AM, Piavlo wrote: Hi, We have a cassandra cluster in ec2. If i stop a node and start it - as a result the node ip changes. The node is recognised as NEW node and is declared as replacing the previous node with same token.(But this is the same n

Re: strange gossip messages after node reboot with different ip

2012-05-08 Thread Piavlo
- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 1/05/2012, at 3:09 AM, Piavlo wrote: Hi, We have a cassandra cluster in ec2. If i stop a node and start it - as a result the node ip changes. The node is recognised as NEW node and is declared as replacing the

is it possible to run cassandra process in client mode as smart proxy

2012-05-16 Thread Piavlo
Hi, I'm interested in using some smart proxy cassandra process that could act as coordinator node and be aware of cluster state. And run this smart proxy cassandra process on each client side host where the application(php) with short lived cassandra connections runs. Besides being aware of

Re: is it possible to run cassandra process in client mode as smart proxy

2012-05-16 Thread Piavlo
re of the ring state and the protocol and if smaprt proxy was the cassandra itself then it would have all the needed features tested and reliable at no effort. Thanks Alex Good luck! 2012/5/16 Piavlo mailto:lolitus...@gmail.com>> Hi, I'm interested in using some smart

Re: cassandra read latency help

2012-05-17 Thread Piavlo
On 05/18/2012 08:49 AM, Viktor Jevdokimov wrote: Row cache is ok until keys are not heavily updated, otherwise it frequently invalidates and pressures GC. According to http://www.datastax.com/docs/1.0/operat

Couldn't detect any schema definitions in local storage - after handling schema disagreement according to FAQ

2012-05-18 Thread Piavlo
Hi, I had a schema disagreement problem in cassandra 1.0.9 cluster, where one node had different schema version. So I followed the faq at http://wiki.apache.org/cassandra/FAQ#schema_disagreement disabled gossip, disabled thrift, drained and finally stopped the cassandra process, on startup

Urgent - IllegalArgumentException during compaction and memtable flush

2012-06-13 Thread Piavlo
Hi, I have a pretty urgent issue with 1.0.9 cluster in opscenter i saw a compation that had a progress of 0% for a long time, looking at the cassandra log on the relevant node I see REPEATED messages of IllegalArgumentException in CompactionExecutor INFO [CompactionExecutor:3335] 2012-06-

Re: Urgent - IllegalArgumentException during compaction and memtable flush

2012-06-14 Thread Piavlo
fer.java:249) ... - Thanks for your help. On 06/14/2012 11:09 AM, Sylvain Lebresne wrote: On Thu, Jun 14, 2012 at 8:26 AM, Piavlo wrote: I started looking for similar messages on other nodes saw a SINGLE IllegalArgumentException on ValidationExecutor on the same node and

Re: Urgent - IllegalArgumentException during compaction and memtable flush

2012-06-14 Thread Piavlo
ing column? can I find which column is problematic? maybe sstable2json can somehow help? Thanks Alex On 06/14/2012 04:04 PM, Sylvain Lebresne wrote: On Thu, Jun 14, 2012 at 12:00 PM, Piavlo wrote: What's the procedure to check if the compressed sstable is corrupted or not? Since you

Re: Urgent - IllegalArgumentException during compaction and memtable flush

2012-06-14 Thread Piavlo
Ok i've run scrub on the 3 nodes and the problematic row Error validating row DecoratedKey(92668395684826132216160944211592988451, 353339332d3134363533393931) The full message is WARN [CompactionExecutor:2700] 2012-06-14 14:26:42,041 CompactionManager.java (line 582) Non-fatal error reading

Re: Urgent - IllegalArgumentException during compaction and memtable flush

2012-06-14 Thread Piavlo
? thanks On 06/14/2012 06:17 PM, Piavlo wrote: Ok i've run scrub on the 3 nodes and the problematic row Error validating row DecoratedKey(92668395684826132216160944211592988451, 353339332d3134363533393931) The full message is WARN [CompactionExecutor:2700] 2012-06-14 14:26:4

not even number of keys per CFs in fully balanced cluster with random partitioner

2013-10-29 Thread Piavlo
Hi, There is a 12 node cluster , still stuck on 1.0.8. All nodes in the cluster ring are balanced. Using random partitioner. All CFs use compression. Data size on nodes varies from 40G to 75G. This variance is not due to the bigger nodes having more uncompacted sstables than others. Most bigges

heap issues - looking for advices on gc tuning

2013-10-29 Thread Piavlo
Hi, Below I try to give a full picture to the problem I'm facing. This is a 12 node cluster, running on ec2 with m2.xlarge instances (17G ram , 2 cpus). Cassandra version is 1.0.8 Cluster normally having between 3000 - 1500 reads per second (depends on time of the day) and 1700 - 800 writes p

Re: heap issues - looking for advices on gc tuning

2013-10-30 Thread Piavlo
ng up with the pace. tnx 2013/10/30 Piavlo mailto:lolitus...@gmail.com>> Hi, Below I try to give a full picture to the problem I'm facing. This is a 12 node cluster, running on ec2 with m2.xlarge instances (17G ram , 2 cpus). Cassandra version is 1.0.8

Re: heap issues - looking for advices on gc tuning

2013-10-30 Thread Piavlo
ollowing parameters memtable_flush_queue_size: concurrent_compactors: 2013/10/30 Piavlo mailto:lolitus...@gmail.com>> Hi, Below I try to give a full picture to the problem I'm facing. This is a 12 node cluster, running on ec2 with m2.xlarge

Re: ReadCount change rate is different across nodes

2013-10-30 Thread Piavlo
On 10/30/2013 02:06 AM, Daning Wang wrote: We are running 1.2.5 on 8 nodes(256 tokens). all the nodes are running on same type of machine. and db size is about same. but recently we checked ReadCount stats through jmx, and found that some nodes got 3 times change rate(we have calculated the ch