is it possible to disable compaction per CF ?

2012-07-26 Thread Илья Шипицин
Hello! if we are dealing with append-only data model, so what if I disable compaction on certain CF ? any side effect ? can I do it with "update column family with compaction_strategy = null " ? Cheers, Ilya Shipitsin

Re: Schema question : Query to support "Find which all of these 500 email ids have been registered"

2012-07-26 Thread Aklin_81
Sorry for the confusion created. I need to store emails registered just for a single application. So although my data model would fit into just a single row. But is storing a hundred million columns(col name size= 8 byte; col value size=4 byte ) in a single row a good idea ? I am very much tempted

Re: increased RF and repair, not working?

2012-07-26 Thread Dave Brosius
Quorum is defined as (replication_factor / 2) + 1 therefore quorum when rf = 2 is 2! so in your case, both nodes must be up. Really, using Quorum only starts making sense as a 'quorum' when RF=3 On 07/26/2012 10:38 PM, Yan Chunlu wrote: I am using Cassandra 1.0.2, have a 3 nodes clust

Re: Schema question : Query to support "Find which all of these 500 email ids have been registered"

2012-07-26 Thread Roshni Rajagopal
In general I believe wide rows (many cols ) are preferable to skinny rows (many rows) so that you can get all the information in 1 go, One can store 2 billion cols in a row. However, on what basis would you store the 500 email ids in 1 row? What can be the row key? For e.g. If the query you want t

Re: Connection issue in Cassandra

2012-07-26 Thread Adeel Akbar
I used Cassandra 0.8.1 and pycasa 0.2. If I upgrade pycasa, then it have compatibility issue. please suggest Thanks & Regards *Adeel**Akbar* On 7/25/2012 10:13 PM, Tyler Hobbs wrote: That's a pretty old version of pycassa; it was release before 0.7.0 came out. I suggest upgrading. It's po

increased RF and repair, not working?

2012-07-26 Thread Yan Chunlu
I am using Cassandra 1.0.2, have a 3 nodes cluster. the consistency level of read & write are both QUORUM. At first the RF=1, and I figured that one node down will cause the cluster unusable. so I changed RF to 2, and run nodetool repair on every node(actually I did it twice). After the operatio

Re: Counters values are less than expected [1.0.6 - Java/Pelops]

2012-07-26 Thread Radim Kolar
Dne 19.7.2012 15:07, cbert...@libero.it napsal(a): Hi all, I have a problem with counters I'd like to solve before going in production. I have also similar problem with counters, but i do no think that something can be done with it. Developers are not interested in discovering what is wrong and

Re: Bringing a dead node back up after fixing hardware issues

2012-07-26 Thread Brandon Williams
On Wed, Jul 25, 2012 at 6:16 PM, Eran Chinthaka Withana wrote: > Alright, lets assume I want to go on this route. I have RF=2 in the data > center and I believe I need at least RF=3 to set the replication to > LOCAL_QUORUM and hide the node failures. But if I increase the RF to 3 now > then won't

Re: Questions regarding DataStax AMI

2012-07-26 Thread Tamar Fraenkel
What should be the value to create it with Cassandra 1.0.8 Tamar Sent from my iPod On Jul 26, 2012, at 7:06 PM, Joaquin Casares wrote: > Yes, you can easily do this by using the --release switch as found > here: > http://www.datastax.com/docs/1.0/install/install_ami > > Thanks, > > Joaquin

Re: How to manually build and maintain secondary indexes

2012-07-26 Thread Rajat Mathur
http://www.anuff.com/2011/02/indexing-in-cassandra.html On Thu, Jul 26, 2012 at 11:43 PM, Brian O'Neill wrote: > Alon, > > We came to the same conclusion regarding secondary indexes, and instead of > using them we implemented our own wide-row indexing capability and > open-sourced it. > > Its av

Re: How to manually build and maintain secondary indexes

2012-07-26 Thread Brian O'Neill
Alon, We came to the same conclusion regarding secondary indexes, and instead of using them we implemented our own wide-row indexing capability and open-sourced it. Its available here: https://github.com/hmsonline/cassandra-indexing We still have challenges rebuilding indexes, etc. It doesn't

How to manually build and maintain secondary indexes

2012-07-26 Thread Alon Pilberg
Hello, My company is working on transition of our relational data model to Cassandra. Naturally, one of the basic demands is to have secondary indexes to answer queries quickly according to the application's needs. After looking at Cassandra's native support for secondary indexes, we decided not to

Re: restoring a counter

2012-07-26 Thread Pierre-Yves Ritschard
writes: >> restoring a counter column family. I have two questions related to >> this: >> >> a) how does that setting affect C* in a non-restoring start? renew_counter_id regenerates a new "NodeId" for the cassandra VM which is used to keep track of the counter shards the node holds. If you

Re: How schema disagreement can be fixed faster on 1.0.10 cluster ?

2012-07-26 Thread Tyler Hobbs
I know you specified 1.0.10, but C* 1.1 solves this problem: http://www.datastax.com/dev/blog/the-schema-management-renaissance On Thu, Jul 26, 2012 at 7:29 AM, Mateusz Korniak < mateusz-li...@ant.gliwice.pl> wrote: > Hi ! > We got into schema disagreement situation on 1.0.10 having 250GB of > co

Re: Cassandra 1.0 hangs during GC

2012-07-26 Thread Tyler Hobbs
On Thu, Jul 26, 2012 at 1:25 AM, Nikolay Kоvshov wrote: > > And I have remembered that I do a lot of get_range_slices requests, each > time on a range of 100, if this could be important. If you have large rows, try lowering the number of rows you fetch at once from 100 to 25. Pulling in a larg

Re: Adding new node to clusters with PropertyFileSnitch

2012-07-26 Thread Tyler Hobbs
On Thu, Jul 26, 2012 at 7:35 AM, Michael Cherkasov < michael.cherka...@gmail.com> wrote: > Hi all, if my clusters have PropertyFileSnitch and I'm going to add nee > node, does that mean that new node must be added to ALL > cassandra-topology.properties files > Yes, unless that node's dc and rack

Re: Questions regarding DataStax AMI

2012-07-26 Thread Joaquin Casares
Yes, you can easily do this by using the --release switch as found here: http://www.datastax.com/docs/1.0/install/install_ami Thanks, Joaquin Casares DataStax Software Engineer/Support On Thu, Jul 26, 2012 at 12:44 AM, Tamar Fraenkel wrote: > Hi! > Is there a way to launch EC2 cluster from D

is "upgradesstables" required (or recommended) upon "update column family" ?

2012-07-26 Thread Илья Шипицин
Hello! is "upgradesstables" required upon "update column family with compression_options" (or "compaction_strategy") ? Cheers, Ilya Shipitsin

RE: restoring a counter

2012-07-26 Thread mdione.ext
De : mdione@orange.com [mailto:mdione@orange.com] > restoring a counter column family. I have two questions related to > this: > > a) how does that setting affect C* in a non-restoring start? > > b) if it's < bad > (for some value of that), should I stop C*+remove > the setting+start

restoring a counter

2012-07-26 Thread mdione.ext
According to this post[1], one's supposed to start C* with -Dcassandra.renew_counter_id=true as one of the steps of restoring a counter column family. I have two questions related to this: a) how does that setting affect C* in a non-restoring start? b) if it's < bad > (for some value of th

Re: virtual memory of all cassandra-nodes is growing extremly since Cassandra 1.1.0

2012-07-26 Thread Mina Naguib
Hi Thomas On a modern 64bit server, I recommend you pay little attention to the virtual size. It's made up of almost everything within the process's address space, including on-disk files mmap()ed in for zero-copy access. It's not unreasonable for a machine with N amount RAM to have a proces

Re: Creating counter columns in cassandra

2012-07-26 Thread Vivek Mishra
Check out Kundera for Counter column support. Here is the link for Counter column tests: https://github.com/impetus-opensource/Kundera/tree/kundera-2.0.7/kundera-cassandra/src/test/java/com/impetus/client/crud/countercolumns -Vivek On Thu, Jul 26, 2012 at 12:27 PM, Abhijit Chanda wrote: > You

Re: virtual memory of all cassandra-nodes is growing extremly since Cassandra 1.1.0

2012-07-26 Thread Thomas Spengler
I saw this. All works fine upto version 1.1.0 the 0.8.x takes 5GB of memory of an 8GB machine the 1.0.x takes between 6 and 7 GB on a 8GB machine and the 1.1.0 takes all and it is a problem for me it is no solution to wait of the OOM-Killer from the linux kernel and restart the cassandraprocess

Questions regarding DataStax AMI

2012-07-26 Thread Tamar Fraenkel
Hi! Is there a way to launch EC2 cluster from DataStax latest community AMI that will run Cassandra 1.0.8 and not 1.1.2? Thanks *Tamar Fraenkel * Senior Software Engineer, TOK Media [image: Inline image 1] ta...@tok-media.com Tel: +972 2 6409736 Mob: +972 54 8356490 Fax: +972 2 5612956 <>

How schema disagreement can be fixed faster on 1.0.10 cluster ?

2012-07-26 Thread Mateusz Korniak
Hi ! We got into schema disagreement situation on 1.0.10 having 250GB of compressed data per node. Following http://wiki.apache.org/cassandra/FAQ#schema_disagreement after node restart looks like it is replaying all schema changes one be one , right ? As we did a lot of them during cluster life

Re: Creating counter columns in cassandra

2012-07-26 Thread Abhijit Chanda
You can check Astyanax API https://github.com/Netflix/astyanax/blob/5c05d118e22eef541a7a201adf7c1c610da13f5b/src/test/java/com/netflix/astyanax/thrift/ThrifeKeyspaceImplTest.java There are some counter column example which will surely help you.

Re: Creating counter columns in cassandra

2012-07-26 Thread Tamar Fraenkel
Hi To create: ColumnFamilyDefinition counters = createBasicCfDef( KEYSPACE, Consts.COUNTERS, ComparatorType.UTF8TYPE, null, "CounterColumnType", "CompositeType(UTF8Type,UUIDType)"); counters.setReplicateOnWrite(true); cluster.addColumnFamily(counters, true); to inc

Re: Cassandra 1.0 hangs during GC

2012-07-26 Thread Nikolay Kоvshov
Sun Java 6 didn't help it at all Sar shows no special activity on the long GC times And I have remembered that I do a lot of get_range_slices requests, each time on a range of 100, if this could be important. Still my GC times are growing incredible INFO [ScheduledTasks:1] 2012-07-25 12:17:04

Fwd: Cassandra 1.0 hangs during GC

2012-07-26 Thread Nikolay Kоvshov
Sun Java 6 didn't help it at all Sar shows no special activity on the long GC times And I have remembered that I do a lot of get_range_slices requests, each time on a range of 100, if this could be important. Still my GC times are growing incredible  INFO [ScheduledTasks:1] 2012-07-25 12:17:04