Re: How to contribute to C*?

2013-09-04 Thread cem
Thanks Rob! On Thu, Sep 5, 2013 at 12:17 AM, Robert Coli wrote: > On Wed, Sep 4, 2013 at 2:48 PM, cem wrote: > >> I would prefer to have it on server side since it introduces too much >> complexity on client side and CF overheads. >> >> I would like to know how to contribute to C* code base?

Re: How to contribute to C*?

2013-09-04 Thread Robert Coli
On Wed, Sep 4, 2013 at 2:48 PM, cem wrote: > I would prefer to have it on server side since it introduces too much > complexity on client side and CF overheads. > > I would like to know how to contribute to C* code base? > Am I going to open a ticket and assign to me? > Open a JIRA, attach your

How to contribute to C*?

2013-09-04 Thread cem
Hi All, I have a implementation for range partitioning on the client side. Each partition is a CF. It allows you to create and drop partitions. It is very useful if you have time series or event data that you want to store temporarily. You can use TTL for the same issue but it is not fast enough

Re: moving all data to new cluster ?

2013-09-04 Thread Robert Coli
Oh, I feel compelled to emphasize that you MUST avoid name collision when doing this operation. Be CAREFUL to not overwrite files as a result of name collision. =Rob

Key cache size

2013-09-04 Thread Daning Wang
We noticed that key cache could not be fully populated, we have set the key cache size to 1024M. key_cache_size_in_mb: 1024 But none of nodes showed the cache capacity is 1G, we have recently upgraded to 1.2.5, could be an issue in that version? Token: (invoke with -T/--tokens to see

Re: moving all data to new cluster ?

2013-09-04 Thread Robert Coli
On Wed, Sep 4, 2013 at 1:01 PM, Langston, Jim wrote: > Thanks for the link Rob, but I did try earlier to > copy the SSTables over and then to refresh them, > but this is a brand new cluster and the error I got > back indicated that the keyspace didn't exist, and > then figured I needed to copy ev

Re: moving all data to new cluster ?

2013-09-04 Thread Robert Coli
On Wed, Sep 4, 2013 at 12:38 PM, Langston, Jim wrote: > I have built a new 4 node cluster and would like to move the data > from the current 2 node cluster to the new cluster. What would be > the best way to move the data and utilize it on the new cluster. I > have looked at snapshot and also jus

Re: moving all data to new cluster ?

2013-09-04 Thread Langston, Jim
Thanks for the link Rob, but I did try earlier to copy the SSTables over and then to refresh them, but this is a brand new cluster and the error I got back indicated that the keyspace didn't exist, and then figured I needed to copy everything over in the data directory. Jim From: Robert Coli mai

moving all data to new cluster ?

2013-09-04 Thread Langston, Jim
Hi all, I have built a new 4 node cluster and would like to move the data from the current 2 node cluster to the new cluster. What would be the best way to move the data and utilize it on the new cluster. I have looked at snapshot and also just copying the entire tree from the old cluster to the n

Re: system.peers and decommissioned nodes

2013-09-04 Thread John Sanda
I did not see any errors during decommission. I have gone ahead though and upgraded to 1.2.9. On Wed, Sep 4, 2013 at 1:13 PM, Nate McCall wrote: > Did you get any exceptions on decommission? Does CASSANDRA-5857 sound > related at all? (1.2.4 is a few revs behind now and there have been a few >

Re: Selecting multiple rows with composite partition keys using CQL3

2013-09-04 Thread Laing, Michael
you could try this. -ml -- put this in and run using 'cqlsh -f DROP KEYSPACE carl_test; CREATE KEYSPACE carl_test WITH replication = { 'class': 'SimpleStrategy', 'replication_factor' : 1 }; USE carl_test; CREATE TABLE carl_table ( app text, name text, ts int, data te

How to drop a column

2013-09-04 Thread Alberto Carrascal
What is the alternative to the useful and well-known sentence: ALTER TABLE DROP in new versions of Cassandra? I'm using Cassandra 1.2.8 and cql 3 spec.

Re: Selecting multiple rows with composite partition keys using CQL3

2013-09-04 Thread Carl Lerche
I can't find a way to do this with the current implementation of CQL3. Are there any plans to add an OR feature to CQL3 or some other way to select a batch of disjoint composite keys? On Fri, Aug 30, 2013 at 7:52 PM, Carl Lerche wrote: > Hello, > > I've been trying to figure out how to port my

RE: Newbie: Question on JSON values

2013-09-04 Thread Hartzman, Leslie
Thanks. I'll check that out. Les From: Robert Coli [mailto:rc...@eventbrite.com] Sent: Wednesday, September 04, 2013 10:14 AM To: user@cassandra.apache.org Subject: Re: Newbie: Question on JSON values On Wed, Sep 4, 2013 at 10:12 AM, Hartzman, Leslie mailto:leslie.d.hartz...@medtronic.com>> wro

Newbie: Question on JSON values

2013-09-04 Thread Hartzman, Leslie
Hello, I'm just getting my feet wet with Cassandra and I wanted to know if it is possible to search a JSON value in a column and not just retrieve the whole JSON value? Thanks. Les [CONFIDENTIALITY AND PRIVACY NOTICE] Information transmitted by this email is proprietary to Medtronic and is

Re: system.peers and decommissioned nodes

2013-09-04 Thread Nate McCall
Did you get any exceptions on decommission? Does CASSANDRA-5857 sound related at all? (1.2.4 is a few revs behind now and there have been a few fixes there, so and upgrade might not hurt). On Tue, Aug 27, 2013 at 5:53 PM, John Sanda wrote: > Forgot to mention before, the host_id column is null

Re: Newbie: Question on JSON values

2013-09-04 Thread Robert Coli
On Wed, Sep 4, 2013 at 10:12 AM, Hartzman, Leslie < leslie.d.hartz...@medtronic.com> wrote: > I’m just getting my feet wet with Cassandra and I wanted to know if it > is possible to search a JSON value in a column and not just retrieve the > whole JSON value? > If you indexed it with Datastax Ed

RE: row cache

2013-09-04 Thread S C
Thank you all for your valuable comments and information. -SC > Date: Tue, 3 Sep 2013 12:01:59 -0400 > From: chris.burrou...@gmail.com > To: user@cassandra.apache.org > CC: fsareshw...@quantcast.com > Subject: Re: row cache > > On 09/01/2013 03:06 PM, Faraaz Sareshwala wrote: > > Yes, that is c

Best way to track backups/delays for cross DC replication

2013-09-04 Thread Anand Somani
Hi, Scenario is a cluster spanning across datacenters and we use Local_quorum and want to know when things are not getting replicated across data centers. What is the best way to track/alert on that? I was planning on using the HintedHandOffManager (JMX) => org.apache.cassandra.db:type=HintedHand

Re: Cassandra shuts down; was:Cassandra crashes

2013-09-04 Thread Nate McCall
Ideally, you should get back pressure in the form of dropped messages before you see crashes, but if turning down the heap allocation was the only thing you did, there are other changes required (several mentioned by Romain above are very good places to start). A few other ideas: - did you adjust P

Re: Versioning in cassandra

2013-09-04 Thread dawood abdullah
Thanks for the quick response Michael, looks like I have to go with the solution you have given of maps, as performance is pretty critical for our application and we do not have enough time to test. Appreciate your help. Regards, Dawood On Wed, Sep 4, 2013 at 7:33 PM, Laing, Michael wrote: > Da

Re: Cassandra shuts down; was:Cassandra crashes

2013-09-04 Thread Romain HARDOUIN
Have you tried to tweak settings like memtable_total_space_in_mb and flush_largest_memtables_at? Also, the compaction manager seems to be pretty busy, take a look at in_memory_compaction_limit_in_mb. And with SSD hardware you should modifiy multithreaded_compaction, compaction_throughput_mb_per_

Re: Versioning in cassandra

2013-09-04 Thread Laing, Michael
Dawood, In general that will work. However it does mean that you 1) read the old version 2) update the new version and 3) write the archive version. Step 2 is a problem: what if someone else has updated the old version after step 1? and there are 3 atomic operations required, at least. However,

Custom data type is not work at C* 2.0

2013-09-04 Thread Katsutoshi
Hi. I would like to use custom data type. Although it was work at Cassandra 1.2.9, but it is not work at Cassandra 2.0.0. Did anything change by Cassandra 2.0.0 ? My test procedure is as follows: ### DummyType.class ``` package my.marshal; import java.nio.ByteBuffer; import org.apache.cassand

Re: Versioning in cassandra

2013-09-04 Thread dawood abdullah
Michael, Your approach solves the problem, thanks for the solution. I was thinking of another approach as well where in I would create another column family say file_archive, so whenever an update is made to the File table, I will create a new version in the File and move the old version to the ne

Re: Cassandra shuts down; was:Cassandra crashes

2013-09-04 Thread Jan Algermissen
Romain, On 04.09.2013, at 11:11, Romain HARDOUIN wrote: > Maybe you should include the end of Cassandra logs. There is nothing that seems interesting in cassandra.log. Below you find system.log. > What comes to my mind when I read your first post is OOM killer. > But what you describe late

Re: CqlStorage creates wrong schema for Pig

2013-09-04 Thread Miguel Angel Martin junquera
Oppps, sorry by my oversight I was checking the code and I was surprised it did not work with that pig script ... now , It works fine .. Many thanks,Chad Have a nice day Miguel Angel Martín Junquera Analyst Engineer. miguelangel.mar...@brainsins.com 2013/9/3 Chad Johnston > You're tr

Re: Cassandra shuts down; was:Cassandra crashes

2013-09-04 Thread Romain HARDOUIN
Maybe you should include the end of Cassandra logs. What comes to my mind when I read your first post is OOM killer. But what you describe later is not the case. Just to be sure, have you checked /var/log/messages? Romain De :Jan Algermissen A : user@cassandra.apache.org, Date : 04/

Re: Cassandra shuts down; was:Cassandra crashes

2013-09-04 Thread Jan Algermissen
The subject line isn't appropriate - the servers do not crash but shut down. Since the log messages appear several lines before the end of the log file, I only saw afterwards. Excuse the confusion. Jan On 04.09.2013, at 10:44, Jan Algermissen wrote: > Hi, > > I have set up C* in a very limi

Cassandra crashes

2013-09-04 Thread Jan Algermissen
Hi, I have set up C* in a very limited environment: 3 VMs at digitalocean with 2GB RAM and 40GB SSDs, so my expectations about overall performance are low. Keyspace uses replication level of 2. I am loading 1.5 Mio rows (each 60 columns of a mix of numbers and small texts, 300.000 wide rows ef