Fw: How to log the details of the updated data locally

2013-10-01 Thread sathiya prabhu
Hi all, In cassandra cluster, once a write/update is successful to the particular instance locally, i want to log the data that is updated and its timestamps separately in a file.. In which class it will be more appropriate to do this..  To the extent i explored the codebase, it's possible

default_time_to_live

2013-10-01 Thread Pieter Callewaert
Hi, We are starting up a new cluster with Cassandra 2.0.0 and one of the features we were interested in was Per-CF TTL (https://issues.apache.org/jira/browse/CASSANDRA-3974) I didn't find any commands in CQL to set this value, so I've used the following: UPDATE system.schema_colu

Re: Segmentation fault when trying to store into cassandra...

2013-10-01 Thread Krishna Chaitanya
openjdk was the problem. I updated to the latest sun jdk and the issue was fixed!!! Thanks... On Mon, Sep 30, 2013 at 7:30 PM, Vivek Mishra wrote: > Java version issue? > Using sun jdk or open jdk? > > -Vivek > > > On Tue, Oct 1, 2013 at 6:16 AM, Krishna Chaitanya > wrote: > >> Hello, >>

paging through a table with timeuuid primary key

2013-10-01 Thread Jimmy Lin
i have a table like the following: CREATE TABLE log ( mykey timeuuid, type text, msg text, primary key(mykey, type) ); I want to page through all the results from the table using select * from log where token(mykey) > token(maxTimeuuid(x)) limit 100; (where xxx is 0 for the first query, and

nodetool cfhistograms refresh

2013-10-01 Thread Rene Kochen
Quick question. I am using Cassandra 1.0.11 When is nodetool cfhistograms output reset? I know that data is collected during read requests. But I am wondering if it is data since the beginning (start of Cassandra) or if it is reset periodically? Thanks! Rene

Re: paging through a table with timeuuid primary key

2013-10-01 Thread Jan Algermissen
Jimmy, On 01.10.2013, at 17:26, Jimmy Lin wrote: > i have a table like the following: > > CREATE TABLE log ( > mykey timeuuid, > type text, > msg text, > primary key(mykey, type) > ); > > I want to page through all the results from the table using Have you considered the new build-in paging

Re: paging through a table with timeuuid primary key

2013-10-01 Thread David Ward
2.0 has a lot of really exciting stuff, unfortunately 2.0 has a lot of really exciting stuff that may increase the risk of updating to 2.0 just yet. On Tue, Oct 1, 2013 at 9:30 AM, Jan Algermissen wrote: > Jimmy, > > On 01.10.2013, at 17:26, Jimmy Lin wrote: > > > i have a table like the follow

Re: paging through a table with timeuuid primary key

2013-10-01 Thread Jimmy Lin
unfortunately, i have to stick with 1.2 for now for a while. So I am looking for the old fashion way to do the pagination correctly. I think i follow most of the articles on how to paging through a table, but maybe have some silly gap that don't give me the correct behavior or it is timeuuid not

Re: paging through a table with timeuuid primary key

2013-10-01 Thread Jan Algermissen
Maybe you are hitting the problem that your 'pages' can get truncated in the middle of a wide row. See https://groups.google.com/a/lists.datastax.com/d/msg/java-driver-user/lHQ3wKAZgM4/DnlXT4IzqsQJ Jan On 01.10.2013, at 18:12, Jimmy Lin wrote: > unfortunately, i have to stick with 1.2 for

Re: paging through a table with timeuuid primary key

2013-10-01 Thread Jimmy Lin
thanks, yea i am aware of that, and have already taken care. I just also found out a similar thread back in June http://mail-archives.apache.org/mod_mbox/cassandra-user/201306.mbox/%3ccakkz8q2no6oucbwnveomn_ymxfh0nkpqvtym55jmvwa2qwx...@mail.gmail.com%3E Somone was saying Long story short, usin

Re: nodetool cfhistograms refresh

2013-10-01 Thread Richard Low
On 1 October 2013 16:21, Rene Kochen wrote: > Quick question. > > I am using Cassandra 1.0.11 > > When is nodetool cfhistograms output reset? I know that data is collected > during read requests. But I am wondering if it is data since the beginning > (start of Cassandra) or if it is reset periodi

Re: default_time_to_live

2013-10-01 Thread Sylvain Lebresne
You're not supposed to change the table settings by modifying system.schema_columnfamilies as this will skip proper propagation of the change. Instead, you're supposed to do an ALTER TABLE, so something like: ALTER TABLE hol WITH default_time_to_live=10; That being said, if you restart the node

Maintaining counter column consistency

2013-10-01 Thread Ben Hood
Hi, We're maintaining a bunch of application specific counters that are incremented on a per event basis just after the event has been inserted. Given the fact that they can get of sync, we were wondering if there are any best practices or just plain real world experience for handling the consist

Rollback question regarding system metadata change

2013-10-01 Thread Christopher Wirt
Moving back to 1.2.10. What is the procedure roll back from 2.0.1? Changes in the system schema seem to make this quite difficult. We have: DC1 - 10 x 1.2.10 DC2 - 4 x 1.2.10 DC3 - 3 x 2.0.1 -> ran this for a couple days and have decided to roll back In my efforts I've now completel

Re: Rollback question regarding system metadata change

2013-10-01 Thread Robert Coli
On Tue, Oct 1, 2013 at 10:51 AM, Christopher Wirt wrote: > Moving back to 1.2.10. What is the procedure roll back from 2.0.1? > > ** ** > > Changes in the system schema seem to make this quite difficult. > > ... First, unfortunately downgrade is not, in my understanding, a supported oper

Re: PendingTasks: What does it mean inside Cassandra?

2013-10-01 Thread Robert Coli
On Wed, Aug 28, 2013 at 5:47 AM, Girish Kumar wrote: > When high number of Pending tasks are showing up what it means to > cassandra? What are the reasons for high number pending tasks? Does that > mean Cassandra is overloaded ? > It means that tasks have been queued to run inside of a Thread Po

RE: default_time_to_live

2013-10-01 Thread Pieter Callewaert
Thanks, it works perfectly with ALTER TABLE. Stupid I didn't thought of this. Maybe I overlooked, but maybe this should be added in the docs. Really a great feature! Kind regards, [Description: cid:image003.png@01CD9CE5.CE5A2330] Pieter Callewaert Web & IT engineer Web: www.be-mobil

Re: nodetool cfhistograms refresh

2013-10-01 Thread Rene Kochen
If I look at Read Latency I see indeed that they are reset during two runs of cfhistograms. However, "Row Size" and "Column Count" keep the values. When are they re-evaluated? Thanks! Rene 2013/10/1 Richard Low > On 1 October 2013 16:21, Rene Kochen wrote: > >> Quick question. >> >> I am usi

Re: nodetool cfhistograms refresh

2013-10-01 Thread Tyler Hobbs
On Tue, Oct 1, 2013 at 2:34 PM, Rene Kochen wrote: > However, "Row Size" and "Column Count" keep the values. When are they > re-evaluated? They are re-evaluated during compaction. -- Tyler Hobbs DataStax

Re: nodetool cfhistograms refresh

2013-10-01 Thread Rene Kochen
Thanks! Does that mean that cfhistograms scans all Statistics.db files in order to populate the "Row Size" and "Column Count" values? 2013/10/1 Tyler Hobbs > > On Tue, Oct 1, 2013 at 2:34 PM, Rene Kochen > wrote: > >> However, "Row Size" and "Column Count" keep the values. When are they >> re

Re: Rollback question regarding system metadata change

2013-10-01 Thread Chris Wirt
Yep they still work. They dont acutally have any of the new system CF created for 2.0, paxos, etc.. but they do have new rows in the schema_columns table preventing startup and bootstrapping of new nodes. If I drop the keyspace and recreate quickly, I'm guessing that will cause quite a large mess

Re: nodetool cfhistograms refresh

2013-10-01 Thread Tyler Hobbs
On Tue, Oct 1, 2013 at 3:52 PM, Rene Kochen wrote: > Does that mean that cfhistograms scans all Statistics.db files in order to > populate the "Row Size" and "Column Count" values? On startup, yes. After that, it should be updated as new SSTables are created. -- Tyler Hobbs DataStax

Re: Rollback question regarding system metadata change

2013-10-01 Thread Robert Coli
On Tue, Oct 1, 2013 at 3:45 PM, Chris Wirt wrote: > Yep they still work. They dont acutally have any of the new system CF > created for 2.0, paxos, etc.. but they do have new rows in the > schema_columns table preventing startup and bootstrapping of new > nodes. > It *may* be least risky to manu

Re: Unbalanced ring mystery multi-DC issue with 1.1.11

2013-10-01 Thread Aaron Morton
Check the logs for messages about nodes going up and down, and also look at the MessagingService MBean for timeouts. If the node in DR 2 times out replying to DR1 the DR1 node will store a hint. Also when hints are stored they are TTL'd to the gc_grace_seconds for the CF (IIRC). If that's low

Re: changing the primary key type of a table

2013-10-01 Thread Aaron Morton
> is there any downside using text as primary key? any performance impact on > the partition ? Nope. > There is no way to alter a table's primary key with a cql command, that is > what i have read, migrating to a new table seems to be the only way. Yup. > Is there any good recommendation how

Re: What is the best way to install & upgrade Cassandra on Ubuntu ?

2013-10-01 Thread Aaron Morton
> Does DSC include other things like Opscenter by default ? Not sure, I've normally installed it with an existing cluster. > Would it be possible to remove any of these installations but keeping the > data intact & easily switch to the another, I mean switching from DSC package > to apache one

Re: 2.0.1 counter replicate on write error

2013-10-01 Thread Aaron Morton
> Thanks Aaron, I’ve added to the ticket. We were not running on TRACE logging. Thanks. The only work around I can think of is using nodetool scrub. That will read the -Data.db file and re-write it and the other components. Remember to snapshot first for roll back. Cheers -

Re: Refactoring old project

2013-10-01 Thread Aaron Morton
I would try: Comments CF: row_key: (thing_type : thing_id ) where thing_type is "city" etc column_name: (comment_id (reversed)) where comment_id is a timeuuid column_value: the comment. You will need to be wary of very wide rows. It's a pretty simple model for CQL 3 as well: CREATE TABLE comm

Re: temporal solution to CASSANDRA-5543: BUILD FAILED at gen-cql2-grammar target

2013-10-01 Thread Aaron Morton
> In the build file, I see that cassandra uses the jar lib at the ${build.lib} > folder, in this case antlr-3.2.jar my bad. > > • ant generate-cql-html > > • ant maven-ant-tasks-init > > and then execute ant default target > > > > > > • ant Does it work if you use ant clea

Re: Cassandra Summit EU 2013

2013-10-01 Thread Aaron Morton
I'll be there :) * Conducting training with DS on the 16th and 18th. (Still tickets available on the 18th http://www.datastax.com/cassandraeurope2013) * Participating in the panel discussion for Cassandra London with Time Moreton (Acnunu), Patrick McFadin (DataStax), Al Tobey (DataStax) on the 1

Cassandra Heap Size for data more than 1 TB

2013-10-01 Thread srmore
Does anyone know what would roughly be the heap size for cassandra with 1TB of data ? We started with about 200 G and now on one of the nodes we are already on 1 TB. We were using 8G of heap and that served us well up until we reached 700 G where we started seeing failures and nodes flipping. With

Re: paging through a table with timeuuid primary key

2013-10-01 Thread Jimmy Lin
ok found out the problem.. i was using something like: select * from log where token(mykey) > token(maxTimeuuid(x)) limit 100; instead I should just simply use select * from log where token(mykey) > token(key_from_last_result) limit 100; the fake timeuuid although represent the time from la

Re: Cassandra Heap Size for data more than 1 TB

2013-10-01 Thread Mohit Anchlia
Which Cassandra version are you on? Essentially heap size is function of number of keys/metadata. In Cassandra 1.2 lot of the metadata like bloom filters were moved off heap. On Tue, Oct 1, 2013 at 9:34 PM, srmore wrote: > Does anyone know what would roughly be the heap size for cassandra with >