AW: New web client & future API

2011-07-14 Thread MW | Codefreun.de
Hi out there, it was a bit quiet now because I am changing the framework with which Apollo is built, to get away from the flash-based charting. But it continues ... Another question is: What would be a good name for that UI, Apollo seems to be used in another Cassandra context? Greets Markus -

What available Cassandra schema documentation is available?

2011-07-14 Thread Andreas Markauskas
I couldn't find any schema example for the supercolumn column family that is strongly typed. For example, create column family Super1 with comparator=UTF8Type and column_type=Super and key_validation_class=UTF8Type and column_metadata = [ {column_name: username, validation_class:UTF8Type}, {column

gossiper problem

2011-07-14 Thread Donna Li
All: I have four cassandra servers in cluster. I do not restart any one of the servers, why the following print show the four servers restart many times? What is the possible reason? The connection between the four server's is good. Swap may be used, because there are other applications run with

NegativeArraySizeException

2011-07-14 Thread Donna Li
All: What is the following error mean? ERROR [pool-1-thread-62] 2011-07-14 14:31:04,671 CustomTThreadPoolServer.java (line 173) Error occurred during processing of message. java.lang.NegativeArraySizeException at org.apache.thrift.protocol.TBinaryProtocol.readStringBody(TBina

Thrift Java Client - Get a column family from a Keyspace

2011-07-14 Thread Chandrasekhar M
Hi I have been playing around with Cassandra and its Java Thrift Client. >From my understanding, one could get/retrieve a Keyspace, KsDef object, using >the describe_keyspace(String name) method on the Cassandra.Client object. Subsequently, one could get a list of all the ColumnFamily definitio

Re: Cassandra Monitoring

2011-07-14 Thread Albert Vila
Anyone has Cassandra's cacti templates for server 0.7.4+? On 20 December 2010 17:40, Edward Capriolo wrote: > On Sun, Dec 19, 2010 at 10:37 PM, Dave Viner wrote: >> Can you share the code for run_column_family_stores.sh ? >> >> On Sun, Dec 19, 2010 at 6:14 PM, Edward Capriolo >> wrote: >>> >>>

Re: Survey: Cassandra/JVM Resident Set Size increase

2011-07-14 Thread William Oberman
I finally upgraded to 0.7.4 -> 0.8.0 (using riptano packages) 2 days ago. Before, my resident memory (for the java process) would slowly grow without bound and the OS would kill the process. But, over the last 2 days, I _think_ it's been stable. I'll let you know in a week :-) My other stats: AW

Re: Cassandra Monitoring

2011-07-14 Thread Edward Capriolo
On Thu, Jul 14, 2011 at 8:58 AM, Albert Vila wrote: > Anyone has Cassandra's cacti templates for server 0.7.4+? > > On 20 December 2010 17:40, Edward Capriolo wrote: > > On Sun, Dec 19, 2010 at 10:37 PM, Dave Viner > wrote: > >> Can you share the code for run_column_family_stores.sh ? > >> > >>

Re: NegativeArraySizeException

2011-07-14 Thread Jonathan Ellis
That means something sent a nonsense request to Cassandra. Often this happens when a non-Cassandra client connects on the Thrift port. On Thu, Jul 14, 2011 at 3:01 AM, Donna Li wrote: > All: > >     What is the following error mean? > > > > ERROR [pool-1-thread-62] 2011-07-14 14:31:04,671 >

Re: JDBC CQL Driver unable to locate cassandra.yaml

2011-07-14 Thread Derek Tracy
I tried putting the cassandra.yaml in the classpath but got the same error. Adding -Dcassandra.config=file:/path/to/cassandra.yaml did work. - Derek Tracy trac...@gmail.com - On Wed, Jul 13, 2011 at 6:22 PM, Jonathan Ellis wrote:

JDBC CQL Driver setAutoCommit Unsupported Method

2011-07-14 Thread Derek Tracy
Still trying to integrate Cassandra's CQL JDBC driver with my companies ETL but ran into another roadblock. I will caveat this post with "I do not know a lot about JDBC and how it is implemented" When trying to test the connection (using the ETL) I get an Unsupported Method exception, I looked at

Range query ordering with CQL JDBC

2011-07-14 Thread Matthieu Nahoum
Hi, I am trying to range-query a column family on which the keys are epochs (similar to the output of System.currentTimeMillis() in Java). In CQL (Cassandra 0.8.1 with JDBC driver): SELECT * FROM columnFamily WHERE KEY > '130920500'; I can't get to have a result that make sense, it always re

Re: Question about compaction

2011-07-14 Thread Maki Watanabe
These 0 byte files with "-Compacted" suffix indicate that the associated sstables can be removed. In current version, Cassandra delete compacted sstables at Full GC and on startup. maki 2011/7/14 Sameer Farooqui : > Running Cassandra 0.8.1. Ran major compaction via: > > sudo /home/ubuntu/brisk/r

Re: JDBC CQL Driver setAutoCommit Unsupported Method

2011-07-14 Thread Jonathan Ellis
Unsupported means it doesn't work yet. :) In the case of autocommit, I'm not sure it will ever make sense. On the one hand it could make sense to turn autocommit=off statements into a batch, but we don't want to confuse people into thinking it provides some kind of transaction isolation for reads

Re: Storing counters in the standard column families along with non-counter columns ?

2011-07-14 Thread Chris Burroughs
On 07/13/2011 03:57 PM, Aaron Morton wrote: > You can always use a dedicated CF for the counters, and use the same row key. Of course one could do this. The problem is you are now spending ~2x disk space on row keys, and app specific client code just became more complicated.

Re: Storing counters in the standard column families along with non-counter columns ?

2011-07-14 Thread Aditya Narayan
Thanks Aaron & Chris, I appreciate your help. With dedicated CF for counters, in addition to the issue pointed by Chris, the major drawback I see is that I cant read *in a single query* the counters with the regular columns row which is widely required by my application. My use case is like storin

Re: Question about compaction

2011-07-14 Thread Sameer Farooqui
You were right, Maki. Restarting Cassandra cleaned up the directory and now there are only two SSTable files. On Thu, Jul 14, 2011 at 9:08 AM, Maki Watanabe wrote: > These 0 byte files with "-Compacted" suffix indicate that the > associated sstables can be removed. > In current version, Cassandr

Re: question on capacity planning

2011-07-14 Thread Sameer Farooqui
So, in our experience, the amount of storage overhead is much higher. If you plan on storing 120TB of data, you will want to expect storing 250 TB of data on disk after the data over head. And then since you have to leave 50% of storage space free for compaction, you're looking at needing about 500

Data overhead discussion in Cassandra

2011-07-14 Thread Sameer Farooqui
We just set up a demo cluster with Cassandra 0.8.1 with 12 nodes and loaded 1.5 TB of data into it. However, the actual space on disk being used by data files in Cassandra is 3 TB. We're using a standard column family with a million rows (key=string) and 35,040 columns per key. The column name is a

Re: CQL + Counters = bad request

2011-07-14 Thread Nate McCall
Yep there was an issue here. RPM has been updated to 0.8.1-2 and deployed. Thanks for tracking this down. On Wed, Jul 13, 2011 at 3:58 PM, Aaron Turner wrote: > Thanks.  Looks like we tracked down the problem to the datasax 0.8.1 > rpm is actually 0.8.0. > > rpm -qa | grep cassandra > apache-cass

Re: Off-heap Cache

2011-07-14 Thread Vijay
Use describe keyspace and see the settings are right. Check the logs on all the servers, Make sure you dont see errors... Check JNA jar in all the servers. Regards, On Wed, Jul 13, 2011 at 1:29 PM, Raj N wrote: > How do I ensure it is indeed using the SerializingCacheProvider. > > Thanks > -

Re: gossiper problem

2011-07-14 Thread Vijay
How about GC logs, what are your pause times? JVM settings might help If you are not sure how to enable GC logs check cassandra.yaml look for application pause times. it is highly recommended not to swap -- include JNA jar. Regards, On Thu, Jul 14, 2011 at 1:42 AM, Donna Li wrote: > All

Commit log is not emptied after "nodetool drain"

2011-07-14 Thread Zhu Han
The deployed version is based on 0.6.13. After "nodetool drain" is invoked on one of the nodes, the commit log is not emptied. Is this the expected behavior? If so, how can I rename a column family on 0.6.x branch? Here is the log output: " INFO [COMMIT-LOG-WRITER] 2011-07-15 00:39:49,541 CommitL

ttl on a record?

2011-07-14 Thread Boris Yen
Hi, For now, cassandra support setting ttl on columns, is there any way to do the same to a record/row? Regards Boris

Re: Commit log is not emptied after "nodetool drain"

2011-07-14 Thread Jonathan Ellis
It's expected to have a new, empty segment after drain completes. 2011/7/14 Zhu Han : > The deployed version is based on 0.6.13. > > After "nodetool drain" is invoked on one of the nodes, the commit log is not > emptied. Is this the expected behavior? If so, how can I rename a column > family on 0

Re: ttl on a record?

2011-07-14 Thread Jonathan Ellis
No. Just set it on all the columns. On Thu, Jul 14, 2011 at 7:08 PM, Boris Yen wrote: > Hi, > For now, cassandra support setting ttl on columns, is there any way to do > the same to a record/row? > Regards > Boris -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the

Re: ttl on a record?

2011-07-14 Thread Boris Yen
Hi Jonathan, In this case, will this record with no column be removed from cassandra automatically? if no, do you have any plan on supporting it? Regards Boris On Fri, Jul 15, 2011 at 10:43 AM, Jonathan Ellis wrote: > No. Just set it on all the columns. > > On Thu, Jul 14, 2011 at 7:08 PM, Bo

Re: Commit log is not emptied after "nodetool drain"

2011-07-14 Thread Zhu Han
Jonathan, But all the old non-empty log segments are kept on the disk. And cassandra takes some time to apply the operations from these closed log segments after restart of the process. Is it expected? best regards, 韩竹(Zhu Han) 坚果铺子 , 最简单易用的云存储 同步文件, 分享照片, 文档备份! 2011

Re: ttl on a record?

2011-07-14 Thread Jonathan Ellis
On Thu, Jul 14, 2011 at 7:50 PM, Boris Yen wrote: > Hi Jonathan, > In this case, will this record with no column be removed from cassandra > automatically? Yes. -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.dat

Re: Commit log is not emptied after "nodetool drain"

2011-07-14 Thread Jonathan Ellis
If you have non-empty segments post-drain that is a bug. Is it reproducible? 2011/7/14 Zhu Han : > Jonathan, > > But all the old non-empty log segments are kept on the disk. And cassandra > takes some time to apply the operations from these closed log segments after > restart of the process. > >

Re: Commit log is not emptied after "nodetool drain"

2011-07-14 Thread Zhu Han
2011/7/15 Jonathan Ellis > If you have non-empty segments post-drain that is a bug. Is it > reproducible? > I think it is always reproducible on 0.6.x branch. Here is a simple experiment: 1) "bin/nodetool -h localhost" 2) During flush the memtables, we can observe the name of the old commit

Re: gossiper problem

2011-07-14 Thread samal
well I am not a JVM guru, but it seem server has memory problem. > 13 10:44:57,748 Gossiper.java (line 579) InetAddress /10.63.61.74 is now > UP > > INFO [Timer-0] 2011-07-13 15:56:44,630 Gossiper.java (line 181) > InetAddress /10.63.61.74 is now dead. > > INFO [GMFD:1] 2011-07-13 15:56

Re: ttl on a record?

2011-07-14 Thread Boris Yen
Thanks a lot. ^^ My project can make good use of this feature. On Fri, Jul 15, 2011 at 10:59 AM, Jonathan Ellis wrote: > On Thu, Jul 14, 2011 at 7:50 PM, Boris Yen wrote: > > Hi Jonathan, > > In this case, will this record with no column be removed from cassandra > > automatically? > > Yes. >

Cache layer in front of cassandra... any help / suggestions?

2011-07-14 Thread Suman Ghosh
Hi, We're presently trying to use Cassandra as a storage/retrieval system for live data & composite counters (on the data). As we work on telecom data records (voice call/sms/GPRS xDRs), the data volume is simply HUGE, and we definitely need a "controlled" caching mechanism in front of the Cas