Re: RTG/MRTG/Cricket replacement using Cassandra?

2011-05-20 Thread Edward Capriolo
The first love of my open life was cacti. I am going to discuss with them porting some of the system to cassandra. On Friday, May 20, 2011, yangyangyyy wrote: > hi Ryan: > > > Thanks for the link. > I read the slides, could you please provide some more details on how the > temporal aggregation is

Re: RTG/MRTG/Cricket replacement using Cassandra?

2011-05-20 Thread yangyangyyy
hi Ryan: Thanks for the link. I read the slides, could you please provide some more details on how the temporal aggregation is implemented? do you use time+granularity as the key ? or as column names ? Thanks Yang In reply to this post by Aaron Turner We have a solution for time series data on

Re: CounterColumn

2011-05-20 Thread Jonathan Ellis
Look for "Fix version" on the ticket: https://issues.apache.org/jira/browse/CASSANDRA-2614. On Fri, May 20, 2011 at 4:35 PM, Mark Emerson wrote: > CASSANDRA-2614 - create Column and CounterColumn in the same column family > when this will be in cassandra > will this be in cassandra 0.8 -- Jon

CounterColumn

2011-05-20 Thread Mark Emerson
CASSANDRA-2614 - create Column and CounterColumn in the same column family when this will be in cassandra will this be in cassandra 0.8

rainbird question (why is the 1minute buffer needed?)

2011-05-20 Thread Yang
(sorry if Rainbird is not a topic relevant enough, I'd appreciate if someone could point me to a more appropriate venue in that case) Rainbird buffers up 1 minute worth of events first before writing to Cassandra. it seems that this extra layer of buffering is repetitive, and could be avoided :

Re: Can I use secondary index with any partitioner

2011-05-20 Thread Jonathan Ellis
empty byte array for the first call, last key from the previous resultset afterwards On Fri, May 20, 2011 at 12:53 PM, Dave Rav wrote: > if I use 'RandomPartitioner' and call 'get_indexed_slices' > > what  do I do with 'start_key' > > struct IndexClause { > 1: required list expressions >

Re: Inconsistent results using secondary indexes between two DC

2011-05-20 Thread Jonathan Ellis
Has this cluster always been on 0.7.5 or was it upgraded from an earlier version? On Thu, May 19, 2011 at 3:26 AM, Wojciech Pietrzok wrote: > Just checked. Seems to be present in CF on all nodes (in both > datacenters), but are not indexed correctly > > On each node I've used sstablekeys for all

Re: cannot parse as hex bytes

2011-05-20 Thread Patrick Julien
thanks On Fri, May 20, 2011 at 12:58 PM, Jonathan Ellis wrote: > You'd need to add a key validation type for 0.8. > > On Fri, May 20, 2011 at 9:28 AM, Patrick Julien wrote: >> The following sample: >> >> http://www.datastax.com/dev/blog/whats-new-cassandra-07-secondary-indexes >> >> No longer wo

Re: Exception when starting

2011-05-20 Thread mcasandra
In this case, yes. I was asking for the cases where commit log corruption was reported. -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Re-Exception-when-starting-tp6383464p6387101.html Sent from the cassandra-u...@incubator.apache.org mailing lis

Re: Can I use secondary index with any partitioner

2011-05-20 Thread Dave Rav
if I use 'RandomPartitioner' and call 'get_indexed_slices' what  do I do with 'start_key' struct IndexClause { 1: required list expressions 2: required binary start_key, 3: required i32 count=100, }  >Yes.   On Thu, May 19, 2011 at 7:24 PM, Dave Rav wrote:   > Can I use secondary

Re: Exception when starting

2011-05-20 Thread Krish Pan
No data gets lost - * only * thing corrupted is key-cache On Fri, May 20, 2011 at 10:17 AM, mcasandra wrote: > > Brandon Williams wrote: > > > > There was a bug, it is fixed. It's just a cache, chill. > > > > There is no time to chill when fighting it in production :) It's good to > know it's f

Re: Exception when starting

2011-05-20 Thread mcasandra
Brandon Williams wrote: > > There was a bug, it is fixed. It's just a cache, chill. > There is no time to chill when fighting it in production :) It's good to know it's fixed. Another question, when this happens are we able to restore data from replica nodes? -- View this message in context:

Re: Cassandra Vs. Oracle Coherence

2011-05-20 Thread Peter Lin
another product in the same area is gigaspaces. On Fri, May 20, 2011 at 1:12 PM, Milind Parikh wrote: > Other interesting flavors in a distributed cache terracotta, > gemfire.together with a complex event processing engine. like > OCEP > drives a lot of low latency, high freq tra

Re: Cassandra Vs. Oracle Coherence

2011-05-20 Thread Milind Parikh
Other interesting flavors in a distributed cache terracotta, gemfire.together with a complex event processing engine. like OCEP drives a lot of low latency, high freq trading where nano seconds matter /*** sent from my android...please pardon occasional typos as

Re: simple implementation of counters

2011-05-20 Thread Sasha Dolgy
uh. yeah ... was a bad morning ... cheers On Fri, May 20, 2011 at 6:57 PM, Jonathan Ellis wrote: > On Fri, May 20, 2011 at 5:55 AM, Sasha Dolgy wrote: >> First question I have is about the definition.  A column within a >> standard column family cannot be a counter column type? > > Right. https

Re: Exception when starting

2011-05-20 Thread Eranda Sooriyabandara
In my case I started cassandra after sometime with the newer version of it. I think this occurred because there were some files remained belongs to the previous version of cassandra and overwritten with the new one. This is just my thought. Thanks Eranda

Re: Cassandra Vs. Oracle Coherence

2011-05-20 Thread Peter Lin
Although one can use Coherence as a memory cache layer on top of a DB, many customer use it in the financial sector as a in-memory key/value store. Think of transient data that doesn't need to be saved, but needs to scale out across hundreds or thousands of nodes. memcached is making progress, bu

Re: Exception when starting

2011-05-20 Thread Brandon Williams
There was a bug, it is fixed. It's just a cache, chill. On May 20, 2011 11:50 AM, "mcasandra" wrote: > Whenever I hear someone say data is corrupted I panic :) I have seen few > people have reported that but have not seen the real reason for it. Is it a > manual error, config error, bug etc. It w

Re: Cassandra Vs. Oracle Coherence

2011-05-20 Thread mcasandra
Coherence is similar to memcachd (free). It's in memory cache layer on top of the DB. You as a user need to keep that cache in sync with the DB. -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Cassandra-Vs-Oracle-Coherence-tp6375561p6386847.html S

Re: cannot parse as hex bytes

2011-05-20 Thread Jonathan Ellis
You'd need to add a key validation type for 0.8. On Fri, May 20, 2011 at 9:28 AM, Patrick Julien wrote: > The following sample: > > http://www.datastax.com/dev/blog/whats-new-cassandra-07-secondary-indexes > > No longer works with 0.8.0-rc1 > > I get "cannot parse as hex bytes" when doing the > >

Re: simple implementation of counters

2011-05-20 Thread Jonathan Ellis
On Fri, May 20, 2011 at 5:55 AM, Sasha Dolgy wrote: > First question I have is about the definition.  A column within a > standard column family cannot be a counter column type? Right. https://issues.apache.org/jira/browse/CASSANDRA-2614 is open to address this but that's going to be post-0.8.0.

Re: Can I use secondary index with any partitioner

2011-05-20 Thread Jonathan Ellis
Yes. On Thu, May 19, 2011 at 7:24 PM, Dave Rav wrote: > Can I use secondary index with any partitioner > > > > 1) RandomPartitioner > 2) ByteOrderedPartitioner > > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://ww

Re: How to reduce the Read Latency.

2011-05-20 Thread mcasandra
What's your avg column size and row size? Your read latency in most case will directly be related to how much you are trying to read. In my experience you will see high read latency if you have big column size. -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2

Re: how to use indexed column for this case

2011-05-20 Thread Anand Somani
>From what I know you cannot create secondary indexes on SCF. You should have gotten this => https://issues.apache.org/jira/browse/CASSANDRA-1813 on index creation. On Fri, May 20, 2011 at 6:56 AM, Monkey me wrote: > Hi, > I have a SCF, Key is string, super column is TimeUUID, and several >

Re: Exception when starting

2011-05-20 Thread mcasandra
Whenever I hear someone say data is corrupted I panic :) I have seen few people have reported that but have not seen the real reason for it. Is it a manual error, config error, bug etc. It will be good to identify why these things happen so that it can be fixed before it happens in PROD :( -- Vie

Documentation of Known Issues

2011-05-20 Thread Daniel Doubleday
Hi all I was wondering if there might be some way to better communicate known issues. We do try to track jira issues but at times some slip through or we miss implications. Things like the broken repair of specific CFs. (https://issues.apache.org/jira/browse/CASSANDRA-2670). I know that this

RE: Re : Re : selecting data

2011-05-20 Thread Bahadur, Kamal
This is how you create it dynamically: KsDef ksdef = new KsDef(); ksdef.name = "ProgKS"; ksdef.replication_factor = 1; ksdef.strategy_class = "org.apache.cassandra.locator.RackUnawareStrategy"; List cfdefs = new ArrayList(); CfDef cfdef1 = new CfDef(); cfdef1.name = "ProgCF1"; cfdef1.ke

Re: Cassandra Vs. Oracle Coherence

2011-05-20 Thread Jeffrey Kesselman
AH, I stand corrected. Hard to follow Larry's acquisitions without a scorecard. On 5/20/11, Peter Lin wrote: > That's completely wrong. > > TimesTen and Coherence are 2 separate products sold by Oracle. > Coherence is a data grid that takes a key/value approach. It is > massively scalable across

Re : Re : selecting data

2011-05-20 Thread karim abbouh
a storage-conf.xml is read just at the starting of cassandra? is there a way to add a column family dynamically? BR De : karim abbouh À : user@cassandra.apache.org Envoyé le : Ven 20 mai 2011, 12h 48min 54s Objet : Re : selecting data is there a way to set

cannot parse as hex bytes

2011-05-20 Thread Patrick Julien
The following sample: http://www.datastax.com/dev/blog/whats-new-cassandra-07-secondary-indexes No longer works with 0.8.0-rc1 I get "cannot parse as hex bytes" when doing the "Next we add some users: [default@demo] set users[bsanderson][full_name] = 'Brandon Sanderson';" section I can confir

how to use indexed column for this case

2011-05-20 Thread Monkey me
Hi, I have a SCF, Key is string, super column is TimeUUID, and several columns with one column named "type", I create secondary index on this column. I want to have the foliowing query to fetch all super columns along with all columns. 1. given a specific key 2. given a range of sup

DatabaseMetadata

2011-05-20 Thread Vivek Mishra
Any thoughts on building something like separate DatabaseMetadata api for CQL? -Original Message- From: Peter Lin [mailto:wool...@gmail.com] Sent: Friday, May 20, 2011 5:28 PM To: user@cassandra.apache.org Subject: Re: Cassandra Vs. Oracle Coherence That's completely wrong. TimesTen and

Re: Cassandra Vs. Oracle Coherence

2011-05-20 Thread Peter Lin
That's completely wrong. TimesTen and Coherence are 2 separate products sold by Oracle. Coherence is a data grid that takes a key/value approach. It is massively scalable across LAN and WAN. In terms of comparing Cassandra and Coherence, I wouldn't. Coherence is a data grid and most often used as

Re : selecting data

2011-05-20 Thread karim abbouh
is there a way to set for a column of the same key a set of value ? De : Watanabe Maki À : "user@cassandra.apache.org" Envoyé le : Jeu 19 mai 2011, 17h 38min 39s Objet : Re: selecting data Cassandra is not a RDBMS. Only you can do is search on a key, or you

simple implementation of counters

2011-05-20 Thread Sasha Dolgy
Hi, I'm trying to play around with 0.8.0-rc1 and counters, and I'm a little confused. First question I have is about the definition. A column within a standard column family cannot be a counter column type? I had tried the following, with no success. create column family urlcounts with

Re: Inter node communication over UDP

2011-05-20 Thread Sylvain Lebresne
On Fri, May 20, 2011 at 9:39 AM, pankajsoni0126 wrote: > I am working on version 0.7.6 of cassandra. I have been looking into the code > to identify communication between nodes. > > it seems to me that both inter-node and servernode-client communication > happens using thrift protocol, is my under

Re: How to reduce the Read Latency.

2011-05-20 Thread Dikang Gu
I use the default consistency level in the hector client, so it should be QUORUM. -- Dikang Gu 0086 - 18611140205 On Friday, May 20, 2011 at 4:25 PM, Jeffrey Kesselman wrote: > What consistency are you asking for? > > On Fri, May 20, 2011 at 7:42 AM, Dikang Gu wrote: > > Hi All, > > I'm runni

Re: Inter node communication over UDP

2011-05-20 Thread Jeffrey Kesselman
TCP/IP byte over-head v. UDP really isnt that much if your packets are of any significant size (its 30 bytes). And as others have pointed out you can easily get more over-head with worse results trying to reinvent reliable transport on top of UDP. Remember that TCP/IP has had 30 years of developme

Re: How to reduce the Read Latency.

2011-05-20 Thread Jeffrey Kesselman
What consistency are you asking for? On Fri, May 20, 2011 at 7:42 AM, Dikang Gu wrote: > Hi All, > I'm running three cassandra 0.7.4 nodes in a cluster, and I give 2G memory > to each node. > Now, I get the cfstats here: > Keyspace: UserMap > Read Count: 38411 > Read Latency: 123.54214613001484 m

Re: Cassandra Vs. Oracle Coherence

2011-05-20 Thread Jeffrey Kesselman
I believe coherence is their name for the TimesTen technology they bought. TT is an in memory SQL database that can run as a cache for Oracle. Its totally different from Cassandra. On the one hand it supports trad SQL whereas Cassandra does not. On the other hand Cassandra is truly distribute

[RELEASE] Apache Cassandra 0.7.6-2 released

2011-05-20 Thread Sylvain Lebresne
Apache Cassandra 0.7.6 is just 2 days old, but it shipped with a bug in the debian packaging code that prevents the package from being successfully installed. Since debian packaging is an integral part of the project, 0.7.6-2 comes to fix this issue. This is the only change[1] that separate 0.7.6-

CQL: Select for multiple ranges

2011-05-20 Thread David Boxenhorn
In order to fully implement the functionality of super columns using compound columns I need to be able to select multiple column ranges - this would be functionally equivalent to selecting multiple super columns (and more!). I would like to request the following CQL syntax: SELECT [FIRST N] [REV

How to reduce the Read Latency.

2011-05-20 Thread Dikang Gu
Hi All, I'm running three cassandra 0.7.4 nodes in a cluster, and I give 2G memory to each node. Now, I get the cfstats here: Keyspace: UserMap Read Count: 38411 Read Latency: 123.54214613001484 ms. Write Count: 44155 Write Latency: 0.02341093873853471 ms. Pending Tasks: 0 Column Family: Map S

Re: Inter node communication over UDP

2011-05-20 Thread pankajsoni0126
I am working on version 0.7.6 of cassandra. I have been looking into the code to identify communication between nodes. it seems to me that both inter-node and servernode-client communication happens using thrift protocol, is my understanding correct? and the gossiper communication takes place us