Re: CQL and schema-less column family

2011-09-09 Thread osishkin osishkin
Hi, sorry for re-posting, but it would be very helpful to get some input on my previous post, so I'd know which direction to take. So if anyone of the more experienced users here can help, it would be greatly appreciated. Thank you Osi -- Forwarded message -- From: osishkin osishk

Re: Mutations during selects

2011-09-09 Thread altanis
I a thinking about a scenario that goes like this: a node is reading a secondary index to reply to a select query. While in the middle of this, two rows are mutated, one that has already been read and considered for the select result, and one that is yet to be processed. Say both rows where changed

JNA fails to load ?

2011-09-09 Thread Yang
I have jna-3.2.7 in the classpath, but at the start of server messages, I see: INFO 17:48:12,321 Unable to link C library. Native methods will be disabled. java.lang.UnsatisfiedLinkError: Error looking up function '$$YJP$$mlockall': java: undefined symbol: $$YJP$$mlockall at com.sun.jna.Fu

Key Range

2011-09-09 Thread Alaa Zubaidi
Hi, Using 0.7.4, BOP, and RF=3, Write->QUORUM and Read->ONE "NO UPDATES" How does get_range_slices using Key Range works? Is it possible to get out of date list of keys? If a key is inserted into 2 Nodes and after that a read with a key range is issued, is it possible to have the 3 Node (that do

Re: mysterious data disappearance - what happened?

2011-09-09 Thread Peter Schuller
> cluster name for both machines.  So in other words, if we want to launch two > separate instances of cassandra and keep them separate, we must make sure > each uses a different cluster name or else they will gang up into the same > cluster?  But how do they even discover each other?  Can someone

Re: Is sstable2json broken in 0.8.4+?

2011-09-09 Thread Anthony Ikeda
Okay, so let me get this straight, the command should accept: -f (-Data.db) The column family in question uses a UTF8Type Row Key and a composite column name (UTF8Type, TimeUUID) and UTF8Type Column value. Do I need to specify the rowkey, validator and comparator types as well? I'm not sure ho

Re: Disable hector stats

2011-09-09 Thread David Hawthorne
I do it with a log4j properties file: log4j.appender.null=org.apache.log4j.varia.NullAppender log4j.category.me.prettyprint.cassandra.hector.TimingLogger=INFO, null log4j.additivity.me.prettyprint.cassandra.hector.TimingLogger=false On Sep 9, 2011, at 2:07 PM, Daning wrote: > Hi, > > How to d

performance diagnosis questions

2011-09-09 Thread Yang
I'm trying to understand where my queries are spending their time, trying yourkit , vmstat, iostat -x, plus trial and error by enabling/disabling some features my application basically creates a lot of entries for "user history", where each history is a row, and is maintained to be less than 20

Disable hector stats

2011-09-09 Thread Daning
Hi, How to disable hector stats? We keep getting this in log (PeriodicalLog.java:221) INFO Thread-53040 2011-09-09 13:24:03,290 Statistics from Fri Sep 09 13:23:03 PDT 2011 to Fri Sep 09 13:24:03 PDT 2011 (PeriodicalLog.java:221) INFO Thread-53040 2011-09-09 13:24:03,291 Tag

Re: would expiring columns expire a row?

2011-09-09 Thread Jonathan Ellis
Yes. On Fri, Sep 9, 2011 at 2:49 PM, Yang wrote: > if all the columns in a row expired, would the row key be deleted ? > that way the key lookup could possibly be faster due to a smaller key space > > Thanks > Yang > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, th

Re: Is sstable2json broken in 0.8.4+?

2011-09-09 Thread Jonathan Ellis
Sounds like you told Cassandra a key? column? was UTF8 but it had non-UTF8 data in it. On Fri, Sep 9, 2011 at 2:06 PM, Anthony Ikeda wrote: > I can't seem to export an sstable. The parameter flags don't work either > (using -k and -f). > > sstable2json > /Users/X/Database/cassandra_files/data

would expiring columns expire a row?

2011-09-09 Thread Yang
if all the columns in a row expired, would the row key be deleted ? that way the key lookup could possibly be faster due to a smaller key space Thanks Yang

Re: possible feature request RP vs. OPP

2011-09-09 Thread Dean Hiller
wouldn't that be ignoring the fact that is just a "prefix" and there is still the unique key after that prefix ;), so yes it may be just as clumpy as using OPP but only within a node which I don't really see as a big deal at that point, or am I missing something? Though maybe the default impl woul

Is sstable2json broken in 0.8.4+?

2011-09-09 Thread Anthony Ikeda
I can't seem to export an sstable. The parameter flags don't work either (using -k and -f). sstable2json /Users/X/Database/cassandra_files/data/RegistryFoundation/ServerIdentityProfiles-g-3-Data.db WARN 12:01:55,721 Invalid file '.DS_Store' in data directory /Users/X/Database/cassandra_fi

Re: [RELEASE] Apache Cassandra 0.8.5 released

2011-09-09 Thread Jonathan Ellis
Please don't forget that a lot of non-DataStax people contribute to Apache Cassandra! Thanks to everyone for their contributions. On Fri, Sep 9, 2011 at 1:29 PM, Evgeniy Ryabitskiy wrote: > > > 2011/9/9 Roshan Dawrani >> >> On Thu, Sep 8, 2011 at 8:21 PM, Stephen Connolly >> wrote: >>> >>> can

Re: [RELEASE] Apache Cassandra 0.8.5 released

2011-09-09 Thread Evgeniy Ryabitskiy
2011/9/9 Roshan Dawrani > On Thu, Sep 8, 2011 at 8:21 PM, Stephen Connolly < > stephen.alan.conno...@gmail.com> wrote: > >> can take up to 12 hours for the sync to central >> > > Nearly 24 hours now, and 0.8.5 still not available at maven central - > http://mvnrepository.com/artifact/org.apache.c

Re: Replicate On Write behavior

2011-09-09 Thread David Hawthorne
They are evenly distributed. 5 nodes * 40 connections each using hector, and I can confirm that all 200 are active when this happened (from hector's perspective, from graphing the hector jmx data), and all 5 nodes saw roughly 40 connections, and all were receiving traffic over those connections

Using Brisk with the latest Cassandra Build (0.8.5)

2011-09-09 Thread Anthony Ikeda
I just wanted to confirm that we will be able to install Brisk with 0.8.5 cassandra as I am aware of some significant fixes and enhancements to the latest build of Cassandra. Anthony

Re: Mutations during selects

2011-09-09 Thread Jonathan Ellis
Consider this scenario in a SQL database: UPDATE foo SET x = 1 WHERE key = 'asdf'; Now, "simultaneously," two clients run UPDATE foo SET x = 2 WHERE key = 'asdf'; and SELECT * FROM foo WHERE x = 1; Either you get back row asdf, or you don't. Either is valid. Same thing happens with Cassandra

Re: Question on using consistency level with NetworkTopologyStrategy

2011-09-09 Thread Anand Somani
Oh yes, that is cool. I see from the code now (was reading it incorrectly). So a Quorum with NTS would give me 3 copies across the cluster, not necessarily 2 local and 1 remote, but for most parts that would be true since WAN adds to latency. Thanks On Thu, Sep 8, 2011 at 3:40 PM, Jonathan Elli

Cassandra as in-memory cache

2011-09-09 Thread kapil nayar
Hi, Can we configure some column-families (or keyspaces) in Cassandra to perform as a pure in-memory cache? The feature should let the memtables always be in-memory (never flushed to the disk - sstables). The memtable flush threshold settings of time/ memory/ operations can be set to a max value

Re: possible feature request RP vs. OPP

2011-09-09 Thread Edward Capriolo
On Fri, Sep 9, 2011 at 10:34 AM, Dean Hiller wrote: > I saw this quote in the pdf. > > "For large indexes with common terms this too much data! Queries with > > 100k hits" > > 1. What would be considered large? In most of my experience, we have the > typical size of a RDBMS index but just ha

Re: [RELEASE] Apache Cassandra 0.8.5 released

2011-09-09 Thread Stephen Connolly
On 9 September 2011 16:48, Stephen Connolly wrote: > On 9 September 2011 16:18, Sylvain Lebresne wrote: >> On Fri, Sep 9, 2011 at 4:52 PM, Stephen Connolly >> wrote: >>> is the staging repo released at repository.apache.org? or did somebody >>> forget to finish that step? >> >> Nobody forgot tha

Re: [RELEASE] Apache Cassandra 0.8.5 released

2011-09-09 Thread Stephen Connolly
On 9 September 2011 16:18, Sylvain Lebresne wrote: > On Fri, Sep 9, 2011 at 4:52 PM, Stephen Connolly > wrote: >> is the staging repo released at repository.apache.org? or did somebody >> forget to finish that step? > > Nobody forgot that step as can be seen in: > https://repository.apache.org/co

Mutations during selects

2011-09-09 Thread altanis
I see that Cassandra updates secondary indices as soon as a value of the indexed column is updated. This can happen, for example, during a select query with a condition on a secondary index. Does Cassandra perform no checking or locking? Will the result of this select, with old and new values, be r

Re: [RELEASE] Apache Cassandra 0.8.5 released

2011-09-09 Thread Sylvain Lebresne
On Fri, Sep 9, 2011 at 4:52 PM, Stephen Connolly wrote: > is the staging repo released at repository.apache.org? or did somebody > forget to finish that step? Nobody forgot that step as can be seen in: https://repository.apache.org/content/repositories/releases/org/apache/cassandra/apache-cassand

Re: [RELEASE] Apache Cassandra 0.8.5 released

2011-09-09 Thread Stephen Connolly
is the staging repo released at repository.apache.org? or did somebody forget to finish that step? - Stephen --- Sent from my Android phone, so random spelling mistakes, random nonsense words and other nonsense are a direct result of using swype to type on the screen On 9 Sep 2011 04:48, "Roshan

Re: possible feature request RP vs. OPP

2011-09-09 Thread Dean Hiller
I saw this quote in the pdf. "For large indexes with common terms this too much data! Queries with > 100k hits" 1. What would be considered large? In most of my experience, we have the typical size of a RDBMS index but just have many many many more indexes as the size of the index is just de

Re: possible feature request RP vs. OPP

2011-09-09 Thread Dean Hiller
Actually, we only need a 8 bit key(one whole byte) because an 8 bit key would be useful up to 2^8 nodes which I am pretty sure we would never get too. Of course, I guess we could use one more whole byte just in case ;) We are planning on doing this ourselvesit would just be nice if it was hid

[ANN] BigDataCamp Delhi, India, Sep 10, 2011

2011-09-09 Thread Sanjay Sharma
Registration here (few seats left) - http://www.cloudcamp.org/delhi Agenda: 9:30 am - Food, Drinks & Networking 10:00 am - Welcome, Thank yous & Introductions 10:15 am - Lightning Talks (5 minutes each) 10:45 am - Unpanel 11:45 am - Prepare for Unconference Breakout Sessions (solicit breakout t

Re: row key as long type

2011-09-09 Thread Thamizh
It is resolved. I used Map/Reduce program, in that I converted long row key as byte array and stored it as ByteBuffer.  Now row key are in sorted order. I can apply range query. E.g. $list ip[10001:10005]; Regards, Thamizhannal P --- On Fri, 9/9/11, Jonathan Ellis wrote: From: Jonathan Ell

Re: [RELEASE] Apache Cassandra 0.8.5 released

2011-09-09 Thread Roshan Dawrani
On Thu, Sep 8, 2011 at 8:21 PM, Stephen Connolly < stephen.alan.conno...@gmail.com> wrote: > can take up to 12 hours for the sync to central > Nearly 24 hours now, and 0.8.5 still not available at maven central - http://mvnrepository.com/artifact/org.apache.cassandra/cassandra-all :-( rgds, Rosh

Re: what's the difference between repair CF separately and repair the entire node?

2011-09-09 Thread Sylvain Lebresne
On Fri, Sep 9, 2011 at 4:18 AM, Yan Chunlu wrote: > I have 3 nodes and RF=3.  I  tried to repair every node in the cluster by > using "nodetool repair mykeyspace mycf" on every column family.  it finished > within 3 hours, the data size is no more than 50GB. > after the repair, I have tried using

Re: Replicate On Write behavior

2011-09-09 Thread Sylvain Lebresne
We'll solve #2890 and we should have done it sooner. That being said, a quick question: how do you do your inserts from the clients ? Are you evenly distributing the inserts among the nodes ? Or are you always hitting the same coordinator ? Because provided the nodes are correctly distributed on