Re: cassandra for a inbox search with high reading qps

2010-08-30 Thread Chen Xinli
what's the average size of a user? As I know, lucandra will first poll the data from cassandra, then do computation in the client. That's ok for small rows. But we have 1M row in average, and some rows scale to 100M; at the same time, we expect high reading qps. Polling these data to client machin

Re: cassandra for a inbox search with high reading qps

2010-08-30 Thread Todd Nine
We use Lucandra as well for searching for users, as well as geo-encoding. It really works well except for numeric fields. https://issues.apache.org/jira/browse/CASSANDRA-1235 That bug may be a bit of an issue, but after they release 0.6.5 all the Lucene functionality will be available to you. T

Re: cassandra for a inbox search with high reading qps

2010-08-30 Thread Mike Peters
Chen, Have you considered using http://www.slideshare.net/otisg/lucandra Lucandra for Inbox search? We have a similar setup and are currently looking into using Lucandra over implementing the searching ourselves with pure Cassandra. -- View this message in context: http://cassandra-user-in

Re: cassandra for a inbox search with high reading qps

2010-08-17 Thread Chen Xinli
Thanks for your reply. Cassandra, in our case, is used for searching purposes not for data storage. We can build the cassandra keyspace data daily/weekly when system load is lower. We have modified the cassandra code to add a value filter which makes the data-repair not working. The value filter

Re: cassandra for a inbox search with high reading qps

2010-08-17 Thread Benjamin Black
On Tue, Aug 17, 2010 at 7:55 PM, Chen Xinli wrote: > Hi, > > We are going to use cassandra for searching purpose like inbox search. > The reading qps is very high, we'd like to use ConsitencyLevel.One for > reading and disable read-repair at the same time. > In 0.7 you can set a probability for r

Re: cassandra for a inbox search with high reading qps

2010-08-17 Thread Chen Xinli
I'm using cassandra 0.6.4; there's a configuration option DoConsistencyChecksBoolean in storage-conf.xml. Is't that for read-repair ? I will do a test for WRITE QUORUM, READ.ONE if it can meet our requirements. 2010/8/18 Edward Capriolo > On Tue, Aug 17, 2010 at 10:55 PM, Chen Xinli wrote: > >

Re: cassandra for a inbox search with high reading qps

2010-08-17 Thread Edward Capriolo
On Tue, Aug 17, 2010 at 10:55 PM, Chen Xinli wrote: > Hi, > > We are going to use cassandra for searching purpose like inbox search. > The reading qps is very high, we'd like to use ConsitencyLevel.One for > reading and disable read-repair at the same time. > > For reading consistency in this cond