[hadoop] Counters in ColumnFamilyOutputFormat?

2011-05-19 Thread Mck
I'd like to investigate using Counters in hadoop using ColumnFamilyOutputFormat. But i see that this class uses outdated ..hadoop.arvo classes Does it make sense to use counters for hadoop output? If i try rewriting ColumnFamilyOutputFormat and friends should it be to the normal ..avro classes,

Re: Inconsistent results using secondary indexes between two DC

2011-05-19 Thread Wojciech Pietrzok
Just checked. Seems to be present in CF on all nodes (in both datacenters), but are not indexed correctly On each node I've used sstablekeys for all CF_NAME-f-XX-Data.db files. In cassandra-cli I've (using node that behaves correctly) made query get CF_NAME where foo = bar, got correct number of r

Re: [RELEASE] Apache Cassandra 0.7.6 released

2011-05-19 Thread Sylvain Lebresne
A small error made it's way on my previous mail. The issue related to the debian package problem is: https://issues.apache.org/jira/browse/CASSANDRA-2481 -- Sylvain On Wed, May 18, 2011 at 9:54 PM, Sylvain Lebresne wrote: > A small error in the debian setup script made it's way into the debian >

RE: Cassandra CMS

2011-05-19 Thread Vivek Mishra
Hi, Additionally please take a look at Kundera. Kundera is an open source and currently supporting ORM over CASSANDRA, Hbase, MongoDB. Support for REDIS will be there in future. https://github.com/impetus-opensource/Kundera Blogs for reference are: http://xamry.wordpress.com/2011/05/02/working

Support for IN clause

2011-05-19 Thread Vivek Mishra
Does CQL support IN clause? Write to us for a Free Gold Pass to the Cloud Computing Expo, NYC to attend a live session by Head of Impetus Labs on 'Secrets of Building a Cloud Vendor Agnostic PetaByte Scale Real-time Secure Web Application on the Cloud '. Loo

Re: Questions about using MD5 encryption with SimpleAuthenticator

2011-05-19 Thread Ted Zlatanov
On Wed, 18 May 2011 17:16:28 -0700 Sameer Farooqui wrote: SF> But even SSL/TLS is subject to attacks from tools like SSLSNIFF: SF> http://www.thoughtcrime.org/software/sslsniff For perfect security, unplug the server and remove the hard drive. Ted

Re: Support for IN clause

2011-05-19 Thread Yuki Morishita
Hi, I think IN clause for SELECT and UPDATE will be supported in v0.8.1. See https://issues.apache.org/jira/browse/CASSANDRA-2553 2011/5/19 Vivek Mishra : > Does CQL support IN clause? > > > > > > > > > Write to us for a Free Gold Pass to the Cloud Computing Expo,

java.io.IOError: java.io.EOFException with version 0.7.6

2011-05-19 Thread Rene Kochen
I have some severe problems on our production site. I created the following test program to reproduce the issue with Cassandra 0.7.6 (with empty data set). I use the following data-model column_metadata: [] name: Customers column_type: Super gc_grace_seconds: 60 I have a super-column-family wit

Re: [hadoop] Counters in ColumnFamilyOutputFormat?

2011-05-19 Thread Jonathan Ellis
Avro is there because (1) a long time ago (it now seems) we thought we were going to move the main RPC layer to Avro and (2) it simplifies using Avro for Streaming, which also seems misguided now (https://issues.apache.org/jira/browse/CASSANDRA-1497). Using "native" Thrift mutations makes the most

Re: java.io.IOError: java.io.EOFException with version 0.7.6

2011-05-19 Thread Sylvain Lebresne
Would you have a simple script to reproduce the issue ? And could you open a JIRA ticket. Sylvain On Thu, May 19, 2011 at 4:22 PM, Rene Kochen wrote: > I have some severe problems on our production site. > I created the following test program to reproduce the issue with Cassandra > 0.7.6 (with e

Re: java.io.IOError: java.io.EOFException with version 0.7.6

2011-05-19 Thread Jonathan Ellis
It would be useful to post your program. On Thu, May 19, 2011 at 9:22 AM, Rene Kochen wrote: > I have some severe problems on our production site. > I created the following test program to reproduce the issue with Cassandra > 0.7.6 (with empty data set). > > I use the following data-model > > col

Re: [hadoop] Counters in ColumnFamilyOutputFormat?

2011-05-19 Thread Jeremy Hanna
FWIW, as I mentioned in the 1497 comments, the patch makes it abstract so that you can have any rpc/marshalling format you want with a simple extension point. So if we want to move to something besides avro, or even like I mentioned do something with Dumbo for streaming, it's easy to extend. O

selecting data

2011-05-19 Thread karim abbouh
i'm new using cassandra database, i want to get data as in relationnel database: select * from table where field="value"; i see using CLI we have just the followings commands : get .[''] Get a slice of columns. get .[''][''] Get a slice of sub colu

RE: selecting data

2011-05-19 Thread Vivek Mishra
You need to use CQL. Additionally JDBC driver on top of CQL is part of beta release. From: karim abbouh [karim_...@yahoo.fr] Sent: 19 May 2011 21:41 To: user@cassandra.apache.org Subject: selecting data i'm new using cassandra database, i want to get data as in rel

Re : selecting data

2011-05-19 Thread karim abbouh
thanks, but is there a way using just CLI and storage-conf.xml? De : Vivek Mishra À : "user@cassandra.apache.org" Envoyé le : Jeu 19 mai 2011, 17h 23min 15s Objet : RE: selecting data You need to use CQL. Additionally JDBC driver on top of CQL is part of be

Re: selecting data

2011-05-19 Thread Watanabe Maki
Cassandra is not a RDBMS. Only you can do is search on a key, or you need full scan. You need to design your schema carefully as your application needs. On 2011/05/20, at 1:11, karim abbouh wrote: > i'm new using cassandra database, > i want to get data as in relationnel database: > select * f

Re: Inconsistent results using secondary indexes between two DC

2011-05-19 Thread mcasandra
I am wondering if running nodetool repair will help in anyway -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Inconsistent-results-using-secondary-indexes-between-two-DC-tp632p6382819.html Sent from the cassandra-u...@incubator.apache.org mail

Re: Commitlog Disk Full

2011-05-19 Thread Mike Malone
Just noticed this thread and figured I'd chime in since we've had similar issues with the commit log growing too large on our clusters. Tuning down the flush timeout wasn't really an acceptable solution for us since we didn't want to be constantly flushing and generating extra SSTables for no reaso

Re: selecting data

2011-05-19 Thread Jonathan Ellis
only 0.7+ has index support On Thu, May 19, 2011 at 11:38 AM, Watanabe Maki wrote: > Cassandra is not a RDBMS. Only you can do is search on a key, or you need > full scan. > You need to design your schema carefully as your application needs. > > > On 2011/05/20, at 1:11, karim abbouh wrote: > >

Re: Commitlog Disk Full

2011-05-19 Thread Jonathan Ellis
That's basically the approach I want to take in https://issues.apache.org/jira/browse/CASSANDRA-2427. On Thu, May 19, 2011 at 12:00 PM, Mike Malone wrote: > Just noticed this thread and figured I'd chime in since we've had similar > issues with the commit log growing too large on our clusters. Tu

Re : selecting data

2011-05-19 Thread karim abbouh
for example in 0.7 how we use index ? De : Jonathan Ellis À : user@cassandra.apache.org Envoyé le : Jeu 19 mai 2011, 18h 04min 48s Objet : Re: selecting data only 0.7+ has index support On Thu, May 19, 2011 at 11:38 AM, Watanabe Maki wrote: > Cassandra is no

Re: Re : selecting data

2011-05-19 Thread Sasha Dolgy
http://www.datastax.com/dev/blog/whats-new-cassandra-07-secondary-indexes On Thu, May 19, 2011 at 7:10 PM, karim abbouh wrote: > for example in 0.7 how we use index ?

Re: Cassandra CMS

2011-05-19 Thread Edward Capriolo
On Thu, May 19, 2011 at 8:11 AM, Vivek Mishra wrote: > Hi, > > Additionally please take a look at Kundera. > > Kundera is an open source and currently supporting ORM over CASSANDRA, > Hbase, MongoDB. > > Support for REDIS will be there in future. > > > > https://github.com/impetus-opensource/Kun

Re: [hadoop] Counters in ColumnFamilyOutputFormat?

2011-05-19 Thread Mick Semb Wever
On Thu, 2011-05-19 at 09:23 -0500, Jonathan Ellis wrote: > > Using "native" Thrift mutations makes the most sense to me now, which > would keep it similar in structure but avoid the avroToThrift copy. https://issues.apache.org/jira/browse/CASSANDRA-2667 -- "Everything you can imagine is real.

Re: Exception when starting

2011-05-19 Thread Brandon Williams
On Thu, May 19, 2011 at 1:51 PM, Eranda Sooriyabandara <0704...@gmail.com> wrote: > Hi devs, > I tried to start the Apache Cassandra and got an exception. This is what log > says, > > INFO 00:18:12,226 Logging initialized >  INFO 00:18:12,278 Heap size: 1029701632/1029701632 >  INFO 00:18:12,281 JN

Re: Unable to add columns to empty row in Column family: Cassandra

2011-05-19 Thread anuya joshi
Thank you Narendra/Aaron. Sorry for late respponse. PFB further information on this. 1) How do you delete the data in the cli ? Is it a row delete e.g. del MyCF['my-key']; *[Anuya]:* Yeach. Exactly the same way. 2) What client are you using the insert the row the second time ? e.g. custom th

Re: java.io.IOError: java.io.EOFException with version 0.7.6

2011-05-19 Thread kochen
http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/file/n6383644/CassandraIssue.zip CassandraIssue.zip This is the test program (.NET 4) I use Cassandra 0.7.6 with standard yaml and this super-column-family: create column family Customers with column_type = 'Super' and comparator

Re: How to configure internode encryption in 0.8.0?

2011-05-19 Thread Sameer Farooqui
Thanks, Jeremy! Nirmal, any advice on how to generate the key/trust stores with the correct cipher? - Sameer On Wed, May 18, 2011 at 8:10 AM, Jeremy Hanna wrote: > I'll CC Nirmal Ranganathan who implemented the internode encryption who > might be able to give you some advice on this. > > On Ma

Re: How to configure internode encryption in 0.8.0?

2011-05-19 Thread Christopher Deutsch
On Tue, May 17, 2011 at 5:47 PM, Sameer Farooqui wrote: > > Unfortunately, the default instructions in the above link > used TLS_RSA_WITH_AES_256_CBC_SHA. So, when I start Cassandra now, I get this > error: > ERROR 00:10:38,734 Exception encountered during startup. > java.lang.IllegalArgumentExc

Can I use secondary index with any partitioner

2011-05-19 Thread Dave Rav
Can I use secondary index with any partitioner   1) RandomPartitioner 2) ByteOrderedPartitioner

Re: Cassandra Vs. Oracle Coherence

2011-05-19 Thread aaron morton
I've not used Coherence, all I know if from reading the first paragraph here http://www.oracle.com/technetwork/middleware/coherence/overview/index.html and wikipedia:) Cassandra is not a caching layer, it's a database. You can rely on it as your database, and some people find when they do they

Re: Knowing when there is a *real* need to add nodes

2011-05-19 Thread aaron morton
Considering disk usage is a tricky one. Compacted SSTables files will remain on disk until either there is not enough space, or the JVM GC runs. To measure the live space use the "Space used (live)" from the CFStats. "Space used (total)" includes the space which has been compacted and not yet de

Re: Recommandation on how to organize CF

2011-05-19 Thread aaron morton
I'm a bit confused by your examples. I think you are saying... - Standard CF called Message using the UTF8Type for column comparisons used to store the individual messages. Row key is the message UUID. Not sure what the columns are. - Standard CF called MessageTime using TimeUUIDType for column

Re: Support for IN clause

2011-05-19 Thread aaron morton
Language spec is here https://github.com/apache/cassandra/blob/trunk/doc/cql/CQL.textile - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 20 May 2011, at 01:42, Yuki Morishita wrote: > Hi, > > I think IN clause for SELECT and UPDATE will b

Re: Exception when starting

2011-05-19 Thread Eranda Sooriyabandara
Thanks Brandon, All data in /var/lib/cassandra was corrupted and after removing them it started normally.