Re: Insertion question

2010-09-24 Thread Jonathan Ellis
On Fri, Sep 24, 2010 at 7:12 PM, Lucas Nodine wrote: > I am working with 0.7.0-beta1 (distribution from bin on website) > > First, am I correct in that since beta1 keys are now bytes instead of > strings? Yes. > Second, should there be additional data before the key value that I specify > (read

Insertion question

2010-09-24 Thread Lucas Nodine
I am working with 0.7.0-beta1 (distribution from bin on website) First, am I correct in that since beta1 keys are now bytes instead of strings? Second, should there be additional data before the key value that I specify (read below for explaination)? I am attempting to perform a batch mutation w

Re: Cassandra hadoop Thrift Time out

2010-09-24 Thread aaron morton
There is some information on the wiki http://wiki.apache.org/cassandra/HadoopSupport about a resource leak before 0.6.2 versions that can result in a TimeoutException. But you're on 0.6.5 so should be ok. I had a quick look at the Hadoop code and could not see where to change the timeout (tha

Apache Con

2010-09-24 Thread aaron morton
I've been looking at the Cassandra, Couch DB, Hadoop offerings at Apache Con in Atlanta http://na.apachecon.com/c/acna2010/schedule/grid. Aside from the social aspect does anyone have an idea of how valuable these events are? I've got a reasonable view of Cassandra from the outside, and a very

Re: Cassandra & Pig & Framed Transport

2010-09-24 Thread Jonathan Ellis
by 0.7 I meant Cassandra 0.7 On Fri, Sep 24, 2010 at 4:18 PM, Mark wrote: >  I am using Pig v0.7 and Cassandra v0.6.5. The example that comes bundles up > in Cassandra under contrib/pig uses unframed by default. When I use the > default configuration for Cassandra then the Pig contrib works as ex

Re: Cassandra & Pig & Framed Transport

2010-09-24 Thread Mark
I am using Pig v0.7 and Cassandra v0.6.5. The example that comes bundles up in Cassandra under contrib/pig uses unframed by default. When I use the default configuration for Cassandra then the Pig contrib works as expected. However when I change the configuration to framed then pig just freeze

Re: 0.7 memory usage problem

2010-09-24 Thread Alaa Zubaidi
My rows consist of only *60 *columns and these 60 columns looks like this: ColumnName: Sensor59 -- Value: 434.2647915698039 -- TTL: 10800 On 9/24/2010 3:42 PM, Jonathan Ellis wrote: looks like you're OOMing trying to compact a very large row. solution: smaller rows, or larger heap. On Fri, S

Re: Cassandra & Pig & Framed Transport

2010-09-24 Thread Jonathan Ellis
I don't think you can (although in 0.7 framed is the default for Pig like everything else). On Fri, Sep 24, 2010 at 2:14 PM, Mark wrote: >  How does one enable framed transport when using the pig loadfunc? > > Thanks > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of Riptano, t

Re: Cassandra & Pig

2010-09-24 Thread Mark
Thanks Jonathan. I have this part figured out now :) Can you explain to me how I can get this to work with Framed support. It just hangs now and doesn't return anything On 9/24/10 3:39 PM, Jonathan Ellis wrote: pig doesn't have the thrift jar on its classpath On Fri, Sep 24, 2010 at 10:32 A

Re: 0.7 memory usage problem

2010-09-24 Thread Jonathan Ellis
looks like you're OOMing trying to compact a very large row. solution: smaller rows, or larger heap. On Fri, Sep 24, 2010 at 3:03 PM, Alaa Zubaidi wrote: >  Nothing is working, after disabling swap entirely, the heap is not > exhausted but Cassandra crashed with out of memory error. > I even slow

Re: Cassandra & Pig

2010-09-24 Thread Jonathan Ellis
pig doesn't have the thrift jar on its classpath On Fri, Sep 24, 2010 at 10:32 AM, Mark wrote: >  I am trying to run the Cassandra pig example but I keep receiving... > > org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to > open iterator for alias rows >    at org.apache.pi

Cassandra & Pig & Framed Transport

2010-09-24 Thread Mark
How does one enable framed transport when using the pig loadfunc? Thanks

Re: LongType from user input

2010-09-24 Thread Christian Decker
Thanks for your quick answer, I think I'll use an affix to sort of cast the keys, ranges and others from their textual representation (from Pig) to the desired byte representation, since I just noticed that the keys for the rows themselfs are always UTF8 interpreted, and since I want to make key-ra

Cassandra hadoop Thrift Time out

2010-09-24 Thread Saket Joshi
Hi Experts, I need help on an exception integrating cassandra-hadoop. I am getting the following exception, when running a Hadoop Map reduce job http://pastebin.com/RktaqDnj I am using cassandra 0.6.5 , 3 node cluster. I don't get any exception when the data I am processing is very small < 5

Re: Cassandra for graph data structure

2010-09-24 Thread Courtney Robinson
?Nate & Lucas thanks for the responses. Nate, I think it would be asking a bit much to suggest the hector team implement convenience methods for a graph representations. But if we went ahead and forked hector, I'd be sure to contribute back what i can and just release it as another client or if

Re: How can the cassandra token of a key be determined from the cassandra client side?

2010-09-24 Thread Stu Hood
Take a look at your particular implementation of org.apache.cassandra.dht.IPartitioner: each partitioner: creates tokens in a different way, but all of them are straightforward. - Reply message - From: "Dwight Smith" Date: Fri, Sep 24, 2010 1:07 pm Subject: How can the cassandra token o

How can the cassandra token of a key be determined from the cassandra client side?

2010-09-24 Thread Dwight Smith
This question relates to a C++ client application, to direct the Cassandra request to the correct Cassandra node based on token form of the key. Would the following work? If the token form of the key could be determined - the keyspace description could be used to select the correct Cassandra no

Cassandra & Pig

2010-09-24 Thread Mark
I am trying to run the Cassandra pig example but I keep receiving... org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias rows at org.apache.pig.PigServer.openIterator(PigServer.java:521) at org.apache.pig.tools.grunt.GruntParser.processDum

Re: LongType from user input

2010-09-24 Thread Tyler Hobbs
Yes, you can use describe_keyspace() and then look through the results. It's a little ugly in 0.6, but it works. - Tyler On Fri, Sep 24, 2010 at 11:25 AM, Christian Decker < decker.christ...@gmail.com> wrote: > Well I'm writing a loading function for Pig, and as it happens I want to be > able to

Re: LongType from user input

2010-09-24 Thread Christian Decker
Well I'm writing a loading function for Pig, and as it happens I want to be able to load slices from cassandra which are specified in the pig script (thus the input from stdin) but the ColumnFamily from which to read the data is another parameter and some of the CFs have UTF8, UUID, TimeUUID or Lon

Re: LongType from user input

2010-09-24 Thread Tyler Hobbs
I'm not sure I understand why using this with multiple column families prevents you from converting it. Could you clarify this? On Fri, Sep 24, 2010 at 10:56 AM, Christian Decker < decker.christ...@gmail.com> wrote: > Hi all, > > I'm having quite a dilemma with the CompareWith attribute. The Pro

LongType from user input

2010-09-24 Thread Christian Decker
Hi all, I'm having quite a dilemma with the CompareWith attribute. The Problem is that I have numeric IDs that I'd like to use as row keys, only that I also have to offer a possibility to let users input them from std input. Since I cannot ask my users to input an 8byte sequence representing the I

Re: Cassandra for graph data structure

2010-09-24 Thread Nate McCall
> My idea however was to fork hector, remove all the stuff i don't need and > turn it into a graph API sitting on top of Cassandra. We are always looking for ideas and design feedback regarding Hector. Please feel free to make suggestions or fork and send pull requests. http://groups.google.com/gr

Re: Cassandra for graph data structure

2010-09-24 Thread Lucas Nodine
Just a tip for evaluation. Reads using Cassandra are expensive. Each link in the graph would probably require a read transaction. I have never used a graph db, but I would expect their API will be much more efficient for your needs. Just something to consider before deciding. Good luck! - Luc

Cassandra for graph data structure

2010-09-24 Thread Courtney Robinson
?Apoligies for the first e-mail with the misleading subject i was reading a thread and mistakenly replied I've been using Cassandra for a while now and no problems. I have a new project coming up now that we're penciling out the data structure for. The best we've come up with has turned into a

ColumnFamily structure documentation

2010-09-24 Thread Andrey V. Panov
Hi all. I want share one idea about how to documet Cassandra ColumnFamily structure. I found software called "XMind" (it's free) and it allow easy draw schema like this: http://s57.radikal.ru/i158/1009/2a/a94e13a98e1e.jpg I suppose it's important to have big picture about your data structure. Hop

Re: Moving from 0.7.0-beta1 to nightly build

2010-09-24 Thread AeC
For the record, I solved this by bouncing the cluster down to 0.6.5 and then following the upgrade procedure to the nightly build. I couldn't find any way of going from 0.7.0.beta1->nightly. I'm wondering if there is a potential problem looming for beta1->beta2 upgrades ? Andy > On 22/09/20