Re: other questions about // RE: batch_mutate

2013-04-11 Thread aaron morton
t; > De : aaron morton [mailto:aa...@thelastpickle.com] > Envoyé : vendredi 6 juillet 2012 01:21 > À : user@cassandra.apache.org > Objet : Re: batch_mutate > > Does it mean that the popular use case is when we need to update multiple > column families using the same key? > Yes

RE: other questions about // RE: batch_mutate

2013-04-09 Thread DE VITO Dominique
) ? Thanks, Dominique De : aaron morton [mailto:aa...@thelastpickle.com] Envoyé : vendredi 6 juillet 2012 01:21 À : user@cassandra.apache.org Objet : Re: batch_mutate Does it mean that the popular use case is when we need to update multiple column families using the same key? Yes. Shouldn'

Re: other questions about // RE: batch_mutate

2013-03-26 Thread aaron morton
> Dominique > > > De : aaron morton [mailto:aa...@thelastpickle.com] > Envoyé : vendredi 6 juillet 2012 01:21 > À : user@cassandra.apache.org > Objet : Re: batch_mutate > > Does it mean that the popular use case is when we need to update multiple > column fam

other questions about // RE: batch_mutate

2013-03-25 Thread DE VITO Dominique
nks, Dominique De : aaron morton [mailto:aa...@thelastpickle.com] Envoyé : vendredi 6 juillet 2012 01:21 À : user@cassandra.apache.org Objet : Re: batch_mutate Does it mean that the popular use case is when we need to update multiple column families using the same key? Yes. Shouldn't we design our

Re: batch_mutate and erlang

2012-09-23 Thread Tyler Hobbs
It's a pretty solid standard at this point. The large majority of client library work from this point on will be based on cql. On Sun, Sep 23, 2012 at 12:45 AM, Bradford Toney wrote: > Yeah i've seen how it's done in CQL3 is just wasn't sure if it was a solid > standard yet. I will probably go t

Re: batch_mutate and erlang

2012-09-22 Thread Bradford Toney
Yeah i've seen how it's done in CQL3 is just wasn't sure if it was a solid standard yet. I will probably go the CQL route as right now i am doing each insert individually. On Sat, Sep 22, 2012 at 11:34 AM, Tyler Hobbs wrote: > If there's not already a well-written client in place, you should str

Re: batch_mutate and erlang

2012-09-22 Thread Tyler Hobbs
If there's not already a well-written client in place, you should strongly consider using cql3 instead. It will save you a ton of work. If you want to ignore that advice, you can look at the send() and insert() methods in phpcassa: https://github.com/thobbs/phpcassa/blob/master/lib/phpcassa/Batch

Re: batch_mutate

2012-07-05 Thread aaron morton
> Does it mean that the popular use case is when we need to update multiple > column families using the same key? Yes. > Shouldn’t we design our space in such a way that those columns live in the > same column family? Design a model where the data for common queries is stored in one row+cf. Yo

RE: batch_mutate

2012-07-05 Thread Leonid Ilyevsky
I actually found an answer to my first question at http://wiki.apache.org/cassandra/API. So I got it wrong: actually the outer key is the key in the table, and the inner key is the table name (this was somewhat counter-intuitive). Does it mean that the popular use case is when we need to update

Re: RE: batch_mutate failed: out of sequence response

2011-04-18 Thread Dan Washusen
Sure is: scale7-pelops-1.1-0.7.x-20110418.225848-3.jar Cheers, -- Dan Washusen On Tuesday, 19 April 2011 at 3:58 PM, Héctor Izquierdo Seliva wrote: > Thanks Dan for fixing that! Is the change integrated in the latest maven > snapshot? > > El mar, 19-04-2011 a las 10:48 +1000, Dan Washusen escri

Re: RE: batch_mutate failed: out of sequence response

2011-04-18 Thread Héctor Izquierdo Seliva
Thanks Dan for fixing that! Is the change integrated in the latest maven snapshot? El mar, 19-04-2011 a las 10:48 +1000, Dan Washusen escribió: > An example scenario (that is now fixed in Pelops): > 1. Attempt to write a column with a null value > 2. Cassandra throws a TProtocolException

Re: RE: batch_mutate failed: out of sequence response

2011-04-18 Thread Dan Washusen
An example scenario (that is now fixed in Pelops): Attempt to write a column with a null value Cassandra throws a TProtocolException which renders the connection useless for future operations Pelops returns the corrupt connection to the pool A second read operation is attempted with the corrupt co

Re: RE: batch_mutate failed: out of sequence response

2011-04-18 Thread Jonathan Ellis
Any idea what's causing the original TPE? On Mon, Apr 18, 2011 at 6:22 PM, Dan Washusen wrote: > It turns out that once a TProtocolException is thrown from Cassandra the > connection is useless for future operations. Pelops was closing connections > when it detected TimedOutException, TTransportE

Re: RE: batch_mutate failed: out of sequence response

2011-04-18 Thread Dan Washusen
It turns out that once a TProtocolException is thrown from Cassandra the connection is useless for future operations. Pelops was closing connections when it detected TimedOutException, TTransportException and UnavailableException but not TProtocolException. We have now changed Pelops to close c

Re: RE: batch_mutate failed: out of sequence response

2011-04-14 Thread Dan Washusen
I've looked over the Pelops code again and I really can't see how it could be at fault here... -- Dan Washusen On Wednesday, 13 April 2011 at 3:20 AM, Stephen McKamey wrote: > [I wrote this Apr 10, 2011 at 12:09 but my message seems to have gotten lost > along the way.] > > I use Pelops (the

RE: batch_mutate failed: out of sequence response

2011-04-12 Thread Stephen McKamey
[I wrote this Apr 10, 2011 at 12:09 but my message seems to have gotten lost along the way.] I use Pelops (the 1.0-0.7.x build from the Github Maven repo) and have occasionally seen this message (under load or during GC). I have a test app running in two separate single-threaded processes doing a

Re: RE: batch_mutate failed: out of sequence response

2011-04-07 Thread Dan Washusen
Pelops uses a single connection per operation from a pool that is backed by Apache Commons Pool (assuming you're using Cassandra 0.7). I'm not saying it's perfect but it's NOT sharing a connection over multiple threads. Dan Hendry mentioned that he sees these errors. Is he also using Pelops? Fro

Re: RE: batch_mutate failed: out of sequence response

2011-04-07 Thread Héctor Izquierdo Seliva
El mié, 06-04-2011 a las 21:04 -0500, Jonathan Ellis escribió: > "out of sequence response" is thrift's way of saying "I got a response > for request Y when I expected request X." > > my money is on using a single connection from multiple threads. don't do > that. > I'm not using thrift direct

Re: RE: batch_mutate failed: out of sequence response

2011-04-07 Thread Héctor Izquierdo Seliva
El mié, 06-04-2011 a las 21:04 -0500, Jonathan Ellis escribió: > "out of sequence response" is thrift's way of saying "I got a response > for request Y when I expected request X." > > my money is on using a single connection from multiple threads. don't do > that. I'm not using thrift direc

Re: RE: batch_mutate failed: out of sequence response

2011-04-06 Thread Jonathan Ellis
"out of sequence response" is thrift's way of saying "I got a response for request Y when I expected request X." my money is on using a single connection from multiple threads. don't do that. On Wed, Apr 6, 2011 at 5:59 PM, Dan Washusen wrote: > Pelops will retry when TimedOutException, TTransp

Re: RE: batch_mutate failed: out of sequence response

2011-04-06 Thread Dan Washusen
Pelops will retry when TimedOutException, TTransportException or UnavailableException exceptions are thrown but not TApplicationException. TApplicationException has a type property which looks like it could be used to retry based on specific values. Based on the names the INTERNAL_ERROR and BAD

Re: RE: batch_mutate failed: out of sequence response

2011-04-06 Thread Héctor Izquierdo Seliva
El mié, 06-04-2011 a las 09:06 +1000, Dan Washusen escribió: > Pelops raises a RuntimeException? Can you provide more info please? > org.scale7.cassandra.pelops.exceptions.ApplicationException: batch_mutate failed: out of sequence response > -- > Dan Washusen > Make big files fly > visit digit

Re: RE: batch_mutate failed: out of sequence response

2011-04-05 Thread Dan Washusen
Pelops raises a RuntimeException? Can you provide more info please? -- Dan Washusen Make big files fly visit digitalpigeon.com On Tuesday, 5 April 2011 at 11:43 PM, Héctor Izquierdo Seliva wrote: El mar, 05-04-2011 a las 09:35 -0400, Dan Hendry escribió: > > I too have seen the out of sequence r

Re: batch_mutate failed: out of sequence response

2011-04-05 Thread Jonathan Ellis
Step 1: disable swap. 2011/4/5 Héctor Izquierdo Seliva : > Update with more info: > > I'm still running into problems. Now I don't write more than 100 columns > at a time, and I'm having lots of Stop-the-world gc pauses. > > I'm writing into three column families, with memtable_operations = 0.3 >

RE: batch_mutate failed: out of sequence response

2011-04-05 Thread Héctor Izquierdo Seliva
Update with more info: I'm still running into problems. Now I don't write more than 100 columns at a time, and I'm having lots of Stop-the-world gc pauses. I'm writing into three column families, with memtable_operations = 0.3 and memtable_throughput = 64. There is now swapping, and full GCs are

RE: batch_mutate failed: out of sequence response

2011-04-05 Thread Héctor Izquierdo Seliva
I'm still running into problems. Now I don't write more than 100 columns at a time, and I'm having lots of Stop-the-world gc pauses. I'm writing into three column families, with memtable_operations = 0.3 and memtable_throughput = 64. Is any of this wrong? > > -Original Message- > > From

RE: batch_mutate failed: out of sequence response

2011-04-05 Thread Héctor Izquierdo Seliva
El mar, 05-04-2011 a las 09:35 -0400, Dan Hendry escribió: > I too have seen the out of sequence response problem. My solution has just > been to retry and it seems to work. None of my mutations are THAT large (< > 200 columns). > > The only related information I could find points to a thrift/u

RE: batch_mutate failed: out of sequence response

2011-04-05 Thread Dan Hendry
I too have seen the out of sequence response problem. My solution has just been to retry and it seems to work. None of my mutations are THAT large (< 200 columns). The only related information I could find points to a thrift/ubuntu bug of some kind (http://markmail.org/message/xc3tskhhvsf5awz7

Re: batch_mutate vs number of write operations on CF

2010-11-29 Thread Tyler Hobbs
Using batch_mutate on a single row will count as 1 write operation, even if you mutate multiple columns. Using batch_mutate on N rows will count as N write operations. - Tyler On Mon, Nov 29, 2010 at 5:58 PM, Narendra Sharma wrote: > Hi, > > I am using Cassandra 0.7 beta3 and Hector. > > I create

Re: batch_mutate in 0.7

2010-10-25 Thread Chris Oei
Thanks Gary and Jonathan. Yeah, I'm planning on switching to Hector sometime soon; I started with Thrift mostly because I wanted to see what was going on underneath the hood before using a higher-level interface. I suppose now is as good a time to switch as any. Thanks, Chris On Mon, Oct 25, 2010

Re: batch_mutate in 0.7

2010-10-25 Thread Jonathan Ellis
You want the set_keyspace method. What language are you using? We don't recommend using raw Thrift unless there's no other option. On Mon, Oct 25, 2010 at 12:59 PM, Chris Oei wrote: > So, I'm a bit puzzled about how to change my old 0.6 code to 0.7. > In 0.6, I used: >   client.batch_mutate(key

Re: batch_mutate in 0.7

2010-10-25 Thread Gary Dusbabek
client.set_keyspace() On Mon, Oct 25, 2010 at 12:59, Chris Oei wrote: > So, I'm a bit puzzled about how to change my old 0.6 code to 0.7. > In 0.6, I used: >   client.batch_mutate(keySpace, mutationMap, ConsistencyLevel.ONE); > But in 0.7, batch_mutate no longer has a keyspace argument, so I used

Re: batch_mutate silently failing in Cassandra

2010-09-07 Thread Jonathan Ellis
QUORUM of ReplicationFactor=1 is 1. All consistency levels should work fine as long as RF <= node count. If you are seeing it work at CL.ONE but not at QUORUM then that is probably a bug. On Tue, Sep 7, 2010 at 7:36 PM, Lucas Nodine wrote: > Partially Resolved... > > Taking your advise (both Jo

Re: batch_mutate silently failing in Cassandra

2010-09-07 Thread Lucas Nodine
Partially Resolved... Taking your advise (both Jonathan and Aaron's) I was able to track the problem down. The issue was that running insert (also batch_mutate) and using a consistencylevel of quorum on a cluster of 1 server with a replication factor of 1 does not work. Well, that is not accurat

Re: batch_mutate silently failing in Cassandra

2010-09-07 Thread Lucas Nodine
Jonathan, I have done it successfully with insert, but I have not tried it with mutate. I'll give that a try tonight. Thanks On Tue, Sep 7, 2010 at 2:54 PM, Jonathan Ellis wrote: > I would try to get a single hard-coded column to insert, before doing > something more complex. > > You can also

Re: batch_mutate silently failing in Cassandra

2010-09-07 Thread Aaron Morton
Turn up the logging to DEBUG level (in config/log4-server.properties) and check that you are sending what you think you are. AaronOn 08 Sep, 2010,at 02:11 AM, Lucas Nodine wrote:Hello all, I have posted the following to Stackoverflow, but thought that I would also try the list.  If you have any s

Re: batch_mutate silently failing in Cassandra

2010-09-07 Thread Jonathan Ellis
I would try to get a single hard-coded column to insert, before doing something more complex. You can also enable debug logging on the server and see if that matches what you want the client to be doing. On Tue, Sep 7, 2010 at 9:11 AM, Lucas Nodine wrote: > Hello all, > > I have posted the follo

Re: batch_mutate atomicity

2010-08-09 Thread Peter Schuller
> I am using the familiar meanings from ACID: > > atomic means either the entire update will succeed or none of it. > > isolated means other threads will not see partial updates while it is > being applied. A related concern is whether there is a write *ordering* guarantee for mutations within a r

Re: batch_mutate atomicity

2010-08-07 Thread Benjamin Black
The first. On Sat, Aug 7, 2010 at 10:04 AM, james anderson wrote: > good afternoon; > > On 2010-08-07, at 15:26 , Jonathan Ellis wrote: > >> I am using the familiar meanings from ACID: >> >> atomic means either the entire update will succeed or none of it. >> >> isolated means other threads will

Re: batch_mutate atomicity

2010-08-07 Thread james anderson
good afternoon; On 2010-08-07, at 15:26 , Jonathan Ellis wrote: I am using the familiar meanings from ACID: atomic means either the entire update will succeed or none of it. isolated means other threads will not see partial updates while it is being applied. yes, those terms are not new. i

Re: batch_mutate atomicity

2010-08-07 Thread Jonathan Ellis
I am using the familiar meanings from ACID: atomic means either the entire update will succeed or none of it. isolated means other threads will not see partial updates while it is being applied. On Sat, Aug 7, 2010 at 12:50 AM, james anderson wrote: > good morning; > > On 2010-08-07, at 02:45 ,

Re: batch_mutate atomicity

2010-08-06 Thread james anderson
good morning; On 2010-08-07, at 02:45 , Jonathan Ellis wrote: Everything in the same key of a batch_mutate is atomic. (But not isolated.) what does the distinction mean in the context of cassandra? is it that the execution of an operation with the same key could see the effect of the 'f

Re: batch_mutate atomicity

2010-08-06 Thread Jonathan Ellis
Everything in the same key of a batch_mutate is atomic. (But not isolated.) On Fri, Aug 6, 2010 at 2:15 PM, B. Todd Burruss wrote: > ok i just saw the FAQ > (http://wiki.apache.org/cassandra/FAQ#batch_mutate_atomic) > > follow up question ... > > it states that "As a special case, mutations agai

Re: batch_mutate atomicity

2010-08-06 Thread B. Todd Burruss
ok i just saw the FAQ (http://wiki.apache.org/cassandra/FAQ#batch_mutate_atomic) follow up question ... it states that "As a special case, mutations against a single key are atomic, but more generally no" ... i interpret that to also mean " .. mutations against a single key in the same CF ... "

Re: batch_mutate atomic?

2010-06-14 Thread Gary Dusbabek
This question has been coming up quite regularly now. I've added an entry to the FAQ. Please feel free to expand an clarify. http://wiki.apache.org/cassandra/FAQ#batch_mutate_atomic Gary. On Mon, Jun 14, 2010 at 06:43, Ran Tavory wrote: > no, it's not atomic. it just shortens the roundtrip of

Re: batch_mutate atomic?

2010-06-14 Thread Ran Tavory
no, it's not atomic. it just shortens the roundtrip of many update requests. Some may fail and some may succeed On Mon, Jun 14, 2010 at 2:40 PM, Per Olesen wrote: > Can I expect batch_mutate to work in what I would think of as an atomic > operation? > > That either all the mutations in the batch

Re: Batch_Mutate throws Uncaught exception

2010-05-28 Thread Moses Dinakaran
Hi sorry for the post I was wrong in understanding key and column family I was in the thinking cache_pages is the column family and Page is the key but its the other way right I will update my code and check it again. Thanks, Moses On Thu, May 27, 2010 at 3:46 PM, Mishail wrote: > Hi, > > Jus

Re: Batch_Mutate throws Uncaught exception

2010-05-27 Thread Jonathan Ellis
you need to pull out the exception "why" field, which explains what was invalid about the request On Thu, May 27, 2010 at 2:45 AM, Moses Dinakaran wrote: > Hi, > > > > I am trying to use batch_mutate() with PHP Thrift. I was getting the > following error. > > > > > > Fatal error:  Uncaught except

Re: Batch_Mutate throws Uncaught exception

2010-05-27 Thread Mishail
Hi, Just to clarify. Are you trying to insert a couple of columns with key "cache_pages" in the ColumnFamily "Page"? Moses Dinakaran wrote: i, > > > > I am trying to use batch_mutate() with PHP Thrift. I was getting the > following error. >

Re: batch_mutate - PHP

2010-04-27 Thread Jordan Pittier
Hi, Here is a working example : $mutation_map = array("$key"=>array("Standard1" => array())); for($column_name=0; $column_name<$options['numcolumns']; $column_name++) { $column = new cassandra_Column(array('name' => "$column_name", 'value' => 'put your data here', 'timestamp' =>

Re: batch_mutate silently failing

2010-04-15 Thread Jonathan Ellis
Ah, I see. Glad you resolved that. :) On Thu, Apr 15, 2010 at 12:31 PM, Lee Parker wrote: > The entire thing was completely my own fault. I was making an invalid > request and, somewhere in the code, I was catching the exception and not > handling it at all. So it only appeared to be silent w

Re: batch_mutate silently failing

2010-04-15 Thread Lee Parker
The entire thing was completely my own fault. I was making an invalid request and, somewhere in the code, I was catching the exception and not handling it at all. So it only appeared to be silent when in reality it was throwing a nice descriptive exception. Lee Parker l...@spredfast.com [image:

Re: batch_mutate silently failing

2010-04-15 Thread Jonathan Ellis
Could you create a ticket for us to return an error message in this situation? -Jonathan On Tue, Apr 13, 2010 at 4:24 PM, Lee Parker wrote: > nevermind. I figured out what the problem was. I was not putting the > column inside a ColumnOrSuperColumn container. > > > Lee Parker > l...@spredfast

Re: batch_mutate silently failing

2010-04-13 Thread Lee Parker
nevermind. I figured out what the problem was. I was not putting the column inside a ColumnOrSuperColumn container. Lee Parker l...@spredfast.com [image: Spredfast] On Tue, Apr 13, 2010 at 4:19 PM, Lee Parker wrote: > I upgraded my dev environment to 0.6.0 today in expectation of upgrading >