Re: How to implement (generic) ACID on application level

Never mind - I didn't want to send the last paragraph. I'm sorry. 2010/9/7 Jonathan Shook > ... some kind of what? > > On Mon, Sep 6, 2010 at 3:38 AM, Michal Augustýn > wrote: > > Thank you for the great link! > > The mentioned solution is using locking but I would prefer some > optimistic > >

timeout when insert an indexed column

Hi all, I don't know if anyone had post this question , if it is ,plz let me know the post. Here is the problem i met: First , i create the keyspace that contains a columnfamily ,and the columfamily contains a indexed column . The code is : ColumnDef clDef = new ColumnDef("name

RE: timeout when insert an indexed column

I didn't get which keyspace and column family you trying to insert to? > parent.setColumn_family("Standard1"); -Original Message- From: Ying Tang [mailto:ivytang0...@gmail.com] Sent: Tuesday, September 07, 2010 11:10 AM To: user@cassandra.apache.org Subject: timeout when insert an indexe

Re: timeout when insert an indexed column

Before inserting, the Cassandra.client is assined the keyspace . ColumnParent parent = new ColumnParent(); parent.setColumn_family("Standard1"); On Tue, Sep 7, 2010 at 4:19 PM, Viktor Jevdokimov < viktor.jevdoki...@adform.com> wrote: > I didn't get which keyspace and column family yo

Re: timeout when insert an indexed column

oh ,i've found this https://issues.apache.org/jira/browse/CASSANDRA-1402 On 9/7/10, Ying Tang wrote: > Before inserting, the Cassandra.client is assined the keyspace . > ColumnParent parent = new ColumnParent(); >parent.setColumn_family("Standard1"); > > > On Tue, Sep 7, 2010 at

Re: timeout when insert an indexed column

Hi Ivy, Are you sure about this. One is TimedOutException, and another is ArrayIndexOutOfBoundsException. I can't see any connection. Please point out, thank you. Calin4J 2010/9/7 Ying Tang > oh ,i've found this https://issues.apache.org/jira/browse/CASSANDRA-1402 > > > > On 9/7/10, Ying

Re: timeout when insert an indexed column

Sorry , i didn't put it clearly. The app throws out the TimeoutException , but the cassandra throws out the ArrayIndexOutOfBoundsException. And if i shortened this key's length,such as one letter , the indexed column insert is successful. But if i let the key be 'index0' ,this insert operation

Re: Flush and compaction happens frequently

That sounds a little odd, may help if you post the yaml settings, the tpstats and the log lines that look something like this... INFO [ROW-MUTATION-STAGE:5] 2010-09-04 15:43:49,402 ColumnFamilyStore.java (line 790) Enqueuing flush of memtable-sup...@1754565178(80208 bytes, 2304 operations) Als

batch_mutate silently failing in Cassandra

Hello all, I have posted the following to Stackoverflow, but thought that I would also try the list. If you have any suggestions, please let me know I am working with Cassandra 0.6.5 using the thrift interface. I am trying to use the batch_mutate method call, however, when I execute it, I receiv

Re: timeout when insert an indexed column

On Sep 7, 2010, at 11:05 AM, Ying Tang wrote: Sorry , i didn't put it clearly. The app throws out the TimeoutException , but the cassandra throws out the ArrayIndexOutOfBoundsException. And if i shortened this key's length,such as one letter , the indexed column insert is successful. But if

connect to cassandra using java

Hi I need to use the low level java API in order to test bulk ingestion to cassandra. I have already looked at the code in contrib/ bmt_example and contrib/client_only. When I try and run the following code, I get following exception ; using cassandra-cli I am able to see the "Keyspace1

Re: Migration from 6.X to 7.X

On Mon, Sep 6, 2010 at 8:39 PM, Jonathan Ellis wrote: > On Mon, Sep 6, 2010 at 4:04 PM, Edward Capriolo wrote: >> I was not aware of that. Also is the default for 6.o non framed and >> 7.o framed? > > Yes. > >>I was thinking possibly replace cassanda.client detect the >> server version and use re

Re: 4k keyspaces... Maybe we're doing it wrong?

This might be a loaded question... what is a 'lot of CFs'? 50? 250? 500? I say loaded because I know that its probably dependent on how many keys (size) are in a column family. On Mon, Sep 6, 2010 at 7:53 PM, Benjamin Black wrote: > On Mon, Sep 6, 2010 at 12:41 AM, Janne Jalkanen > wrote: > >

Droping ColumnFamily in 0.6.x

How can one trucate or drop a column family in 0.6.x? Thanks

Re: Droping ColumnFamily in 0.6.x

flush, stop server, remove the data files, start server On Tue, Sep 7, 2010 at 11:39 AM, Mark wrote: >  How can one trucate or drop a column family in 0.6.x? > > Thanks > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of Riptano, the source for professional Cassandra support htt

Re: Droping ColumnFamily in 0.6.x

On 9/7/10 10:09 AM, Jonathan Ellis wrote: flush, stop server, remove the data files, start server As I understand it, there a race here where a new Memtable can be created before the server is stopped, unless you flush with "nodetool drain". This is relevant in some versions of 0.6.x (below 0

Capping the memory limit in cassandra

For this java process /opt/java/bin/java -ea -Xms1G -*Xmx7G *-XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8 -XX:MaxTenuringThreshold=1 -XX:+HeapDumpOnOutOfMemoryError -Dcom.sun.management.jmxremote.port=8181 -Dcom.sun.management.jmxremote.ssl=false -Dcom

Re: Capping the memory limit in cassandra

Hi When is this happening I mean is Cassandra idle or application is inserting/reading values from it .are you running any map/reduce job at that time. Regards Vineet Daniel Cell : +918106217121 Websites : Blog | Linkedin

Re: Capping the memory limit in cassandra

Are you using mmapped i/o? If so you'll be running into https://issues.apache.org/jira/browse/CASSANDRA-1214 On Tue, Sep 7, 2010 at 6:38 PM, Dathan Pattishall wrote: > For this java process > > /opt/java/bin/java -ea -Xms1G -Xmx7G -XX:+UseParNewGC > -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkE

Re: Droping ColumnFamily in 0.6.x

I am using 0.6.5 so I guess its easy as draining and removing the data files. Thanks On 9/7/10 10:28 AM, Rob Coli wrote: On 9/7/10 10:09 AM, Jonathan Ellis wrote: flush, stop server, remove the data files, start server As I understand it, there a race here where a new Memtable can be creat

Re: Capping the memory limit in cassandra

see http://www.mail-archive.com/user@cassandra.apache.org/msg03583.html On Tue, Sep 7, 2010 at 12:38 PM, Dathan Pattishall wrote: > For this java process > > /opt/java/bin/java -ea -Xms1G -Xmx7G -XX:+UseParNewGC > -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8 > -XX:Max

Re: Droping ColumnFamily in 0.6.x

I thought it went without saying that if you plan to drop a CF, you should stop using it before you drop it. On Tue, Sep 7, 2010 at 12:28 PM, Rob Coli wrote: > On 9/7/10 10:09 AM, Jonathan Ellis wrote: >> >> flush, stop server, remove the data files, start server > > As I understand it, there a r

Re: 4k keyspaces... Maybe we're doing it wrong?

And now that everyone thinks I'm a complete dolt ;-), I realize should've been more clear and asked whether there's an intrinsic overhead in Keyspace itself that causes problems, or is it just the plain amount of CFs which is bad :-) But I'm gathering that the Keyspace overhead is negligl

Re: connect to cassandra using java

On Wed, Sep 8, 2010 at 3:20 AM, Asif Jan wrote: > > > Hi > I need to use the low level java API in order to test bulk ingestion to > cassandra. I have already looked at the code in contrib/bmt_example and > contrib/client_only. > When I try and run the following code, I get following exception ; u

Re: Capping the memory limit in cassandra

Ah thanks Johnathan. I am using mmap, which is outside the control of the JVM from the looks of it. On Tue, Sep 7, 2010 at 11:15 AM, Jonathan Ellis wrote: > see http://www.mail-archive.com/user@cassandra.apache.org/msg03583.html > > On Tue, Sep 7, 2010 at 12:38 PM, Dathan Pattishall > wrote: >

Re: batch_mutate silently failing in Cassandra

I would try to get a single hard-coded column to insert, before doing something more complex. You can also enable debug logging on the server and see if that matches what you want the client to be doing. On Tue, Sep 7, 2010 at 9:11 AM, Lucas Nodine wrote: > Hello all, > > I have posted the follo

Re: batch_mutate silently failing in Cassandra

Turn up the logging to DEBUG level (in config/log4-server.properties) and check that you are sending what you think you are. AaronOn 08 Sep, 2010,at 02:11 AM, Lucas Nodine wrote:Hello all, I have posted the following to Stackoverflow, but thought that I would also try the list.  If you have any s

Re: batch_mutate silently failing in Cassandra

Jonathan, I have done it successfully with insert, but I have not tried it with mutate. I'll give that a try tonight. Thanks On Tue, Sep 7, 2010 at 2:54 PM, Jonathan Ellis wrote: > I would try to get a single hard-coded column to insert, before doing > something more complex. > > You can also

drop/recreate column family race condition

using 0.7 latest from trunk as of few minutes ago. 1 client, 1 node i have the scenario where i want to drop a column family and recreate it - unit testing for instance, is a good reason you may want to do this (always start fresh). the problem i observe is that if i do the following: 1 - d

Re: drop/recreate column family race condition

On Tue, Sep 7, 2010 at 3:55 PM, B. Todd Burruss wrote: > using 0.7 latest from trunk as of few minutes ago.  1 client, 1 node > > i have the scenario where i want to drop a column family and recreate it - > unit testing for instance, is a good reason you may want to do this (always > start fresh).

Re: drop/recreate column family race condition

On Tue, Sep 7, 2010 at 5:10 PM, Jonathan Ellis wrote: > On Tue, Sep 7, 2010 at 3:55 PM, B. Todd Burruss wrote: >> using 0.7 latest from trunk as of few minutes ago.  1 client, 1 node >> >> i have the scenario where i want to drop a column family and recreate it - >> unit testing for instance, is

Re: drop/recreate column family race condition

https://issues.apache.org/jira/browse/CASSANDRA-1477 comments below On 09/07/2010 02:10 PM, Jonathan Ellis wrote: On Tue, Sep 7, 2010 at 3:55 PM, B. Todd Burruss wrote: using 0.7 latest from trunk as of few minutes ago. 1 client, 1 node i have the scenario where i want to drop a column f

Re: drop/recreate column family race condition

5 secs isn't enough for me, 10 is good. i haven't tried any other values as i can get around this through another manner. On 09/07/2010 02:24 PM, Edward Capriolo wrote: On Tue, Sep 7, 2010 at 5:10 PM, Jonathan Ellis wrote: On Tue, Sep 7, 2010 at 3:55 PM, B. Todd Burruss wrote: us

Re: drop/recreate column family race condition

On Tue, Sep 7, 2010 at 4:29 PM, B. Todd Burruss wrote: > if you are referring to R, W, N - i am aware, but i have a one node cluster, > with R=W=N = 1.  single threaded test app.  any column manipulations would > be immediate because R+W>N, so i assume the same for column family > manipulations.  

Re: drop/recreate column family race condition

interesting is that "truncate" API doesn't return a schema version nor take a consistency level. does this mean that when it returns the cluster is always consistent? On 09/07/2010 02:50 PM, Jonathan Ellis wrote: On Tue, Sep 7, 2010 at 4:29 PM, B. Todd Burruss wrote: if you are referrin

Few questions regarding cassandra deployment on windows

Hi All, We are currently considering Cassandra for our application. Platform: * a single-node cluster. * windows '08 * 64-bit jvm For the sake of brevity let, Cassandra service = a single node cassandra server running as an embedded service inside a JVM My use cases: 1) Start with a sc

Re: drop/recreate column family race condition

truncate doesn't change schema, it just drops the data associated with it. so it's a different beast from either normal writes or schema change. truncate will wait for each node to response, and send a TimedOutException if any do not. On Tue, Sep 7, 2010 at 5:42 PM, B. Todd Burruss wrote: > int

Re: Few questions regarding cassandra deployment on windows

This does not sound like a good application for Cassandra at all. Why are you using it? On Tue, Sep 7, 2010 at 3:42 PM, kannan chandrasekaran wrote: > Hi All, > > We are currently considering Cassandra for our application. > > Platform: > * a single-node cluster. > * windows '08 > * 64-bit jvm >

Re: 4k keyspaces... Maybe we're doing it wrong?

Really depends on your memtable settings and your memory. Larger memtables are generally better, so having lots of active ones works against making them as large as you might want. For example, if the flush MB threshold is 256 (which is the low end of what I recommend), even 50 of them could cons

Re: Few questions regarding cassandra deployment on windows

Can you please elaborate on why you think Cassandra would not be suitable for this ? Main reasons why we think cassandra because, 1) We are on focusing on moving to a distributed architecture very soon and using cassandra as a backend naturally lends to this. 2) Our schema is relatively simple

Re: Few questions regarding cassandra deployment on windows

I haven't looked at your previos e-mail( s) or the responses to them but have a look at http://prettyprint.me/2010/02/14/running-cassandra-as-an-embedded-service/ the post was written by one of the guys who maintains the hector cassandra client. In any case the simple and short answer is yes, h

Re: batch_mutate silently failing in Cassandra

Partially Resolved... Taking your advise (both Jonathan and Aaron's) I was able to track the problem down. The issue was that running insert (also batch_mutate) and using a consistencylevel of quorum on a cluster of 1 server with a replication factor of 1 does not work. Well, that is not accurat

Cassandra 0.7 logging

Hi, I are testing 0.7 and I cannot find the system.log file, is there any thing I need to do in order to enable the logging? I read about the changes made to the logging in 0.7 but did not find any thing that needs to be done to enable the logging.. Regards, Alaa

Re: Cassandra 0.7 logging

logging is configured in the conf/log4-server.properties file. The default location is /var/log/cassandra/system.logIt's enabled at the INFO level by default, and also logs to the file and stdout by default.AaronOn 08 Sep, 2010,at 12:44 PM, Alaa Zubaidi wrote: Hi, I are testing 0.7 and I cannot f

Re: Cassandra 0.7 logging

Thanks Aaron, For some reason /var/log/cassandra/system.log does not have the 0.7 info, it has the Old 0.6.5 info. I modified the log4-server.properties and changed the default location and still did not get anything? I running on Windows by the way, and Cassandra created /var/log/cassandra

Re: Cassandra 0.7 logging

Ah, running on windows. Have you included the drive spec in the logging configuration, i.e. is you logging configured to use E:\var\log\cassandra\Cass07\system.logWhen you say cassandra created  /var/log/cassandra/system.log i'ts a bit confusing, what drive are you talking about ?AaronOn 08 Sep, 20

Re: batch_mutate silently failing in Cassandra

QUORUM of ReplicationFactor=1 is 1. All consistency levels should work fine as long as RF <= node count. If you are seeing it work at CL.ONE but not at QUORUM then that is probably a bug. On Tue, Sep 7, 2010 at 7:36 PM, Lucas Nodine wrote: > Partially Resolved... > > Taking your advise (both Jo

Re: Cassandra 0.7 logging

I modified the log4-server.properties: /# Edit the next line to point to your logs directory log4j.appender.R.File=E:\var\log\cassandra\Cass07\system.log / Cassandra is installed on E: The var\log\cassandra is created on the same place where Cassandra is installed which is (in my case) "E" Ho

Re: Cassandra 0.7 logging

AFAIK nothing has changed in the logging other than the name of the config file. All the logging is done through log4j. Do not know about the windows install, but using the normal (non package install) on linux the /var/log/cassandra path was not automatically created. It's going to be a config pro

Re: Cassandra 0.7 logging

I did most of the things you said, I will check the rest and double check all. Thanks and Regards, Alaa On 9/7/2010 9:20 PM, Aaron Morton wrote: AFAIK nothing has changed in the logging other than the name of the config file. All the logging is done through log4j. Do not know about the windo

RE: Cassandra 0.7 logging

We found that on Windows only log4j.properties is working for logging, not log4-server.properties -Original Message- From: Alaa Zubaidi [mailto:alaa.zuba...@pdf.com] Sent: Wednesday, September 08, 2010 7:34 AM To: user@cassandra.apache.org Subject: Re: Cassandra 0.7 logging I did most