Cassandra keeps on logging "Finished hinted handoff of 0 rows to endpoint"

2012-02-24 Thread Manoj Mainali
Hi, I have been running Cassandra 1.0.7 and in the log file I see the log saying " Finished hinted handoff of 0 rows to endpoint /{ipaddress}" The above issue can be reproduced by the following steps, 1. Start a cluster with 2 node, suppose node1 and node2 2. Create a keyspace with rf=2, create

newer Cassandra + Hadoop = TimedOutException()

2012-02-24 Thread Patrik Modesto
Hi, I can see some strange behaviour on my test cluster and in production. Both running cassandra 0.8.10. Strange is that when I compile my mapreduce job against cassandra-all 0.8.7 everything is ok, but if I use higher version I get quite a lots of TimedOutException. java.lang.RuntimeException:

Re: newer Cassandra + Hadoop = TimedOutException()

2012-02-24 Thread Patrik Modesto
Some more info, running the cluster with debug enabled shows this error: DEBUG 14:23:05,749 Thrift transport error occurred during processing of message. org.apache.thrift.transport.TTransportException: java.net.SocketException: Broken pipe at org.apache.thrift.transport.TIOStreamTranspor

Re: Querying all keys in a column family

2012-02-24 Thread Alexandru Sicoe
Hi Aaron and Martin, Sorry about my previous reply, I thought you wanted to process only all the row keys in CF. I have a similar issue as Martin because I see myself being forced to hit more than a million rows with a query (I only get a few columns from every row). Aaron, we've talked about thi

Re: newer Cassandra + Hadoop = TimedOutException()

2012-02-24 Thread Patrik Modesto
There are two more similar exceptions: DEBUG 14:23:12,817 Thrift transport error occurred during processing of message. org.apache.thrift.transport.TTransportException at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132) at org.apache.thrift.transpor

unidirectional communication/replication

2012-02-24 Thread Alexandru Sicoe
Hello everyone, I'm battling with this contraint that I have: I need to regularly ship out timeseries data from a Cassandra cluster that sits within an enclosed network, outside of the network. I tried to select all the data within a certian time window, writing to a file, and then copying the fi

Re: newer Cassandra + Hadoop = TimedOutException()

2012-02-24 Thread Jeremy Hanna
Check out the troubleshooting section of the hadoop support - we ran into the same thing and tried to update that with some info on how to get around it: http://wiki.apache.org/cassandra/HadoopSupport#Troubleshooting On Feb 24, 2012, at 7:20 AM, Patrik Modesto wrote: > Hi, > > I can see some st

Re: newer Cassandra + Hadoop = TimedOutException()

2012-02-24 Thread Patrik Modesto
Hi Jeremy, I've seen the page and tried the values but to no help. Here goes tcpdump of one failed TCP connection: 15:06:20.231421 IP 10.0.18.87.9160 > 10.0.18.87.39396: Flags [P.], seq 137891735:137904068, ack 708, win 282, options [nop,nop,TS val 4119981636 ecr 4119981636], length 12333 15:06:

CQL, How to insert Bytes

2012-02-24 Thread Montgomery Burns
Hi everyone, what do I use in order to insert bytes instead of characters into a column, using CQL with the Thrift-client?

Re: Cassandra keeps on logging "Finished hinted handoff of 0 rows to endpoint"

2012-02-24 Thread Brandon Williams
It's a special case of a single sstable existing for hints: https://issues.apache.org/jira/browse/CASSANDRA-3955 On Fri, Feb 24, 2012 at 5:43 AM, Manoj Mainali wrote: > Hi, > > I have been running Cassandra 1.0.7 and in the log file I see the log saying > > " Finished hinted handoff of 0 rows to

Re: CQL, How to insert Bytes

2012-02-24 Thread Eric Evans
On Fri, Feb 24, 2012 at 9:28 AM, Montgomery Burns wrote: > what do I use in order to insert bytes instead of characters into a > column, using CQL with the Thrift-client? Assuming the type is 'blob' (bytes), use hex encoding. -- Eric Evans Acunu | http://www.acunu.com | @acunu

Re: CQL, How to insert Bytes

2012-02-24 Thread Montgomery Burns
That works - but only for static columns. How do I use this with dynamic columns? And how can I specify column-names that are bytes (rather than characters) themselves in CQL? 2012/2/24 Eric Evans : > On Fri, Feb 24, 2012 at 9:28 AM, Montgomery Burns > wrote: >> what do I use in order to insert

Re: data model advice

2012-02-24 Thread David Leimbach
On Thu, Feb 23, 2012 at 7:54 PM, Martin Arrowsmith < arrowsmith.mar...@gmail.com> wrote: > Hi Franc, > > Or, you can consider using composite columns. It is not recommended to use > Super Columns anymore. > Yes, but why? Is it because composite columns effectively replace and simplify similar mo

Re: CQL, How to insert Bytes

2012-02-24 Thread Eric Evans
On Fri, Feb 24, 2012 at 10:33 AM, Montgomery Burns wrote: > That works - but only for static columns. How do I use this with > dynamic columns? And how can I specify column-names that are bytes > (rather than characters) themselves in CQL? Using blob as the comparator (WITH comparator = blob) wil

Re: data model advice

2012-02-24 Thread Brandon Williams
On Fri, Feb 24, 2012 at 10:46 AM, David Leimbach wrote: > > > On Thu, Feb 23, 2012 at 7:54 PM, Martin Arrowsmith > wrote: >> >> Hi Franc, >> >> Or, you can consider using composite columns. It is not recommended to use >> Super Columns anymore. > > > Yes, but why?  Is it because composite columns

Re: newer Cassandra + Hadoop = TimedOutException()

2012-02-24 Thread Jeremy Hanna
By chance are you in EC2? On Feb 24, 2012, at 8:33 AM, Patrik Modesto wrote: > Hi Jeremy, > > I've seen the page and tried the values but to no help. > > Here goes tcpdump of one failed TCP connection: > > 15:06:20.231421 IP 10.0.18.87.9160 > 10.0.18.87.39396: Flags [P.], seq > 137891735:13790

Re: CQL, How to insert Bytes

2012-02-24 Thread Montgomery Burns
Thank you - that works perfectly! One final question, is this in the docs somewhere - or where should I look into in the future for questions like these? Google doesn't seem to be much help since it mostly refers to the docs by datastax, or other other posts in this mailing list. 2012/2/24 Eric E

Re: How to delete a range of columns using first N components of CompositeType Column?

2012-02-24 Thread Praveen Baratam
Thank you Aaron for the clarification. May be this could be a feature that Cassandra team should consider implementing. Instead of two network round trips the logic could be consolidated on the server side if read before range delete is unavoidable. On Fri, Feb 24, 2012 at 12:46 AM, aaron morton

Re: Minor compaction throws NPE

2012-02-24 Thread Dan Retzlaff
The stack looks like this one: https://issues.apache.org/jira/browse/CASSANDRA-2863 On Fri, Feb 24, 2012 at 9:12 AM, Jahangir Mohammed wrote: > Hi All, > > > Minor compaction throws NPE. Any ideas? Bug? > > > Cassandra version: 0.8.7 > > > Stack Trace: > > ERROR [Thread-220] 2012-02-24 16:35:34,4

Re: CQL, How to insert Bytes

2012-02-24 Thread Eric Evans
On Fri, Feb 24, 2012 at 11:08 AM, Montgomery Burns wrote: > Thank you - that works perfectly! > > One final question, is this in the docs somewhere - or where should I > look into in the future for questions like these? Google doesn't seem > to be much help since it mostly refers to the docs by da

Server crashed due to "OutOfMemoryError: Java heap space"

2012-02-24 Thread Feng Qu
Hello,  We have a 6-node ring running 0.8.6 on RHEL 6.1. The first node also runs OpsCenter community. This node has crashed few time recently with "OutOfMemoryError: Java heap space" while several compactions on few 200-300 GB SSTables were running. We are using 8GB Java heap on host with 96GB

Re: "Final buffer length 4690 to accomodate data size of 2347 for RowMutation" error caused node death

2012-02-24 Thread Jonathan Ellis
I've filed https://issues.apache.org/jira/browse/CASSANDRA-3957 as a bug. Any further light you can shed here would be useful. (Is row cache enabled? Is JNA installed?) On Mon, Feb 20, 2012 at 5:43 AM, Thomas van Neerijnen wrote: > Hi all > > I am running the Apache packaged Cassandra 1.0.7 on

Re: nodetool ring runs very slow

2012-02-24 Thread Jonathan Ellis
Read the server log and look for GCInspector output. On Fri, Feb 24, 2012 at 11:02 AM, Feng Qu wrote: > Hi Jonathan, how to check out whether it's in GC storming? This server > crashed few time due to Java heap out of memory. We use 8GB heap on a server > with 96GB ram. This is first node in a 6-

Re: Frequency of Flushing in 1.0

2012-02-24 Thread Jonathan Ellis
http://www.datastax.com/dev/blog/whats-new-in-cassandra-1-0-improved-memory-and-disk-space-management On Thu, Feb 23, 2012 at 6:05 PM, Xaero S wrote: > > I recently started using Cassandra 1.0.4 and observed that it takes a lot > longer to flush the commit logs to SSTables, than was observed in v

Re: hinted handoff 16 s delay

2012-02-24 Thread Jonathan Ellis
Right. See also https://issues.apache.org/jira/browse/CASSANDRA-3958. On Thu, Feb 23, 2012 at 5:43 PM, Todd Burruss wrote: > if I remember correctly, cassandra has a random delay in it so hint > deliver is staggered and does not overwhelm the just restarted node. > > On 2/23/12 1:46 PM, "Hontvár

Re: Cassandra keeps on logging "Finished hinted handoff of 0 rows to endpoint"

2012-02-24 Thread Manoj Mainali
Thanks. On Saturday, February 25, 2012, Brandon Williams wrote: > It's a special case of a single sstable existing for hints: > https://issues.apache.org/jira/browse/CASSANDRA-3955 > > On Fri, Feb 24, 2012 at 5:43 AM, Manoj Mainali wrote: >> Hi, >> >> I have been running Cassandra 1.0.7 and in t

Re: Counter add in 'batch'

2012-02-24 Thread Tyler Hobbs
On Tue, Feb 21, 2012 at 4:00 PM, A J wrote: > Hello > Is there a way to incorporate counter CF add operations in batch ? I > just tried with pycassa and it seems to just allow > insert/update/remove operations but not counter add operations. > > Thanks. > If you're using the batch interface (Mut

Re: newer Cassandra + Hadoop = TimedOutException()

2012-02-24 Thread Patrik Modesto
No, we have our own servers, no cloud service. P. On Feb 24, 2012 5:57 PM, "Jeremy Hanna" wrote: > By chance are you in EC2? > > On Feb 24, 2012, at 8:33 AM, Patrik Modesto wrote: > > > Hi Jeremy, > > > > I've seen the page and tried the values but to no help. > > > > Here goes tcpdump of one fa