Re: is there a key to sstable index file?

2013-07-17 Thread Jean-Armel Luce
@Michal : look a this for the improvement of read performance : https://issues.apache.org/jira/browse/CASSANDRA-2498 Best regards. Jean Armel 2013/7/18 Michał Michalski > SSTables are immutable - once they're written to disk, they cannot be > changed. > > On read C* checks *all* SSTables [1],

Re: InvalidRequestException(why:Not enough bytes to read value of component 0)

2013-07-17 Thread Sylvain Lebresne
I don't know Hector very much really, but I highly suspect that "ts.toString()" is wrong, since composite column names are not strings. So again, not a Hector expert, but I can't really see how converting the composite into string could work. -- Sylvain On Wed, Jul 17, 2013 at 11:14 PM, Rahul Gu

Re: is there a key to sstable index file?

2013-07-17 Thread Michał Michalski
SSTables are immutable - once they're written to disk, they cannot be changed. On read C* checks *all* SSTables [1], but to make it faster, it uses Bloom Filters, that can tell you if a row is *not* in a specific SSTable, so you don't have to read it at all. However, *if* you read it in case

Re: alter column family ?

2013-07-17 Thread Langston, Jim
As a follow up – I did upgrade the cluster to 1.2.6 and that did take care of the issue. The upgrade went very smoothly, the longest part was being thorough on the configuration files, but I was able to able to quickly update the schema's after restarting the cluster. Jim From: "Langston, Jim"

Re: sstable size ?

2013-07-17 Thread Langston, Jim
Thanks, this does look like what I'm experiencing. Can someone post a walkthrough ? The README and the sstablesplit script don't seem to cover it use in any detail. Jim From: Colin Blower mailto:cblo...@barracuda.com>> Reply-To: mailto:user@cassandra.apache.org>> Date: Wed, 17 Jul 2013 16:49:59 -

Fp chance for column level bloom filter

2013-07-17 Thread Takenori Sato
Hi, I thought memory consumption of column level bloom filter will become a big concern when a row becomes very wide like more than tens of millions of columns. But I read from source(1.0.7) that fp chance for column level bloom filter is hard-coded as 0.160, which is very high. So seems not. Is

Re: sstable size ?

2013-07-17 Thread Colin Blower
Take a look at the very recent thread called 'Alternate "major compaction"'. There are some ideas in there about splitting up a large SSTable. http://www.mail-archive.com/user@cassandra.apache.org/msg30956.html On 07/17/2013 04:17 PM, Langston, Jim wrote: > Hi all, > > Is there a way to get an S

sstable size ?

2013-07-17 Thread Langston, Jim
Hi all, Is there a way to get an SSTable to a smaller size ? By this I mean that I currently have an SSTable that is nearly 1.2G, so that subsequent SSTables when they compact are trying to grow to that size. The result is that when the min_compaction_threshold reaches it value and a compaction is

Re: AbstractCassandraDaemon.java (line 134) Exception in thread

2013-07-17 Thread Dave Brosius
What is your -Xss set to. If it's below 256m, set it there, and see if you still have the issues. - Original Message -From: "Julio Quierati" >;julio.quier...@gmail.com

Re: is there a key to sstable index file?

2013-07-17 Thread Robert Coli
On Wed, Jul 17, 2013 at 1:53 PM, S Ahmed wrote: > So is there an index of key's to sstables, and there can be 1 or more > sstables per key? > There are bloom filters, which answer the question "is my row key definitely not in this SSTable"? There is also the Key Cache, which is a list of SSTabl

InvalidRequestException(why:Not enough bytes to read value of component 0)

2013-07-17 Thread Rahul Gupta
Getting error while trying to persist data in a Column Family having a CompositeType comparator Using Cassandra ver 1.1.9.7 Hector Core ver 1.1.5 API ( which uses Thrift 1.1.10) Created Column Family using cassandra-cli: create column family event_counts with comparator = 'CompositeType(DateTyp

RE: is there a key to sstable index file?

2013-07-17 Thread Kanwar Sangha
Yes..Multiple SSTables can have same key and only after compaction the keys are merged reflect the latest value.. From: S Ahmed [mailto:sahmed1...@gmail.com] Sent: 17 July 2013 15:54 To: cassandra-u...@incubator.apache.org Subject: is there a key to sstable index file? Since SSTables are mutable

Re: Alternate "major compaction"

2013-07-17 Thread Radim Kolar
Dne 16.7.2013 20:45, Robert Coli napsal(a): On Fri, Jul 12, 2013 at 2:28 AM, Radim Kolar > wrote: with some very little work (less then 10 KB of code) is possible to have online sstable splitter and exported this functionality over JMX. Are you volunteering?

is there a key to sstable index file?

2013-07-17 Thread S Ahmed
Since SSTables are mutable, and they are ordered, does this mean that there is a index of key ranges that each SS table holds, and the value could be 1 more sstables that have to be scanned and then the latest one is chosen? e.g. Say I write a value "abc" to CF1. This gets stored in a sstable. T

is there a key to sstable index file?

2013-07-17 Thread S Ahmed
Since SSTables are mutable, and they are ordered, does this mean that there is a index of key ranges that each SS table holds, and the value could be 1 more sstables that have to be scanned and then the latest one is chosen? e.g. Say I write a value "abc" to CF1. This gets stored in a sstable. T

Re: Compaction: pending tasks are stuck

2013-07-17 Thread Steffen Rusitschka
Hi Aaron, list, Thanks for the input. But... We figured out what the reason is: https://issues.apache.org/jira/browse/CASSANDRA-5677 we've eliminated the two major spots where we did deletes and things have calmed down. Timeouts still happen and we're eagerly awaiting 1.2.7. Cheers Steffen

Re: manually removing sstable

2013-07-17 Thread Robert Coli
On Wed, Jul 17, 2013 at 1:47 AM, Michał Michalski wrote: > According to my knowledge it's not necessarily true. In a specific case > this patch comes into play: > > https://issues.apache.org/**jira/browse/CASSANDRA-4671 > > "We could however p

Re: unsubscribe

2013-07-17 Thread Robert Coli
http://wiki.apache.org/cassandra/FAQ#unsubscribe On Wed, Jul 17, 2013 at 8:35 AM, wrote: > unsubscribe >

Re: AbstractCassandraDaemon.java (line 134) Exception in thread

2013-07-17 Thread Julio Quierati
System up again xD nodetool removetoken 129020446491903175361975561488312102412 nodetool removetoken force nodetool removetoken 42514072861213193928274919594412671125 nodetool removetoken force nodetool removetoken 99246027852756676471313599864858497886 nodetool removetoken force -- Julio Quie

Re: Minimum CPU and RAM for Cassandra and Hadoop Cluster

2013-07-17 Thread Martin Arrowsmith
Even if we have one machine, will splitting it up into 2 nodes via a VM make a difference ? Can it simulate 2 nodes of half the computing power ? Also, yes, this will just be a test playground and not in production. Thank you, Martin On Mon, Jul 15, 2013 at 1:56 PM, Nate McCall wrote: > Good

Re: AbstractCassandraDaemon.java (line 134) Exception in thread

2013-07-17 Thread Julio Quierati
Hi Aaron, My cassandra-env is by setting "-Xss160k" changed to "-Xss100k". if [ "`uname`" = "Linux" ] ; then # reduce the per-thread stack size to minimize the impact of Thrift # thread-per-client. (Best practice is for client connections to # be pooled anyway.) Only do so on Linux w

unsubscribe

2013-07-17 Thread crigano
unsubscribe

Re: Main method not found in class org.apache.cassandra.service.CassandraDaemon

2013-07-17 Thread Brian O'Neill
Vivek, You could try echoing the CLASSPATH to double check. Drop an echo into the launch_service function in the cassandra shell script. (~line 121) Let us know the output. -brian --- Brian O'Neill Chief Architect Health Market Science The Science of Better Results 2700 Horizon Drive € King o

Re: Main method not found in class org.apache.cassandra.service.CassandraDaemon

2013-07-17 Thread Vivek Mishra
Hi Brian, Thanks for your response. I think i did change CASSANDRA_HOME to point to new directory. -Vivek On Wed, Jul 17, 2013 at 7:03 PM, Brian O'Neill wrote: > Vivek, > > The location of CassandraDaemon changed between versions. (from > org.apache.cassandra.thrift to org.apache.cassandra.ser

Re: Main method not found in class org.apache.cassandra.service.CassandraDaemon

2013-07-17 Thread Brian O'Neill
Vivek, The location of CassandraDaemon changed between versions. (from org.apache.cassandra.thrift to org.apache.cassandra.service) It is likely that the start scripts are picking up the old version on the classpath, which results in the main method not being found. Do you have CASSANDRA_HOME s

Re: Main method not found in class org.apache.cassandra.service.CassandraDaemon

2013-07-17 Thread Vivek Mishra
Finally, i have to delete all rpm installed files to get this working, folders are: /usr/share/cassandra /etc/alternatives/cassandra /usr/bin/cassandra /usr/bin/cassandra.in.sh /usr/bin/cassandra-cli Still don't understand why it's giving me such weird error: **

Re: Intresting issue with getting Order By to work...

2013-07-17 Thread Tony Anecito
Thanks for the answers.   The reason why I ask is it is stated the composite keys are not the same as Primary Key. I found no examples for thrift where it specifcally said the composite key is a primary key required by order by. All the examples where the words primary key were used were with CQ

Re: Main method not found in class org.apache.cassandra.service.CassandraDaemon

2013-07-17 Thread Vivek Mishra
@aaron Thanks for your reply. I did have a look rpm installed files 1. /etc/alternatives/cassandra, it contains configuration files only. and .sh files are installed within /usr/bin folder. Even if i try to run from extracted tar ball folder as /home/impadmin/apache-cassandra-1.2.4/bin/cassa

Re: manually removing sstable

2013-07-17 Thread aaron morton
> https://issues.apache.org/jira/browse/CASSANDRA-4671 Thanks for the tip. A - Aaron Morton Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 17/07/2013, at 8:47 PM, Michał Michalski wrote: > Hi Aaron, > > > * Tombstones will only be purged if all

Re: Huge query Cassandra limits

2013-07-17 Thread aaron morton
> In ours tests, we found there's a significant performance difference > between various configurations and we are studying a policy to optimize it. > The doubt is that, if the needing of issuing multiple requests is caused only > by a fixable implementation detail, would make pointless do th

Re: Main method not found in class org.apache.cassandra.service.CassandraDaemon

2013-07-17 Thread aaron morton
Something is messed up in your install. Can you try scrubbing the install and restarting ? Cheers - Aaron Morton Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 17/07/2013, at 6:47 PM, Vivek Mishra wrote: > Error: Main method not found in class

Re: Main method not found in class org.apache.cassandra.service.CassandraDaemon

2013-07-17 Thread Vivek Mishra
Any suggestions? I am kind of stuck with this, else i need to delete rpm installation to get it working. -Vivek On Wed, Jul 17, 2013 at 12:17 PM, Vivek Mishra wrote: > Error: Main method not found in class > org.apache.cassandra.service.CassandraDaemon, please define the main method > as: >

Re: Intresting issue with getting Order By to work...

2013-07-17 Thread aaron morton
> The use of Order By requires Primary Key which appears to be only supported > by by using CQL and not Cassandra-cli. Order By in CQL is the also supported on the thrift interface. When using thrift the order you get the columns back is the order the Comparator puts them in. If you want them

Re: Deletion use more space.

2013-07-17 Thread aaron morton
you are seeing this http://wiki.apache.org/cassandra/FAQ#range_ghosts Lots of client API's and CQL 3 hide this from you now. Cheers - Aaron Morton Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 17/07/2013, at 1:52 PM, 杨辉强 wrote: > Thanks, But

Re: AbstractCassandraDaemon.java (line 134) Exception in thread

2013-07-17 Thread aaron morton
Double check the stack size is to set 100K see https://github.com/apache/cassandra/blob/cassandra-1.1/conf/cassandra-env.sh#L187 Cheers - Aaron Morton Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 17/07/2013, at 6:26 AM, Julio Quierati wrote: >

Re: cassandra GC cpu usage

2013-07-17 Thread aaron morton
Dive into the logs and look for messages from the GCInspector. These log ParNew and CMS activity that takes over 200 ms. To get further insight consider enabling the full GC logging (see cassandra-env.sh) on one of the problem nodes. Looking at your graphs you are getting about 2 ParNew collec

Re: Pig load data with cassandrastorage and slice filter param

2013-07-17 Thread aaron morton
Not sure I understand the question. What was the command that failed? Cheers - Aaron Morton Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 16/07/2013, at 11:03 PM, Miguel Angel Martin junquera wrote: > hi all > > I trying to load data from cas

Re: IllegalArgumentException on query with AbstractCompositeType

2013-07-17 Thread aaron morton
> This would seem to conflict with the advice to only use secondary indexes on > fields with low cardinality, not high cardinality. I guess low cardinality is > good, as long as it isn't /too/ low? My concern is seeing people in the wild create secondary indexes with low cardinality that genera

Re: manually removing sstable

2013-07-17 Thread Michał Michalski
Hi Aaron, > * Tombstones will only be purged if all fragments of a row are in the SStable(s) being compacted. According to my knowledge it's not necessarily true. In a specific case this patch comes into play: https://issues.apache.org/jira/browse/CASSANDRA-4671 "We could however purge tom

Re: Huge query Cassandra limits

2013-07-17 Thread cesare cugnasco
Hi Rob, of course, we could issue multiple requests, but then we should consider which is the optimal way to split the query in smaller ones. Moreover, we should choose how many of sub-query run in parallel. In ours tests, we found there's a significant performance difference between various c