Re: Is there a way from a running Cassandra node to determine whether or not itself is "up"?

2011-06-16 Thread aaron morton
take a look at mx4j http://wiki.apache.org/cassandra/Operations#Monitoring_with_MX4J someone told me once you can call the JMX ops via http, i've not checked though. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 16 Jun

Re: Docs: Token Selection

2011-06-16 Thread aaron morton
- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 16 Jun 2011, at 15:51, Vijay wrote: > +1 for more documentation (I guess contributions are always welcomed) I > will try to write it down sometime when we have a bit more time... > >

Re: Important Variables for Scaling

2011-06-16 Thread aaron morton
Hope that helps. --------- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 16 Jun 2011, at 18:28, Schuilenga, Jan Taeke wrote: > Which variables (for instance: throughput, CPU, I/O, connections) are leading > in deciding to add a node to a Cassandra se

Visiting Auckland

2011-06-16 Thread aaron morton
So long as the Volcanic Ash stays away I'll be visiting Auckland next week on the 23rd and 24th. Drop me an email if you would like to meet to talk about things Cassandra. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com

Re: Cassandra JVM GC settings

2011-06-16 Thread aaron morton
It would help if you can provide some log messages from the GCInspector so people can see how much GC is going on. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 17 Jun 2011, at 02:46, Sebastien Coutu wrote: > Hi Every

Re: client API

2011-06-16 Thread aaron morton
"The Thrift Java compiler creates code that is not compliant with Java 5." https://issues.apache.org/jira/browse/THRIFT-1170 So you may have trouble getting the thrift API to run. Cheers ----- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpick

Re: Docs: Token Selection

2011-06-16 Thread aaron morton
> But, I'm thinking about using OldNetworkTopStrat. NetworkTopologyStrategy is where it's at. A ----- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 17 Jun 2011, at 01:39, AJ wrote: > Thanks Eric! I've finally got

Re: Easy way to overload a single node on purpose?

2011-06-17 Thread aaron morton
n it, but it will do for now :) Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 17 Jun 2011, at 10:25, Suan Aik Yeo wrote: > > Having a ping column can work if every key is replicated to every node. It > > would tell you the c

Re: cassandra crash

2011-06-17 Thread aaron morton
/ console. If you are using a packed distro it will probably be in /var/log/cassandra/output.log Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 17 Jun 2011, at 19:18, Donna Li wrote: > All: > Can you find some exception from th

Re: Cassandra.yaml

2011-06-17 Thread aaron morton
sounds like https://issues.apache.org/jira/browse/CASSANDRA-2694 Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 17 Jun 2011, at 20:10, Vivek Mishra wrote: > Hi Sasha, > This is what I am trying . I can sense this is hap

Re: Cassandra.yaml

2011-06-19 Thread aaron morton
/src/java/org/apache/cassandra/config/CFMetaData.java#L642 It is in the trunk and the current trunk and builds. Can you try the nightly here https://builds.apache.org/job/Cassandra-0.8/ Hope that helps. - Aaron Morton Freelance Cassandra Developer @aaronmorton http

Re: MemoryMeter uninitialized (jamm not specified as java agent)

2011-06-19 Thread aaron morton
agent The args to the java process should include -javaagent:bin/../lib/jamm-0.2.2.jar Cheers ----- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 17 Jun 2011, at 22:18, Rene Kochen wrote: > Since using cassandra 0.8, I see the foll

Re: Re : last record rowId

2011-06-19 Thread aaron morton
get_range_slice() api call allows you to iterate of the keys in the DB. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 18 Jun 2011, at 05:00, karim abbouh wrote: > is there any way to remember the keys (rowId) inserted

Re: Error trying to move a node - 0.7

2011-06-19 Thread aaron morton
I *think* someone had a similar problem once before, moving a node that was the only node in a DC. Whats version are you using ? - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 17 Jun 2011, at 07:42, Ben Frank wrote: > Hi All, >

Re: framed transport and buffered transport

2011-06-20 Thread aaron morton
From changes.txt = https://github.com/apache/cassandra/blob/cassandra-0.8.0/CHANGES.txt#L687 " make framed transport the default so malformed requests can't OOM the=20= server (CASSANDRA-475) " btw, you *really* should upgrade. Cheers --------- Aaron Morton Free

Re: Secondary indexes performance

2011-06-21 Thread aaron morton
that using the other predicates. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 21 Jun 2011, at 09:04, Wojciech Pietrzok wrote: > Hello, > > I've noticed that queries using secondary indexes seems to be getting

Re: OOM during restart

2011-06-21 Thread aaron morton
an process only one at a time. The JVM option D.cassandra_ring=false will stop the node from joining the cluster and stop other nodes sending requests to it until you have sorted it out. Hope that helps. ----- Aaron Morton Freelance Cassandra Developer @aaronm

Re: Create columnFamily

2011-06-21 Thread aaron morton
set data['31']['address'][utf8('city')]='noida'; Value inserted. Hope that helps. - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 21 Jun 2011, at 19:06, Vivek Mishra wrote: > I understand tha

Re: Flushing behavior in Cassandra 0.8

2011-06-21 Thread aaron morton
The new memtable_total_space_in_mb option is kicking in https://github.com/apache/cassandra/blob/cassandra-0.8.0/NEWS.txt#L34 http://thelastpickle.com/2011/05/04/How-are-Memtables-measured/ Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http

Re: CommitLog replay

2011-06-21 Thread aaron morton
andra/blob/cassandra-0.8.0/NEWS.txt#L34 http://thelastpickle.com/2011/05/04/How-are-Memtables-measured/ Cheers ----- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 22 Jun 2011, at 01:51, Stephen Pope wrote: > I've only got one cf, and h

Re: Compressing data types

2011-06-21 Thread aaron morton
Also https://issues.apache.org/jira/browse/HADOOP-7206 Now part of brisk http://www.datastax.com/dev/blog/brisk-1-0-beta-2-released Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 22 Jun 2011, at 04:04, Vijay wrote: > You mi

Re: Storing files in blob into Cassandra

2011-06-22 Thread aaron morton
files are best kept in a file system, until a compelling reason is found to do other wise. Hope that helps. - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 22 Jun 2011, at 20:23, Damien Picard wrote: > >store your images / documents

Re: Storing files in blob into Cassandra

2011-06-22 Thread aaron morton
connected from the network / taken out of rotation for maintenance. There are lots of reasons for a server to not be doing what it should be. ----- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 22 Jun 2011, at 23:10, Damien Picard wrote: >

Re: Secondary indexes performance

2011-06-22 Thread aaron morton
> it will probably be better to denormalize and store > some precomputed data Yes, if you know there are queries you need to serve it is better to support those directly in the data model. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorto

Re: insufficient space to compact even the two smallest files, aborting

2011-06-22 Thread aaron morton
compaction once the memtables have been flushed - check the logs for messages from 'CompactionManager' - when done grab the output from `ls -lah` again. Hope that helps. ----- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 23 Jun 2011

Re: Strange Connection error of nodetool

2011-06-22 Thread aaron morton
Check the list here http://wiki.apache.org/cassandra/JmxGotchas I *think* the jmx server tells the client to connect back on another host/port. Hope that helps. - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 22 Jun 2011, at 21:02

Re: unsubscribe

2011-06-22 Thread aaron morton
http://wiki.apache.org/cassandra/FAQ#unsubscribe - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 23 Jun 2011, at 06:02, Carey Hollenbeck wrote: > unsubscribe > > From: William Oberman [mailto:ober...@civicscience.com

Re: Atomicity Strategies

2011-06-22 Thread aaron morton
Atomic on a single machine yes. - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 23 Jun 2011, at 09:42, AJ wrote: > On 4/9/2011 7:52 PM, aaron morton wrote: >> My understanding of what they did with locking (based on the exam

Re: Backup/Restore: Coordinating Cassandra Nodetool Snapshots with Amazon EBS Snapshots?

2011-06-22 Thread aaron morton
(seconds? minutes? hours?) Consider the snapshot to be from the time of the first one. Previous discussion on AWS backup http://www.mail-archive.com/user@cassandra.apache.org/msg12831.html Hope that helps. - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.th

Re: Decorator Algorithm

2011-06-23 Thread aaron morton
which endpoints contain replicas is done by the AbstractReplicationStrategy.calculateNaturalEndpoints() implementations. Does that help? - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 23 Jun 2011, at 19:58, Jonathan Colby wrote: >

Re: insufficient space to compact even the two smallest files, aborting

2011-06-23 Thread aaron morton
Missed that in the history, cheers. A - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 23 Jun 2011, at 20:26, Sylvain Lebresne wrote: > As Jonathan said earlier, you are hitting > https://issues.apache.org/jira/browse/CASSANDR

Re: get_range_slices result

2011-06-23 Thread aaron morton
Not sure what your question is. Does this help ? http://wiki.apache.org/cassandra/FAQ#range_rp Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 23 Jun 2011, at 21:59, karim abbouh wrote: > how can get_range_slices() funct

Re: RAID or no RAID

2011-06-27 Thread aaron morton
RAID0 so you have one big volume. For performance (cassandra does not stripe sstables across the data dirs) and otherwise you'll have fragmentation and wont be able to utilise all your space. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton

Re: Clock skew

2011-06-27 Thread aaron morton
. - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 28 Jun 2011, at 10:03, A J wrote: > During writes, the timestamp field in the column is the system-time of > that node (correct me if that is not the case and the system-time of > the co-

Re: remove all the columns of a key in a column family

2011-06-27 Thread aaron morton
AFAIK that is still not supported. To delete all the columns for row send a Mutation where the Deletion has neither a super_column or predicate Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 28 Jun 2011, at 15:50, Donna Li

Re: RAID or no RAID

2011-06-27 Thread aaron morton
> Not sure what the intended purpose is, but we've mostly used it as an > emergency disk-capacity-increase option Thats what I've used it for. Cheers --------- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 28 Jun 2011, at 15:

Re: remove all the columns of a key in a column family

2011-06-28 Thread aaron morton
That error is thrown if you send a Deletion with a predicate that has neither columns or a SliceRange. Send a Deletion that does not have a predicate. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 28 Jun 2011, at 18:11

Re: Truncate introspection

2011-06-28 Thread aaron morton
- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 28 Jun 2011, at 20:00, David Boxenhorn wrote: > Does drop work in a similar way? > > When I drop a CF and add it back with a different schema, it seems to work. > > But I notice that in b

Re: Re : Re : get_range_slices result

2011-06-28 Thread aaron morton
heers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 28 Jun 2011, at 22:20, karim abbouh wrote: > can i have an example for usingTimeUUIDType as comparator in a client > java code. > > De : karim abbouh > À : "user@cassandra

Re: custom reconciling columns?

2011-06-28 Thread aaron morton
with using a row for the user and columns for each item. Then you can have fast no look writes. What problems are you seeing with the reads ? Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 29 Jun 2011, at 04:20, Yang wrote:

Re: Query indexed column with key filter‏

2011-06-28 Thread aaron morton
reasonable. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 29 Jun 2011, at 05:31, Daning wrote: > I found this code > >// Start and finish keys, *and* column relations (KEY> foo AND KEY< > bar

Re: Server-side CQL parameters substitution

2011-06-28 Thread aaron morton
see https://issues.apache.org/jira/browse/CASSANDRA-2475 - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 29 Jun 2011, at 08:45, Michal Augustýn wrote: > Hi all, > > in most SQL implementations, it's possible to declare

Re: custom reconciling columns?

2011-06-28 Thread aaron morton
data churn, data model and query before looking at serialisation. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 29 Jun 2011, at 10:37, Yang wrote: > I can see that as my user history grows, the reads time proportionally (

Re: Cannot set column value to zero

2011-06-29 Thread aaron morton
does not ring any bells. Let us know if it happens again. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 30 Jun 2011, at 02:13, dnalls...@taz.qinetiq.com wrote: > I had a strange problem recently where I was unable to set the va

Re: hadoop results

2011-06-29 Thread aaron morton
How about get_slice() with reversed == true and count = 1 to get the highest time UUID ? Or you can also store a column with a magic name that have the value of the timeuuid that is the current metric to use. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton

Re: Chunking if size > 64MB

2011-06-29 Thread aaron morton
AFAIK there is no server side chunking of column values. This link http://wiki.apache.org/cassandra/FAQ#large_file_and_blob_storage is just suggesting in the app you do not store more than 64MB per column. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http

Re: SimpleAuthenticator

2011-06-30 Thread aaron morton
=/etc/cassandra/access.properties" btw at a minimum you should upgrade from 0.7.2 to 0.7.6-2 see https://github.com/apache/cassandra/blob/cassandra-0.7.6-2/NEWS.txt#L61 Hope that helps. --------- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com

Re: Repair doesn't work after upgrading to 0.8.1

2011-06-30 Thread aaron morton
nyone else ? ----- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 1 Jul 2011, at 09:11, Héctor Izquierdo Seliva wrote: > Hi all, > > I have upgraded all my cluster to 0.8.1. Today one of the disks in one > of the nodes died. After replacing the disk I tri

Re: incomplete schema sync for new node

2011-07-03 Thread aaron morton
d tutting and stoking my beard. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 2 Jul 2011, at 12:58, Jeremy Stribling wrote: > Oops, forgot to mention that we're using Cassandra 0.7.2. > > On 07/01/2011 05:46 PM, Jere

Re: secondary index performance

2011-07-04 Thread aaron morton
change. cfstats for secondary index CF's are available via JMX / JConsole. Cheers ----- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 4 Jul 2011, at 10:12, Jeremy Hanna wrote: > > On Jul 3, 2011, at 4:29 PM, Jeremy Hanna wrote:

Re: flushing issue

2011-07-04 Thread aaron morton
by using nodetool cfstats. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 4 Jul 2011, at 22:28, Vivek Mishra wrote: > Hi, > I know, I might be missing something here. > I am currently facing 1 issue. > > I h

Re: copy data from multi-node cluster to single node

2011-07-04 Thread aaron morton
ou really want to have *everything* from the prod cluster then copy the data from all 3 nodes onto the dev node and compact it down. Hope that helps. ----- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 5 Jul 2011, at 03:05, Ross Black wrote:

Re: copy data from multi-node cluster to single node

2011-07-05 Thread aaron morton
rom multiple nodes onto one you will need to manually update them. Cheers ----- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 5 Jul 2011, at 14:59, Zhu Han wrote: > On Tue, Jul 5, 2011 at 8:58 AM, aaron morton wrote: >> How do you cha

Re: Problems Iterating over tokens in > 0.7.5

2011-07-06 Thread Aaron Morton
If you still have problems send through some details of where you get incorrect results. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 6/07/2011, at 3:23 AM, Anand Somani wrote: > Hi, > > Using thrift and get_ran

Re: deleting keys

2011-07-06 Thread Aaron Morton
See http://wiki.apache.org/cassandra/FAQ#range_ghosts Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 6/07/2011, at 3:46 AM, karim abbouh wrote: > i use get_range_slice to get the list of keys, > then i call client.

Re: Details of 'nodetool move'

2011-07-06 Thread Aaron Morton
, it will also be sent writes while it is bootstrapping. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 6/07/2011, at 10:35 AM, A J wrote: > Hello, > Where can I find details of nodetool move. Most places just mention > t

Re: memory

2011-07-06 Thread Aaron Morton
That advice is a little out of date, specially in the future world of 0.8 memory management, see http://thelastpickle.com/2011/05/04/How-are-Memtables-measured/ Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 6/07/2011, at 5:51

Re: result sorted by keys in reversed

2011-07-06 Thread Aaron Morton
, someone else may have requested it) Cheers ----- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 7/07/2011, at 1:39 AM, Monnom Monprenom wrote: > Hi, > > I am using get_range_slice and I get the results sorted by keys, Is it >

Re: commitlogs not draining

2011-07-06 Thread Aaron Morton
ages? The non draining logs may be this https://issues.apache.org/jira/browse/CASSANDRA-2829 . If a node tool flush does not clear them a restart will. Cheers ----- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 7/07/2011, at 12:26 PM, Sco

Re: Running hadoop jobs against data in remote data center

2011-07-06 Thread Aaron Morton
de to get on with it's life without worrying about the other DC. Hope that helps. ----- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 7/07/2011, at 1:29 PM, Jason Baker wrote: > I'm just setting up a Cassandra cluster for

Re: Pig pulling an older value from cassandra

2011-07-08 Thread aaron morton
Jeremy did you get anywhere with this ? If you are reading at CL ONE Read Repair will run in the background, so it may only be visible to subsequent reads. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 6 Jul 2011, at 20:52

Re: Re : result sorted by keys in reversed

2011-07-08 Thread aaron morton
> Is it possible to have same results sorting in reversed by another method > without get_range_slice in JAVA ? Sorry I don't understand your question. Cheers ----- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 7 Jul 2011, at 01

Re: List nodes where write was applied to

2011-07-08 Thread aaron morton
n the replicas. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 7 Jul 2011, at 10:01, A J wrote: > Is there a way to find what all nodes was a write applied to ? It > could be a successful write (i.e. w was met) or unsuccessful w

Re: how large cassandra could scale when it need to do manual operation?

2011-07-08 Thread aaron morton
eys. Is there something you are specifically concerned about with your current installation ? Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 8 Jul 2011, at 08:50, Yan Chunlu wrote: > hi, all: > I am curious about how la

Re: Corrupted data

2011-07-08 Thread aaron morton
You may not lose data. - What version and whats the upgrade history? - What RF / node count / CL ? - Have you been running repair consistently ? - Is this on a single node or all nodes ? Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http

Re: node stuck "leaving"

2011-07-09 Thread aaron morton
. cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 8 Jul 2011, at 16:27, Casey Deccio wrote: > I've got a node that is stuck "Leaving" the ring. Running "nodetool > decommission" never terminates. It&#

Re: how large cassandra could scale when it need to do manual operation?

2011-07-09 Thread aaron morton
ms > latency). Lookup LOCAL_QUORUM in the wiki Hope that helps. - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 9 Jul 2011, at 02:01, Chris Goffinet wrote: > As mentioned by Aaron, yes we run hundreds of Cassandra nodes across mu

Re: Cassandra Secondary index/Twissandra

2011-07-09 Thread aaron morton
r type has very little to do with the performance. Hope that helps. - - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 9 Jul 2011, at 12:15, Eldad Yamin wrote: > Hi, > I have few questions: > > Secondary index

Re: Corrupted data

2011-07-09 Thread aaron morton
files. Try to run repair. Try running it on a single CF to start with. Good luck ----- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 9 Jul 2011, at 16:45, Héctor Izquierdo Seliva wrote: > Hi Peter. > > I have a problem with re

Re: Cassandra Secondary index/Twissandra

2011-07-10 Thread aaron morton
r. But may still be plenty fast enough, depending on scale and throughput and all those other things. see http://thelastpickle.com/2011/07/04/Cassandra-Query-Plans/ Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 10 Jul 2011, at

Re: Corrupted data

2011-07-10 Thread aaron morton
he code base, can you provide some more information ? Cheers ----- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 10 Jul 2011, at 03:26, Yan Chunlu wrote: > I am running RF=2(I have changed it from 2->3 and back to 2) and 3 nodes and > d

Re: node stuck "leaving"

2011-07-10 Thread aaron morton
node which thing the missing node is up with using the Dcassandra.load_ring_state=false JVM property. But you may have to take more drastic action. http://www.datastax.com/docs/0.8/troubleshooting/index#view-of-ring-differs-between-some-nodes Cheers - Aaron Morton Freelance Cass

Re: R: Re: Re: AntiEntropy?

2011-07-12 Thread aaron morton
> Running nodetool repair causes Cassandra to execute a major compaction This is not what I would call factually accurate. Repair does not run a major compaction. Major compaction is when all SSTables for a CF are compacted down to one SSTable. Cheers ----- Aaron Morton Freela

Re: commitlog replay missing data

2011-07-13 Thread Aaron Morton
erted, and is never decremented. Deletes and overwrites will inflate this value. What was your workload like? As of 0.8 we now have global memory management for cf's that tracks actual JVM bytes used by a CF. Cheers ----- Aaron Morton Freelance Cassandra Developer @aaronm

Re: Storing counters in the standard column families along with non-counter columns ?

2011-07-13 Thread Aaron Morton
If you can provide some more details on the use case we may be able to provide some data model help. You can always use a dedicated CF for the counters, and use the same row key. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On

Re: Range query ordering with CQL JDBC

2011-07-17 Thread aaron morton
. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 16 Jul 2011, at 06:09, Matthieu Nahoum wrote: > Hi Eric, > > I am using the default partitioner, which is the RandomPartitioner I guess. > The key type is String. Are String

Re: Data overhead discussion in Cassandra

2011-07-17 Thread aaron morton
offset for the data file. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 15 Jul 2011, at 07:09, Sameer Farooqui wrote: > We just set up a demo cluster with Cassandra 0.8.1 with 12 nodes and loaded > 1.5 TB of data into it. H

Re: Thrift Java Client - Get a column family from a Keyspace

2011-07-17 Thread aaron morton
gainst thrift they also provide connection management and retry features that are dead handy. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 14 Jul 2011, at 23:59, Chandrasekhar M wrote: > Hi > > I have been play

Re: What available Cassandra schema documentation is available?

2011-07-18 Thread aaron morton
Indexes are not supported on sub columns. Also, you definition seems to mix standard and sub columns together in the CF. For a super CF all top level columns contain sub columns. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On

Re: thrift install

2011-07-18 Thread aaron morton
Why are you installing thrift ? The cassandra binary packages contain all the dependancies. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 19 Jul 2011, at 07:51, Sal Lopez wrote: > Does anyone have documentation/tips

Re: How to keep only exactly column of key

2011-07-18 Thread aaron morton
ou no longer need. You could also try Redis. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 19 Jul 2011, at 03:22, JKnight JKnight wrote: > Dear all, > > I want to keep only 100 column of a key: when I add a column

Re: b-tree

2011-07-20 Thread aaron morton
ot would depend on your data. The top sets may get very big, . Cheers ----- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 21 Jul 2011, at 08:33, Jeffrey Kesselman wrote: > Im not sure if I have an answer for you, anyway, but I'm curi

Re: Data Visualization Best Practices

2011-07-20 Thread aaron morton
This project may provide some inspiration https://github.com/driftx/chiton Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 21 Jul 2011, at 06:36, Selcuk Bozdag wrote: > Hi, > > Cassandra provides a flexible scheme-

Re: Repair taking a long, long time

2011-07-20 Thread aaron morton
n about what is going on. If you want to dive deeper look for a log messages on the machine you started the repair on from the AnitEntropyService. Hope that helps. - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 21 Jul 2011, at 02:

Re: node repair eat up all disk io and slow down entire cluster(3 nodes)

2011-07-20 Thread Aaron Morton
min and max thresholds to 0 via node tool. hope that helps. - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 20/07/2011, at 11:46 PM, Yan Chunlu wrote: > just found this: > https://issues.apache.org/jira/browse/CASSANDRA-2156 &g

Re: PHPCassa get number of rows

2011-07-20 Thread Aaron Morton
keys and counting the columns. NOTE: counting columns just reads aol the columns, for a big row it can result in an OOM. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 20/07/2011, at 8:29 AM, Jean-Nicolas Boulay Desjardins wrote

Re: with proof Re: cassandra goes infinite loop and data lost.....

2011-07-20 Thread aaron morton
Personally I would do a repair first if you need to do one, just so you are confident everything is where is should be. Then do the move as described in the wiki. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 21 Jul 2011, at

Re: reset keys_cached

2011-07-21 Thread aaron morton
To clear the key cache use the invalidateKeyCache() operation on the column family in JConsole / JMX Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 21 Jul 2011, at 18:15, 魏金仙 wrote: > Can any one tell how to reset "key

Re: Need help json2sstable

2011-07-21 Thread aaron morton
What is the command line you are executing ? That error is only returned by sstable2json when an sstable path is not passed on the command line. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 21 Jul 2011, at 18:50, Nilabja

Re: Memtables stored in which location

2011-07-21 Thread aaron morton
to the commit log first, then the memtable in memory, which is later flushed to disk. A read is from potentially multiple sstables and memtables. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 21 Jul 2011, at 21:17, CASSANDRA

Re: cassandra massive write perfomance problem

2011-07-21 Thread aaron morton
#cleaning_compacted_tables You may also want to track things by looking at nodetool tpstats and cfstats (for latency). Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 21 Jul 2011, at 21:49, lebron james wrote: > Please help me solve

Re: Data Visualization Best Practices

2011-07-21 Thread aaron morton
I've never used it myself as it's not something I need. You'll have to try and build it yourself I'm afraid. Cheers --------- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 21 Jul 2011, at 23:02, Selcuk Bozdag wrote: >

Re: node repair eat up all disk io and slow down entire cluster(3 nodes)

2011-07-21 Thread aaron morton
What are you seeing in compaction stats ? You may see some of https://issues.apache.org/jira/browse/CASSANDRA-2280 Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 21 Jul 2011, at 23:17, Yan Chunlu wrote: > after tr

Re: Memtables stored in which location

2011-07-21 Thread aaron morton
The data file with rows and columns, the bloom filter for the rows in the data file, the index for rows in the data file and the statistics. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 21 Jul 2011, at 23:26, Nilabja

Re: Need help json2sstable

2011-07-21 Thread aaron morton
mmm, there is no -f option for sstable2json / SSTableExport. Datastax guys/girls ?? this works for me bin/sstable2json /var/lib/cassandra/data/dev/data-g-1-Data.db -k 666f6f > output.txt NOTE: key is binary, so thats the ascii encoding for foo Cheers ----- Aaron Mor

Re: b-tree

2011-07-21 Thread aaron morton
> But how will you be able to maintain it while it evolves and new data is > added without transactions? What is the situation you think you need transactions for ? Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 22 Jul 20

Re: Compacting manual managing and optimization

2011-07-21 Thread aaron morton
up or make some other changes. What does your cluster look like ? # nodes, load per node, throughput, # clients etc Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 22 Jul 2011, at 00:30, lebron james wrote: > Hi! Tell me ple

Re: Need help json2sstable

2011-07-21 Thread aaron morton
m cassandra-cli list (unless you have either set a key_validation_class for the CF or used the assume statement). If one way does not work try the other. Cheers --------- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 22 Jul 2011, at 01:15, Ni

Re: Modeling troubles

2011-07-21 Thread aaron morton
hites perspective. - each column name is the byte array for the possible positions of the other colour Good luck. - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 22 Jul 2011, at 01:18, Stephen Pope wrote: > For a side project I’m work

Re: Is it safe to stop a read repair and any suggestion on speeding up repairs

2011-07-21 Thread aaron morton
300GB per node. The reason for this recommendation is so that things like repair, compaction, node moves, etc are managable and because the loss of a single node has less of an impact. I would not recommend running a live system with that much data per node. Hope that helps. -

<    5   6   7   8   9   10   11   12   13   14   >