Re: High disk read throughput on only one node.

2012-12-19 Thread aaron morton
Is there a sustained difference or did it settle back ? Could this have been compaction or repair or upgrade tables working ? Do the read / write counts available in nodetool cfstats show anything different ? Cheers - Aaron Morton Freelance Cassandra Developer New Zealand

Re: Partition maintenance

2012-12-19 Thread aaron morton
n the sstable header will help here. Note that columns are not purged unless all fragments from the row are included in the compaction. This could be a problem. It probably depends on your workload though. Hope that helps. - Aaron Morton Freelance Cassandra Developer New Ze

Re: Exception on running nodetool in windows

2012-12-19 Thread aaron morton
> Classcastexception: can not convert java.lang.String to some another java > type( i don't remember exact java class). It's a lot easier to help if you include the full error. Cheers --------- Aaron Morton Freelance Cassandra Developer New Zealand @

Re: TTL on SecondaryIndex Columns. A bug?

2012-12-19 Thread aaron morton
--- RowKey: 66 => (column=1, value=val, timestamp=135595439049, ttl=7884000) => (column=10, value=val, timestamp=135595439269, ttl=7884000) ... => (column=indexedColumn, value=66, timestamp=1355952223881937, ttl=7887600) Looking into it now. Thanks

Re: TTL on SecondaryIndex Columns. A bug?

2012-12-19 Thread aaron morton
Well that was fun https://issues.apache.org/jira/browse/CASSANDRA-5079 Just testing my idea of a fix now. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 20/12/2012, at 10:33 AM, aaron morton wrote: >> Please

Re: TTL on SecondaryIndex Columns. A bug?

2012-12-20 Thread aaron morton
Yes, but they will get compacted away again unless the patch is there. it's a small patch so you should be able to apply it easily enough if you need a fix ASAP. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com

Re: Moving data from one datacenter to another

2012-12-20 Thread aaron morton
copy part done pretty quickly. If that's the case you can: 1) do the main copy 2) stop the old system. 3) do the delta copy 4) start the new system That way you will not have stale reads in the new system. Hope that helps. - Aaron Morton Freelance Cassandra Developer New

Re: Too Many Open files error

2012-12-20 Thread aaron morton
> THe number of files in the data directory is around 29500+. If you are using Levelled Compaction it is probably easier to set the ulimit to unlimited. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 21/12/2

Re: Replication Factor and Consistency Level Confusion

2012-12-20 Thread aaron morton
me (if this is not already the case) so > that you have repeatable results. Take a look at the nodetool getendpoints command. It will tell you which nodes a key is stored on. Though for RF 3 and N3 it's all of them :) Cheers - Aaron Morton Freelance Cassandra Developer

Re: question about config leading to an unbalanced ring

2012-12-20 Thread aaron morton
in rack 1. If you are using racks it's best to have an even distribution of nodes and the RF to be a multiple of the number of racks. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 21/12/2012, at 8:13 AM, Rob Co

Re: Loading sstables to Cassandra using sstableloader and JMX client

2012-12-20 Thread aaron morton
>> -d '127.0.0.1' 'C:\Anand\Workspace\H2C_POC\Customer' Are you using the quotes on the command line / in the arguments ? Try without them. >> I end up having "Unknown directory: 'C:\Anand\Workspace\H2C_POC\Customer'" >> error. Whats

Re: CQL3 Compound Primary Keys - Do I have the right idea?

2012-12-23 Thread aaron morton
NE internal column / cell, the shipname * the internal column / cell "shipname" is a composite of the *value* of time_seen. e.g. Hope that helps. ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 23/12/2012, at

Re: Need to run nodetool repair on a cluster running 1.1.6 if no deletes

2012-12-23 Thread aaron morton
tes, I do not know of any other technical issues for running repair. And I have seen a lot of systems running without out. (I just prefer a very boring life). Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 23/12

Re: Exception on running nodetool in windows

2012-12-23 Thread aaron morton
The line numbers in the stack trace do not match the code for 1.1.6. I would blow away the install and check your java install. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 22/12/2012, at 6:59 PM, Vivek Mishra

Re: Cassandra read throughput with little/no caching.

2012-12-23 Thread aaron morton
ter with local disks. It also introduces a single point of failure into a distributed system. > but it's likely in the Linux disk cache, given the sizing of the > node/data/jvm. Are you sure that the local Linux machine is going to cache files stored on the SAN ? Cheers

Re: How to show unread messages counts?

2013-01-02 Thread aaron morton
> Currently I'm thinking of having a separate Counter CF just to keep the > number of unread messages in there. Is this a good approach? Yup. Add a UserMetrics CF with columns for the counts you want to keep. Cheers ----- Aaron Morton Freelance Cassandra Developer

Re: Column Family migration/tombstones

2013-01-02 Thread aaron morton
sh. Or by kicking of a user defined compaction using the JMX interface. > 3) Any words of warning when undergoing this? Make sure you have a good breakfast. (It's more general advice than Cassandra specific.) Cheers - Aaron Morton Freelance Cassandra Developer New

Re: sliding window problem

2013-01-03 Thread aaron morton
Without knowing any details of your problem, try using a Time To Live on the column. You will get a better reply if you ask a more specific question. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 3/01/2013, at 5

Re: UUID - Java

2013-01-03 Thread aaron morton
, which is sometimes zero'd out so you can reproduce a UUID for a specific time. See http://en.wikipedia.org/wiki/Universally_unique_identifier#Version_1_.28MAC_address.29 and http://wiki.apache.org/cassandra/FAQ#working_with_timeuuid_in_java Hope that helps. --------- Aaron Morton Free

Re: Multi threads updating single row

2013-01-03 Thread aaron morton
And then the size of issue depends somewhat on the size of the inserts you are running. i.e. a smaller insert size means less re-work. There are also potential performance issues if you have secondary indexes on the row. Hope that helps. ----- Aaron Morton Freelance Cassa

Re: Row cache and counters

2013-01-03 Thread aaron morton
queuing cf messages that occur immediately after writing cf messages. Hope that helps. - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 4/01/2013, at 4:25 AM, André Cruz wrote: > Does anyone see anything wrong in these se

Re: Error after 1.2.0 upgrade

2013-01-03 Thread aaron morton
Michael, Could you share some of your problems ? May be of help for others. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 4/01/2013, at 5:45 AM, Michael Kjellman wrote: > I'm having huge upgrad

Re: Error after 1.2.0 upgrade

2013-01-03 Thread aaron morton
. - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 4/01/2013, at 5:56 AM, Alain RODRIGUEZ wrote: > Wow, so you're going live with 1.2.0, good luck with that. When it's done, > whould you mind letting me know if ever

Re: Cassandra supported Avro data types

2013-01-03 Thread aaron morton
ams if you wanted to. Hope that helps. ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 4/01/2013, at 7:22 AM, Renato Marroquín Mogrovejo wrote: > Hi all, > > I have started playing around with Cassandra and

Re: Error after 1.2.0 upgrade

2013-01-03 Thread aaron morton
sip; echo "Sleeping for 10..." sleep 10; echo "Drain..." nodetool -h localhost drain; echo "Sleeping for 10..." sleep 10; echo "Stopping..." sudo monit stop cassandra; A - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton h

Re: AWS EMR <-> Cassandra

2013-01-03 Thread aaron morton
> Instead, I get an error from CassandraStorage that the initial address isn't > set (on the slave, the master is ok). Can you post the full error ? Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 4/01/201

Re: Cassandra supported Avro data types

2013-01-03 Thread aaron morton
Collections might be what you are looking for http://www.datastax.com/dev/blog/cql3_collections Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 4/01/2013, at 11:35 AM, Renato Marroquín Mogrovejo wrote: > Tha

Re: when are keyspace dirs removed?

2013-01-03 Thread aaron morton
> Are they never removed in fear of removing snapshots? Aye. Their should be shapshots in there https://github.com/apache/cassandra/blob/trunk/conf/cassandra.yaml#L402 Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com

Re: Column Family migration/tombstones

2013-01-06 Thread aaron morton
stones. > Do tombstones take up bloomfilter space after gc_grace_period? Any row, regardless of the liveness of the columns, takes up bloom filter space (in -Filter.db). Once the row is removed it will no longer take up space. Cheers - Aaron Morton Freelan

Re: Schema recommendation

2013-01-06 Thread aaron morton
Riak has an out of the box S3 compatible service http://basho.com/products/riakcs/. Not sure what the pricing is. Hope that helps. - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 7/01/2013, at 4:46 AM, Attila Nagy wrote:

Re: Cassandra 1.2 compatible Python bindings

2013-01-06 Thread aaron morton
I'm not aware of any issues with using the thrift API with http://pycassa.github.com/pycassa/ and 1.2 Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 7/01/2013, at 8:21 AM, Adam Venturella wrote: > I h

Re: Column Family migration/tombstones

2013-01-06 Thread aaron morton
ou have purged the deleted data, keep an eye on the sstables. If it looks like the one created by major compaction is not going to get compaction for a long time come back and ask about "anti compacting" / "sstable split". Hope that helps. - Aaron Morton

Re: Cassandra 1.2 compatible Python bindings

2013-01-06 Thread aaron morton
> I know work is in progress to fix this... AFAIK CF's created by CQL 3 using COMPACT STORAGE are visible to thrift. Those created without it are not, and will not, be visible to thrift. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmor

Re: Column Family migration/tombstones

2013-01-07 Thread aaron morton
ase the max JVM heap to get through your maintenance task. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 8/01/2013, at 1:35 AM, Mike wrote: > Thanks, > > Another related question. In the situation desc

Re: puzzled why my cluster is slowing down

2013-01-07 Thread aaron morton
cassandra log do not show anything the next thing to look at is work load. Look for things like wide gets on wide rows, long lived rows with many deletes. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 8/01/2013,

Re: help turning compaction..hours of run to get 0% compaction....

2013-01-07 Thread aaron morton
Take a look at iostat -x 5 to see if your disks are dogging it. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 8/01/2013, at 9:13 AM, Michael Kjellman wrote: > Size tiered or leveled compaction? > > Fr

Re: inconsistent hadoop/cassandra results

2013-01-08 Thread aaron morton
Assuming their were no further writes, running repair or using CL all should have fixed it. Can you describe the inconsistency between runs? Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 8/01/2013, at 2:16 AM

Re: The solution of the write-in load of Cassandra?

2013-01-08 Thread aaron morton
probably block the writes. > Although the design of a resource is important, isn't there any method of > perceiving a process down beforehand? Not sure what you mean here. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thel

Re: Cassandra counters replication uses more traffic than client increments?

2013-01-08 Thread aaron morton
payload. This is the same as messages that go between nodes within the same DC. >> - Is there anything that can be done to reduce cross-DC replication >> traffic? Perhaps some compression scheme? fixed in 1.2 https://issues.apache.org/jira/browse/CASSANDRA-3127?attachmentOrder=desc C

Re: Helenos 1.3 released

2013-01-08 Thread aaron morton
I was going to say update the Wiki, but it's already there. Thanks for contributing. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 9/01/2013, at 1:02 AM, Tomek Kuprowski wrote: > Dear all, > &g

Re: How long does it take for a write to actually happen?

2013-01-08 Thread aaron morton
storm-project.net/ and register for this talk from a Brian O'Neill one of my fellow Data Stax MVP's http://learn.datastax.com/WebinarCEPDistributedProcessingonCassandrawithStorm_Registration.html Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmor

Re: Date Index?

2013-01-08 Thread aaron morton
x27;s to 100's millions of things in the same month you may want to do some performance testing. There can still be times when you want to support common read paths by using custom / hand rolled indexes. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronm

Re: JIRA for native IAuthorizer and IAuthenticator ?

2013-01-09 Thread aaron morton
Do these help? https://issues.apache.org/jira/browse/CASSANDRA-4874 https://issues.apache.org/jira/browse/CASSANDRA-4875 Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 9/01/2013, at 1:21 PM, Frank Hsueh wrote: >

Re: How long does it take for a write to actually happen?

2013-01-09 Thread aaron morton
And by default in CQL 3 the timestamp is generated server side. There is an option to provide them client side however. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 10/01/2013, at 3:32 AM, Vegard Berget wrote

Re: change cluster name retaining keypsace

2013-01-09 Thread aaron morton
must have the same name. By only deleting the LocationInfo CF your schema will be preserved. You do not have to move / delete any of the user data. Hope that helps. - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 10/01/2013

Re: remote datacentre consistency

2013-01-09 Thread aaron morton
y will fail. Hope that helps. - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 10/01/2013, at 11:40 AM, Jabbar

Re: Pagination over row Keys in Cassandra using Kundera/CQL queries

2013-01-09 Thread aaron morton
Try this http://wiki.apache.org/cassandra/FAQ#iter_world Take a look at the code examples it points to. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 10/01/2013, at 11:55 AM, Snehal Nagmote wrote: > Hello

Re: change cluster name retaining keypsace

2013-01-10 Thread aaron morton
> I think Arron meant /var/lib/cassandra (by default) Yup, sorry. A ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 10/01/2013, at 4:38 PM, Michael Kjellman wrote: > I think Arron meant /var/lib/cassandra (by d

Re: How long does it take for a write to actually happen?

2013-01-10 Thread aaron morton
be using thrift, and if you are not setting the timestamp the client will be doing it for you. In either case it's always good to have the clocks as syncronised as possible. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle

Re: Collecting of tombstones columns during read query fills up heap

2013-01-10 Thread aaron morton
Then migrate the data from the old rows to the new one and remove the old row. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 11/01/2013, at 12:37 AM, André Cruz wrote: > Hello. > > I have a schema to repr

Re: inconsistent hadoop/cassandra results

2013-01-10 Thread aaron morton
tremendous amount of experience. But this is the first time I've tried to > use the > wide-row support, which makes me a little suspicious. The wide-row support is > not > very well documented, so maybe I'm doing something wrong there in ignorance. > > Brian > >

Re: Wide rows in CQL 3

2013-01-10 Thread aaron morton
> Is this possible without using multiple rows in CQL3 non compact tables? Depending on the number of (log record) keys you *could* do this as a map type in your CQL Table. create table log_row ( sequence timestamp, props map ) Cheers ----- Aaron Morton Freelance Cassan

Re: How many BATCH inserts in to many?

2013-01-13 Thread aaron morton
- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 14/01/2013, at 12:56 AM, Radim Kolar wrote: > do not use cassandra for implementing queueing system with high throughput. > It does not scale because of tombstone managemen

Re: Cassandra 1.2, wide row and secondary index question

2013-01-14 Thread aaron morton
overhead? Cheers A - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 15/01/2013, at 6:56 AM, Sylvain Lebresne wrote: > On Mon, Jan 14, 2013 at 5:04 PM, Shahryar Sedghi wrote: > Can I always count on this order, or it may

Re: change cluster name retaining keypsace

2013-01-14 Thread aaron morton
That looks technically correct for pre 1.2, in 1.2 the name of the column has changed to cluster_name. Note that you are diving into internals and that way be danger. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com

Re: Starting Cassandra

2013-01-14 Thread aaron morton
--set java /usr/lib/jvm/java-6-sun/jre/bin/java Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 11/01/2013, at 10:55 PM, "Sloot, Hans-Peter" wrote: > Hi, > I removed the open-jdk packages which caused

Re: Pagination over row Keys in Cassandra using Kundera/CQL queries

2013-01-14 Thread aaron morton
way to achieve this in cql or jpa query language? > > Thanks, > Snehal > > On 9 January 2013 16:28, aaron morton wrote: > Try this http://wiki.apache.org/cassandra/FAQ#iter_world > > Take a look at the code examples it points to. > > Cheers > > ---

Re: Collecting of tombstones columns during read query fills up heap

2013-01-14 Thread aaron morton
t; written otherwise I could lose some updates. I think you can do it without synchronisation or ZK. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 11/01/2013, at 12:10 PM, André Cruz wrote: > On Jan 10, 2013, at

Re: Cassandra 1.2 thrift migration

2013-01-16 Thread aaron morton
> Any idea whether interoperability b/w Thrift and CQL should work properly in > 1.2? AFAIK the only incompatibility is CQL 3 between pre 1.2 and 1.2. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 16/01/2013

Re: error when creating column family using cql3 and persisting data using thrift

2013-01-16 Thread aaron morton
The thrift request is not sending a composite type where it should. CQL 3 uses composites in a lot of places. What was your table definition? Are you using a high level client or rolling your own? Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton

Re: write count increase after 1.2 update

2013-01-16 Thread aaron morton
ed by wide reads ? Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 16/01/2013, at 6:23 AM, Reik Schatz wrote: > Hi, we are running a 1.1.6 (datastax) test cluster with 6 nodes. After the > recent 1.2 release

Re: Astyanax returns empty row

2013-01-16 Thread aaron morton
If you think you have located a bug in Astyanax please submit it to https://github.com/Netflix/astyanax Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 17/01/2013, at 3:44 AM, Sávio Teles wrote: > We have multi

Re: Cassandra timeout whereas it is not much busy

2013-01-16 Thread aaron morton
round the switch lock. Trying reducing the commitlog_segment_size_in_mb so that less CF's are flushed. Hope that helps - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 17/01/2013, at 10:30 AM, Nicolas Lalevée wrote: >

Re: LCS not removing rows with all TTL expired columns

2013-01-16 Thread aaron morton
lso interested to know if LCS helps. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 17/01/2013, at 2:55 PM, Bryan Talbot wrote: > According to the timestamps (see original post) the SSTable was written

Re: error when creating column family using cql3 and persisting data using thrift

2013-01-17 Thread aaron morton
> and thrift operation code :- You life will be a lot easier if you use one of the many find Java Cassandra clients such as https://github.com/Netflix/astyanax or https://github.com/hector-client/hector. They know how to talk to C* Cheers ----- Aaron Morton Freelance Cassan

Re: read path, I have missed something

2013-01-17 Thread aaron morton
When a digest mis match happens the read has to be run again, and that takes time. You should continue to use nodetool repair on each node once every gc_grace_seconds to ensure tombstones are distributed. Cheers ----- Aaron Morton nodetool Freelance Cassandra Developer New Zealand

Re: write count increase after 1.2 update

2013-01-17 Thread aaron morton
> Semi-lame post to this mailing list i guess :( I should have checked that > earlier No problems. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 17/01/2013, at 11:50 PM, Reik Schatz wrote: > Cool featur

Re: Pig / Map Reduce on Cassandra

2013-01-18 Thread aaron morton
anax Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 18/01/2013, at 7:48 AM, James Lyons wrote: > Silly question -- but does hive/pig hadoop etc work with cassandra > 1.1.8? Or only with 1.2? We are using astyanax li

Re: Efficiency between SimpleStrategy and NetworkTopologyStrategy

2013-01-20 Thread aaron morton
Use the NetworkTopologyStrategy, it's the default and it saves a lot of trouble later. There is no real performance difference between NTS and SS. The NTS uses the information provided by the snitch, it does not perform any network access. Cheers - Aaron Morton Free

Re: Cassandra Performance Benchmarking.

2013-01-21 Thread aaron morton
or wait times. If the proxyhistograms is showing most requests running faster than your app says it's your app. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 19/01/2013, at 8:16 AM, Tyler Hobbs wrote:

Re: Cassandra pending compaction tasks keeps increasing

2013-01-21 Thread aaron morton
that resets each time you read from it. Also, parallel levelled compaction in 1.2 http://www.datastax.com/dev/blog/performance-improvements-in-cassandra-1-2 Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 20/01/201

Re: Cassandra timeout whereas it is not much busy

2013-01-22 Thread aaron morton
of CPU time. If you are logging a log of GC events you should look into it. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 22/01/2013, at 3:28 AM, Nicolas Lalevée wrote: > Le 17 janv. 2013 à 05:00, aaron m

Re: Concurrent write performance

2013-01-22 Thread aaron morton
rry about sorting. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 22/01/2013, at 4:40 AM, Viktor Jevdokimov wrote: > Do you experience any performance problems? > > This will be the last thin

Re: sstable2json had random behavior

2013-01-22 Thread aaron morton
William, If the solution from Binh works for you can you please submit a ticket to https://issues.apache.org/jira/browse/CASSANDRA The error message could be better if that is the case. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand

Re: node down = log explosion?

2013-01-22 Thread aaron morton
On the subject of bug report -- I probably will -- but I'll wait a bit for perhaps the excessive logging could be handled better, please add a ticket when you have time. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.co

Re: Cassandra pending compaction tasks keeps increasing

2013-01-23 Thread aaron morton
The histogram does not look right to me, too many SSTables for an LCS CF. It's a symptom no a cause. If LCS is catching up though it should be more like the distribution in the linked article. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronm

Re: node down = log explosion?

2013-01-23 Thread aaron morton
gt; - Does that mean I'll have to run at least 4 nodes in each DC? (3 for RF:3 > and one additional in case one fails) 3 nodes and RF 3 is ok. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 23/01/2013, at 8:3

Re: Unavaible Exception with Chunked Object Store

2013-01-23 Thread aaron morton
ing CL QUOURM you need at least 2 nodes to be up. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 24/01/2013, at 12:43 AM, Sávio Teles wrote: > We are using ChunkedStorage described in > https://github.co

Re: Large commit log reasons

2013-01-23 Thread aaron morton
need to? > 3- Does my commit log decrease as much as my sstable increases? Is it a rule? No. The commit log is all writes, the memtables and the sstables are the "latest" writes for the columns. Cheers - Aaron Morton Freelance Cassandra Develop

Re: trouble setting up initial cluster: Host ID collision between active endpoint

2013-01-24 Thread aaron morton
re better off using your laptop than micro instances. For playing around try m1.large and terminate them when not in use. To make life easier use this to make the cluster for you http://www.datastax.com/docs/1.2/install/install_ami Cheers ----- Aaron Morton Freelance Cassandra Deve

Re: Perfroming simple CQL Query using pyhton db-api 2.0 fails

2013-01-24 Thread aaron morton
How did you create the table? Anyways that looks like a bug, I *think* they should go here http://code.google.com/a/apache-extras.org/p/cassandra-dbapi2/issues/list Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On

Re: Issues with CQLSH in Cassandra 1.2

2013-01-24 Thread aaron morton
Can you provide details of the snitch configuration and the number of nodes you have? Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 25/01/2013, at 9:39 AM, Gabriel Ciuloaica wrote: > Hi Tyler, > > N

Re: Issue when deleting Cassandra rowKeys.

2013-01-27 Thread aaron morton
Deletes must be written to disk otherwise they are lost. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 28/01/2013, at 3:29 AM, Kasun Weranga wrote: > Hi, > > After running compaction tombstones get re

Re: why set replica placement strategy at keyspace level ?

2013-01-28 Thread aaron morton
The row is the unit of replication, all values with the same storage engine row key in a KS are on the same nodes. if they were per CF this would not hold. Not that it would be the end of the world, but that is the first thing that comes to mind. Cheers - Aaron Morton

Re: Does setstreamthroughput also throttle the network traffic caused by nodetool repair?

2013-01-28 Thread aaron morton
> Will that throttle the network traffic caused by nodetool repair? yes. > Should I call it to all the nodes on the cluster? Or set it in the yaml file. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 25/0

Re: why set replica placement strategy at keyspace level ?

2013-01-28 Thread aaron morton
mutations. So if you have RS per CF you lose atomic commits for writes to the same row. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 28/01/2013, at 11:22 PM, Manu Zhang wrote: > On Mon 28 Jan 2013 04:42:

Re: Node selection when both partition key and secondary index field constrained?

2013-01-28 Thread aaron morton
ds keys that are outside of the token range. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 28/01/2013, at 4:24 PM, Mike Sample wrote: > Does the following FAQ entry hold even when the partion key is a

Re: Issues with CQLSH in Cassandra 1.2

2013-01-28 Thread aaron morton
see if it's a bug. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 25/01/2013, at 5:35 PM, Gabriel Ciuloaica wrote: > Hi Aaron, > > I'm using PropertyFileSnitch, an my cassandra-topology.propertis

Re: data not shown up after some time

2013-01-28 Thread aaron morton
If you are seeing failed secondary index reads you may be seeing this https://issues.apache.org/jira/browse/CASSANDRA-5079 Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 29/01/2013, at 3:31 AM, Matthias Zeilinger

Re: Cassandra timeout whereas it is not much busy

2013-01-28 Thread aaron morton
commit log or snapshot etc) is waiting. See the comments for memtable_flush_queue_size in the yaml file. If you increase the value you will flush more frequently as C* leaves for memory to handle the case where the queue is full. If you have spare IO you could consider increasing memtable_fl

Re: cluster issues

2013-01-28 Thread aaron morton
you using? If you have the property file snitch do all nodes have the same configuration ? There is a lot of sickness there. If possible I would scrub and start again. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 2

Re: JDBC, Select * Cql2 vs Cql3 problem ?

2013-01-28 Thread aaron morton
What is your table spec ? Do you have the full stack trace from the exception ? Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 29/01/2013, at 8:15 AM, Andy Cobley wrote: > I have the following code in my

Re: Cassandra pending compaction tasks keeps increasing

2013-01-28 Thread aaron morton
ing multithreaded_compaction ? Are you using Key Caches ? Have you tried disabling compaction_preheat_key_cache? Can you enabled DEBUG level logging and make them available ? Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.co

Re: why set replica placement strategy at keyspace level ?

2013-01-28 Thread aaron morton
single CF. This is the thing that is committed to the log, and then the changes in the ColumnFamilies are applied to each CF in an isolated way. > .(must have missed that several times in the > documentation). http://wiki.apache.org/cassandra/FAQ#batch_mutate_atomic Cheers -

Re: Problem on node join the ring

2013-01-28 Thread aaron morton
sing QUOURM / QUOURM you maybe getting inconsistent results now. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 29/01/2013, at 9:51 AM, Daning Wang wrote: > I add a new node to ring(version 1.1.6), after more than

Re: Understanding Virtual Nodes on Cassandra 1.2

2013-01-29 Thread aaron morton
inital_token startup param that takes a comma separated list of tokens for the node. There also appears to be support for the ordered partitions to generate random tokens. But you would still have the problem of having to balance your row keys around the token space. Cheers -----

Re: Cass returns Incorrect column data on writes during flushing

2013-01-29 Thread aaron morton
ot;B") returns "B" only > cfq.getKey("foo").withColumnSlice("A","B","C") returns "A","B" and "C" Can you replicate this using cassandra-cli or CQL ? Makes it clearer what's happening and removes any potential is

Re: data not shown up after some time

2013-01-29 Thread aaron morton
ut not via the secondary index ( in your example) then the index is broken. If you are on pre 1.1.9 try upgrading. cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 29/01/2013, at 8:19 PM, Matthias Zeilinger wrote: > Ho

Re: Cassandra pending compaction tasks keeps increasing

2013-01-29 Thread aaron morton
> * Will try it tomorrow. Do I need to restart server to change the log level? You can set it via JMX, and supposedly log4j is configured to watch the config file. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On

Re: ConfigHelper.setThriftContact() undefined in cassandra v1.2

2013-01-29 Thread aaron morton
in the source distribution. > his statement gives error and I am not able to figure out the replacement for > it: What is the error? Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 29/01/2013, at 9:37 PM, Te

<    1   2   3   4   5   6   7   8   9   10   >