Re: how to access data only on specific node

2013-05-14 Thread Sergey Naumov
see that RR works, but sometimes number of records have been read degrades. RR is enabled on a random 10% of requests, see the read_repair_chance setting for the CF. OK, but I forgot to mention the main thing - each node in my config is a standalone datacenter and distribution is DC1:1, DC2:1, DC

[no subject]

2013-05-14 Thread bjbylh
hello all: i use datastax java-driver to connect c* ,when the program calls cluster.shutdown(),it prints out:java.lang.NoSuchMethodError:org.jboss.netty.channelFactory.shutdown()V. but i do not kown why... c* is 1.2.4,java-driver is 1.0.0 thank you. Sent from Samsung Mobile

Re: Upgrade from 1.0.11 to 1.2.X

2013-05-14 Thread Roshan
Thanks Aaron for the reply. I will need to upgrade 1.0.X to 1.1.X first. -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Upgrade-from-1-0-11-to-1-2-X-tp7587786p7587825.html Sent from the cassandra-u...@incubator.apache.org mailing list archive a

Re: Upgrade from 1.0.11 to 1.2.X

2013-05-14 Thread Roshan
Thanks for your short answer. It explains lot. -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Upgrade-from-1-0-11-to-1-2-X-tp7587786p7587824.html Sent from the cassandra-u...@incubator.apache.org mailing list archive at Nabble.com.

Exception when running YCSB and Cassandra

2013-05-14 Thread Rodrigo Felix
Hi, I'm executing a workload on YCSB (50% read, 50% update) and after few minutes I get the following exception: *TimedOutException()* * at org.apache.cassandra.thrift.Cassandra$get_slice_result.read(Cassandra.java:7174) * * at org.apache.cassandra.thrift.Cassandra$Client.recv_get_slice(Cassan

Re: Upgrade from 1.0.11 to 1.2.X

2013-05-14 Thread aaron morton
Also *always* read the NEWS.TXT file with the release. Cheers - Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 15/05/2013, at 2:57 AM, Edward Capriolo wrote: > Your not supposed to skip minor versions on upgrade. > 1.0 -

Re: cassandra batch mutator

2013-05-14 Thread aaron morton
Start with the help for a client, pycassa has good documentation http://pycassa.github.io/pycassa/ Cheers - Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 15/05/2013, at 2:04 AM, Chandana Tummala wrote: > Hi Team, > > can

Re: The action of the file system at drop column family execution

2013-05-14 Thread aaron morton
> * Although a directory (column family:testcf1) remains, is it satisfactory on > a file system? A snapshot is taken when a truncate or drop command is run. You should see a $KS/$CF/snapshots directory. Cheers - Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmo

Re: create family but not sync

2013-05-14 Thread aaron morton
What version are you using ? Did the other node log an error ? Cheers - Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 14/05/2013, at 11:36 PM, Heclei wrote: > hi , i new in cassandra. I have a problem with create column

Re: how to access data only on specific node

2013-05-14 Thread aaron morton
> see that RR works, but sometimes number of records have been read degrades. RR is enabled on a random 10% of requests, see the read_repair_chance setting for the CF. > If so, then the question is: how to perform local reads to examine content > of specific node? You can check which nodes ar

Re: (better info)any way to get the #writes/second, reads per second

2013-05-14 Thread Hiller, Dean
Yes, we finally got to the bottom of it. There was some code in our web tier so although our client load had not changed, the webtier was reading a lot more than usual. It was a good experience still to debug something like this and get to the bottom of it. Always seem to be learning a new co

Re: CQL3 Question

2013-05-14 Thread aaron morton
> This is also my first post here :). Cool. +1 for what you said. You can access CQL 3 tables via thrift, see http://thelastpickle.com/2013/01/11/primary-keys-in-cql/ In general through I would not recommend mixing the two techniques for the same table / CF. Cheers - Aaron M

Re: (better info)any way to get the #writes/second, reads per second

2013-05-14 Thread aaron morton
> Any reason why cassandra might be reading a lot from the data disks(not > the commit log disk) more than usual? On the new node or all nodes ? Maybe cold Key Cache or cold memmapped files due to a change in the data distribution ? Did it settle down ? Cheers - Aaron Morto

Re: how-to scan a table using CQL3

2013-05-14 Thread aaron morton
> select rowkey from my_table limit N; > while some_row_is_returned do > select rowkey from my_table where token(rowkey) > > token(last_rowkey_returned) limit N; That should work for you. See http://www.datastax.com/docs/1.2/cql_cli/using/paging#non-ordered-partitioner-paging Cheers -

Re: Iterating through large numbers of rows with JDBC

2013-05-14 Thread David McNelis
Another thing to keep in mind when doing this with CQL is to take into account the ordering partitioner you may or may not be using. If you're using one you'll need to make sure that if you have a larger number of rows for the partitioner key than your query limit, then you can end up in a situati

Re: Iterating through large numbers of rows with JDBC

2013-05-14 Thread aaron morton
You can iterate over them, just make sure to set a sensible row count to chunk things up. See http://www.datastax.com/docs/1.2/cql_cli/using/paging#non-ordered-partitioner-paging You can also break up the processing so only one worker reads the token ranges for a node. That allows you to proce

Re: FileNotFound after programmatic create/drop

2013-05-14 Thread aaron morton
>I am using C* 1.2.4 with Vnodes and am getting the following error when > attempting to fetch some keys in a CQL2 table Can you use CQL 3? If you can reproduce this please raise a ticket on https://issues.apache.org/jira/browse/CASSANDRA Cheers - Aaron Morton Freelance Cas

Re:

2013-05-14 Thread aaron morton
It's a tricky thing to get right. Do you have wide rows ? Try enabling the GC logging in cassandra-env.sh. You may want to try changing: JVM_OPTS="$JVM_OPTS -XX:SurvivorRatio=4" JVM_OPTS="$JVM_OPTS -XX:MaxTenuringThreshold=4" This will slow down objects being promoted to the tenured heap,

Re: pycassa fails to write values larger than one-tenth thrift_framed_transport_size_in_mb, defaults to 15MB --> 1.5MB limit on values !?

2013-05-14 Thread aaron morton
> 2013-05-10 16:09:13,250 10441:69: adding > UUID('d8a31630-3b90-46d0-9e34-1b7638044c62') with 1.50 MB > 2013-05-10 16:09:13,250 10441:69: adding > UUID('ba14b6fc-f9ed-4d33-b64d-d705f405ad22') with 1.50 MB > 2013-05-10 16:09:13,250 10441:69: adding > UUID('0b08d080-ec72-4f6e-b4a1-1227b8e

Re: (unofficial) Community Poll for Production Operators : Repair

2013-05-14 Thread Wei Zhu
1) 1.1.6 on 5 nodes, 24CPU, 72 RAM 2) local quorum (we only have one DC though). We do delete through TTL 3) yes 4) once a week rolling repairs -pr using cron job 5) it definitely has negative impact on the performance. Our data size is around 100G per node and during repair it brings in addit

Re: any way to get the #writes/second, reads per second

2013-05-14 Thread Wei Zhu
We have a long running script which wakes up every minute to get reads/writes through JMX. It does the calculation to get r/s and w/s and send them to ganglia. We are thinking of using graphite which comes with some sort of intelligence mentioned by Tomàs, but it's just too big of a change for o

Re: Upgrade from 1.0.11 to 1.2.X

2013-05-14 Thread Edward Capriolo
Your not supposed to skip minor versions on upgrade. 1.0 -> 1.2 = bad 1.0 -> 1.1 -> 1.2 = good On Tue, May 14, 2013 at 3:07 AM, Roshan wrote: > While upgrading from 1.0.11 to 1.2.4, I saw this exception in my log. > > 2013-05-14 10:50:10,291 ERROR [CassandraDaemon] Exception in thread > Thread

cassandra batch mutator

2013-05-14 Thread Chandana Tummala
Hi Team, can any one help me in cassandra batch mutator .i want to load data with batch mutator. is there any website to know about it perfectly. Thanks & Regards, Chandana Tummala. -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/cassandra-

RE: (unofficial) Community Poll for Production Operators : Repair

2013-05-14 Thread Viktor Jevdokimov
> 1) What version of Cassandra do you run, on what hardware? 1.0.12 (upgrade to 1.2.x is planned) Blade servers with 1x6 CPU cores with HT (12 vcores) (upgradable to 2x CPUs) 96GB RAM (upgrade is planned to 128GB, 256GB max) 1x300GB 15k Data and 1x300GB 10k CommitLog/System SAS HDDs > 2) Wha

The action of the file system at drop column family execution

2013-05-14 Thread hiroshi.kise.rk
Hi everyone. Although it may be a stupid question, please give me instruction. [1.Question] A column family is deleted (drop column family testcf1;). As the upper result (dir command execution), testcf1 0 File(s) 0 bytes 3 Dir(s) 139,587,596,288 bytes free

Re: (unofficial) Community Poll for Production Operators : Repair

2013-05-14 Thread Hiller, Dean
We had to roll out a fix in cassandra as a slow node was slowing down our clients of cassandra in 1.2.2 for some reason. Every time we had a slow node, we found out fast as performance degraded. We tested this in QA and had the same issue. This means a repair made that node slow which made ou

Re: Cassandra-cli longtype display

2013-05-14 Thread Heclei
try use ByteEncoderHelper.BigEndianLongEncoder.ToByteArray as key byte array 在 2013-5-13 PM7:08,"Leo.C.He (mis.sh04.Newegg) 41317" 写道: > Hi, I am new in Cassandra, I am using “Aquiles.Cassandra10” , but I > don’t know why longtype in cli like blow. > > can any one kown how to display real lon

Re: any way to get the #writes/second, reads per second

2013-05-14 Thread Hiller, Dean
Cool, thanks, Dean From: Tomàs Núnez mailto:tomas.nu...@groupalia.com>> Reply-To: "user@cassandra.apache.org" mailto:user@cassandra.apache.org>> Date: Tuesday, May 14, 2013 4:53 AM To: user mailto:user@cassandra.apache.org>> Subject: Re: any way to get the #write

create family but not sync

2013-05-14 Thread Heclei
hi , i new in cassandra. I have a problem with create column family in cassandra-cli. the column family has created successed, and with response scheme agree cross cluster. but the column family didn't sync to other server before restart other node. can anyone known this issue. Thanks

Re: any way to get the #writes/second, reads per second

2013-05-14 Thread Tomàs Núnez
Yes, there isn't any place in the JMX with reads/second or writes/second, just CompletedTasks. I send this info to Graphite ( http://graphite.wikidot.com/) and use the "derivative" function to get reads/minute. Munin also does the trick (https://github.com/tcurdt/jmx2munin). But you can't do that w

RE: Added column does not sort as the last column at

2013-05-14 Thread Sam Hodgson
Thanks for this Aaron - I eventually found some data corruption in the keys of the affected CF's which i think was causing the issue. > Subject: Re: Added column does not sort as the last column at > From: aa...@thelastpickle.com > Date: Thu, 11 Apr 2013 22:08:17 +1200 > To: user@cassandra.apache

how to access data only on specific node

2013-05-14 Thread Sergey Naumov
Hello. I'am playing with demo cassandra cluster and decided to test read repair + hinted handoff. One node of a cluster was put down deliberately, and on the other nodes I inserted some records (say 1000). HH is off on all nodes. Then I turned on the node, connected to it with cql (locally, so to

Re: Sudden increase in diskspace usage

2013-05-14 Thread Nicolai Gylling
On May 14, 2013, at 6:50 AM, aaron morton wrote: >> Let's say we're seing some bug in C*, and SSTables doesn't get deleted >> during compaction (which I guess is the only reason for this consumption of >> diskspace). > > Just out of interest can you check the number of SSTables reported by

Re: (unofficial) Community Poll for Production Operators : Repair

2013-05-14 Thread Alain RODRIGUEZ
Hi Rob, 1) 1.2.2 on 6 to 12 EC2 m1.xlarge 2) Quorum R&W . Almost no deletes (just some TTL) 3) Yes 4) On each node once a week (rolling repairs using crontab) 5) The only behavior that is quite odd or unexplained to me is why a repair doesn't fix a counter mismatch between 2 nodes. I mean when I r

Re: Upgrade from 1.0.11 to 1.2.X

2013-05-14 Thread Roshan
While upgrading from 1.0.11 to 1.2.4, I saw this exception in my log. 2013-05-14 10:50:10,291 ERROR [CassandraDaemon] Exception in thread Thread[MutationStage:17,5,main] java.lang.RuntimeException: java.lang.NullPointerException at org.apache.cassandra.service.StorageProxy$HintRunnable.run