sliced_buffer_size_in_kb

2012-07-07 Thread Deno Vichas
all, is it advisable to mess with sliced_buffer_size_in_kb. i normal take slice of a couple hundred columns that are 50-100K each. thanks, deno

node vs node latency

2012-07-06 Thread Deno Vichas
all, what would explain a huge different (12ms vs 0.1ms) in read latency from node to node. i've got a 4 node cluster w/ replication factor of 3 using hector. i'm seeing these numbers with nodetool cfstats. thx, deno

how big can you slice

2012-07-06 Thread Deno Vichas
all, are there any guidelines to how much you can slice. how does total payload size vs # of column affect performance? thanks, deno

Re: datastax aws ami

2012-07-05 Thread Deno Vichas
install, start one node at a time. thanks, deno On 7/4/2012 3:18 AM, aaron morton wrote: Try the data stax forums http://www.datastax.com/support-forums/ Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 3/07/2012, at 7:28 AM, Deno Vichas

Re: hector timeouts

2012-07-02 Thread Deno Vichas
erver side or client side timeouts. Then determine what the query was. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 29/06/2012, at 7:02 AM, Deno Vichas wrote: On 6/28/2012 9:37 AM, David Leimbach wrote: That coupled with Hector ti

Re: faillout from AWS outage - HELP

2012-07-02 Thread Deno Vichas
m%d%H%M%C%y.%S"`; date; mvg Joost On Mon, Jul 2, 2012 at 5:43 PM, Deno Vichas wrote: all, my 4 node cluster seems pretty screwed up after the AWS outage. we found all our machines with their cpu stuck at 100%. so i went to restart each cassandra node one by one. i did node with token

Re: datastax aws ami

2012-07-02 Thread Deno Vichas
is the 2.1 image still around? On 7/2/2012 11:24 AM, Deno Vichas wrote: all, i've got a datastax 2.1 ami instance that's screwed up. for some reason it won't read the config file. what's the recommended way to replace this node with a new one? it doesn't seem lik

Re: Node won't start (faillout from AWS outage) - HELP

2012-07-02 Thread Deno Vichas
nding definition in the Config class. Typically caused by a version mismatch in my experience. On Jul 2, 2012, at 1:20 PM, Robin Verlangen wrote: Your missing the "sliced_buffer_size_in_kb" property in your cassandra.yaml file. 2012/7/2 Deno Vichas mailto:d...@syncopated.net>>

datastax aws ami

2012-07-02 Thread Deno Vichas
all, i've got a datastax 2.1 ami instance that's screwed up. for some reason it won't read the config file. what's the recommended way to replace this node with a new one? it doesn't seem like you can use the ami to bring up single nodes as it want to do whole clusters. thanks, deno

Re: Node won't start (faillout from AWS outage) - HELP

2012-07-02 Thread Deno Vichas
does not have a corresponding definition in the Config class. Typically caused by a version mismatch in my experience. On Jul 2, 2012, at 1:20 PM, Robin Verlangen wrote: Your missing the "sliced_buffer_size_in_kb" property in your cassandra.yaml file. 2012/7/2 Deno Vichas mailto:d...

Re: Node won't start (faillout from AWS outage) - HELP

2012-07-02 Thread Deno Vichas
no, it's there... after editing the first couple lines of the config file there spot where it complains changes. On 7/2/2012 10:20 AM, Robin Verlangen wrote: Your missing the "sliced_buffer_size_in_kb" property in your cassandra.yaml file. 2012/7/2 Deno Vichas mailto:d...

Re: Node won't start (faillout from AWS outage) - HELP

2012-07-02 Thread Deno Vichas
onstructor$ConstructMapping.getProperty(Constructor.java:342) at org.yaml.snakeyaml.constructor.Constructor$ConstructMapping.constructJavaBean2ndStep(Constructor.java:240) ... 16 more On 7/2/2012 9:00 AM, Deno Vichas wrote: the node that doesn't want to start just spit out -

Re: faillout from AWS outage - HELP

2012-07-02 Thread Deno Vichas
eature set. / On 7/2/2012 8:43 AM, Deno Vichas wrote: all, my 4 node cluster seems pretty screwed up after the AWS outage. we found all our machines with their cpu stuck at 100%. so i went to restart each cassandra node one by one. i did node with token id 0 first. i came back but doesn'

faillout from AWS outage - HELP

2012-07-02 Thread Deno Vichas
all, my 4 node cluster seems pretty screwed up after the AWS outage. we found all our machines with their cpu stuck at 100%. so i went to restart each cassandra node one by one. i did node with token id 0 first. i came back but doesn't look like it doing anything. once i thought it was u

Re: hector timeouts

2012-06-28 Thread Deno Vichas
On 6/28/2012 9:37 AM, David Leimbach wrote: That coupled with Hector timeout issues became a real problem for us. could you share some details on this? we're using hector and we see random timeout warns in the logs and not sure how to address them. thanks, deno

cassandra queue

2012-06-27 Thread Deno Vichas
does anybody have experience with these projects? https://github.com/btoddb/cassandra-queue https://github.com/btoddb/cassandra-queue-spring thanks, deno

Re: unknown exception with hector

2012-05-24 Thread Deno Vichas
heers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 24/05/2012, at 5:52 PM, Deno Vichas wrote: i've notice the my nodes seem to have a large (?, not really sure what acceptable numbers are) read dropped count from tpstats. could they be relat

Re: unknown exception with hector

2012-05-23 Thread Deno Vichas
.java:132) Looks like the client is not using framed transport. The server defaults to framed. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 23/05/2012, at 5:35 AM, Deno Vichas wrote: could somebody clue me in to the cause of this exce

Re: Using EC2 ephemeral 4disk raid0 cause high iowait trouble

2012-05-22 Thread Deno Vichas
for what it's worth i've been having pretty good success using the Datastax AMIs. On 5/17/2012 6:59 PM, koji Lin wrote: Hi We use amazon ami 3.2.12-3.2.4.amzn1.x86_64 and some of our data file are more than 10G thanks koji 2012-5-16 下午6:00 於 "aaron morton"

unknown exception with hector

2012-05-22 Thread Deno Vichas
could somebody clue me in to the cause of this exception? i see these randomly. AnalyzerService-2 2012-05-22 13:28:00,385 :: WARN cassandra.connection.HConnectionManager - Exception: me.prettyprint.hector.api.exceptions.HectorTransportException: org.apache.thrift.transport.TTransportExcepti

Re: Taking a Cluster Wide Snapshot

2012-04-26 Thread Deno Vichas
-------- *From:* Deno Vichas [d...@syncopated.net] *Sent:* Thursday, April 26, 2012 12:09 PM *To:* user@cassandra.apache.org *Subject:* Re: Taking a Cluster Wide Snapshot On 4/25/2012 11:34 PM, Shubham Srivastava wrote: Whats the best way(or the only way) to take a cluster wide backup

Re: Taking a Cluster Wide Snapshot

2012-04-25 Thread Deno Vichas
On 4/25/2012 11:34 PM, Shubham Srivastava wrote: Whats the best way(or the only way) to take a cluster wide backup of Cassandra. Cant find much of the documentation on the same. I am using a MultiDC setup with cassandra 0.8.6. Regards, Shubham here's how i'm doing in AWS land using the DataS

Re: EC2 Best Practices

2012-04-25 Thread Deno Vichas
has anybody written up anything related to recovery for fails in EC2? this morning i woke up to find 1 (of 4) nodes marked as unreachable. i used the datastax (1.0.7) ami to set up my cluster and the node that fail had the token id of 0 (this is the seed node - right?). the docs says to repl

Re: multi region EC2

2012-03-26 Thread Deno Vichas
On 3/26/2012 2:15 PM, aaron morton wrote: - can i migrate the replication strategy one node at a time or do i need to shut to the whole cluster to do this? Just use the NTS from the start. but what if i already have a bunch (8g per node) data that i need and i don't have a way to re-create it.

copy data for dev

2012-03-26 Thread Deno Vichas
all, is there a easy way to take a 4 node snapshot and restore it on my single node dev cluster? thanks, deno

multi region EC2

2012-03-26 Thread Deno Vichas
all, we just about ready to push our app live and just have some cassandra tuning left. i've been currently running a 4 node (rep factor 3, simple) in EC2 using the datastax AMIs (thanks datastax). so after reading through a bunch of docs i have a few questions. - what is the min and reco

insert performance

2012-02-22 Thread Deno Vichas
all, would i be better off (i'm in java land) with spawning a bunch of threads that all add a single item to a mutator or a single thread that adds a bunch of items to a mutator? thanks, deno

Re: problem with sliceQuery with composite column

2012-02-16 Thread Deno Vichas
he first time. i can get a range of types. thanks, On 2/16/2012 6:13 PM, Deno Vichas wrote: On 2/16/2012 12:46 AM, aaron morton wrote: split this CF into two? Or change the order of the column components as suggested. as suggested - where? are you saying if the flip the composite i

Re: problem with sliceQuery with composite column

2012-02-16 Thread Deno Vichas
cks:1 ticks:2 ticks:3 quotes:1 quotes:2 quotes:3 thanks, deno On 16/02/2012, at 9:16 PM, Deno Vichas wrote: thanks for the reply. i understand why, but it still seem a bit strange coming from years and years of sql. so if i want to avoid the extra load from fetching way more than i needed

Re: problem with sliceQuery with composite column

2012-02-16 Thread Deno Vichas
and end at 444:ticks you are asking for all the column in between. it is not possible to filter at each level of a composite column. Hope that helps. - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 10/02/2012, at 10:58 PM, Deno Vichas wrote: all

problem with sliceQuery with composite column

2012-02-10 Thread Deno Vichas
all, could somebody clue me to why the below code doesn't work. my schema is; create column family StockHistory with comparator = 'CompositeType(LongType,UTF8Type)' and default_validation_class = 'UTF8Type' and key_validation_class = 'UTF8Type'; the time part works but i'm gettin

Re: data model with composite columns

2012-02-02 Thread Deno Vichas
Freelance Developer @aaronmorton http://www.thelastpickle.com On 3/02/2012, at 10:25 AM, Deno Vichas wrote: hey all! i have a CF that has ~10 columns in it and now i'm finding the need to use composite column names. can you, or should mix and match composite and non-composite column names i

data model with composite columns

2012-02-02 Thread Deno Vichas
hey all! i have a CF that has ~10 columns in it and now i'm finding the need to use composite column names. can you, or should mix and match composite and non-composite column names in the same CF? if you can/should how does sorting work with a single comparator? thanks, deno

Re: is there a "no disk storage" mode ?

2011-12-01 Thread Deno Vichas
if you're in java land there's a maven plugin - http://mojo.codehaus.org/cassandra-maven-plugin/ On 12/1/2011 12:13 PM, Tom van den Berge wrote: Hi Dominique, I don't think there is a way to run cassandra without disk storage. But running it embedded can be very useful for unit testing. I'm

Re: data modeling question

2011-11-30 Thread Deno Vichas
o columns returned, then you need to re-pull for that symbol. Does that make sense? Either way you end up hitting on each of the individual symbols. Maybe someone else has a better idea of how to structure the data for that particular use case. On Wed, Nov 30, 2011 at 3:45 PM, Deno Vichas &

Re: data modeling question

2011-11-30 Thread Deno Vichas
with the quote CF below how would one query for all keys that have a column name value that have a timeuuid of later than x minutes? i need to be able to find all symbols that have not been fetch in x minutes by sector. i know i get list of symbol by sector from my sector CF. thanks, deno O

data modeling question

2011-11-30 Thread Deno Vichas
hey all! i'm started my first project using cassandra and some data model questions. i'm working on an app that fetches stock market data. i need to keep track of when i fetch a set of data for any given stock in any sector; here's what i think my model should look like; fetches : { : {