Re: key cache size

2013-02-21 Thread aaron morton
This is the key cache entry https://github.com/apache/cassandra/blob/trunk/src/java/org/apache/cassandra/cache/KeyCacheKey.java Note that the Descriptor is re-used. If you want to see key cache metrics, including bytes used, use nodetool info. Cheers - Aaron Morton Freelance

Re: Read IO

2013-02-22 Thread aaron morton
AFAIk this is still roughly correct http://thelastpickle.com/2011/04/28/Forces-of-Write-and-Read/ It includes information on the page size read from disk. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 22/02/2013

Re: SSTable Num

2013-02-22 Thread aaron morton
t's working correctly as you have described it http://www.datastax.com/dev/blog/when-to-use-leveled-compaction Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 22/02/2013, at 6:39 AM, Kanwar Sangha wrote: >

Re: "Heap is N.N full." Immediately on startup

2013-02-22 Thread aaron morton
To get a good idea of how GC is performing turn on the GC logging in cassandra-env.sh. After a full cms GC event, see how big the tenured heap is. If it's not reducing enough then GC will never get far enough ahead. Cheers - Aaron Morton Freelance Cassandra Develope

Re: Mutation dropped

2013-02-22 Thread aaron morton
if the request throughput is at it's maximum for the cluster. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 22/02/2013, at 8:15 PM, Wei Zhu wrote: > Thanks Aaron for the great information as always

Re: Adding new nodes in a cluster with virtual nodes

2013-02-22 Thread aaron morton
em. Anytime you are worried about things like this throw in a nodetool repair. If you are using QUOURM for read and writes you will still be getting consistent data, so long as you have only added one node. Or one node every RF'th nodes. Cheers - Aaron Morton Freelan

Re: operations progress on DBA operations?

2013-02-22 Thread aaron morton
nodetool compactionstats Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 23/02/2013, at 3:44 AM, "Hiller, Dean" wrote: > I am used to systems running a first phase calculating how much files it will

Re: ReverseIndexExample

2013-02-22 Thread aaron morton
We are trying to answer client library specific questions on the client-dev list, see the link at the bottom here http://cassandra.apache.org/ If you can ask a more specific question I'll answer it there. Cheers - Aaron Morton Freelance Cassandra Developer New Ze

Re: disabling bloomfilter not working? or did I do this wrong?

2013-02-22 Thread aaron morton
> Bloom Filter Space Used: 2318392048 Just to be sane do a quick check of the -Filter.db files on disk for this CF. If they are very small try a restart on the node. > Number of Keys (estimate): 1249133696 Hey a billion rows on a node, what an age we live in :) Cheers -

Re: How wide rows are structured in CQL3

2013-02-22 Thread aaron morton
7;t understand some of the things like WITH COMPACT STORAGE and > CLUSTERING. Some info here, does not cover compact storage http://thelastpickle.com/2013/01/11/primary-keys-in-cql/ Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thela

Re: Q on schema migratins

2013-02-22 Thread aaron morton
in the cli. If they are in disagreement see this http://wiki.apache.org/cassandra/FAQ#schema_disagreement Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 23/02/2013, at 5:17 AM, Igor wrote: > Hello > >

Re: is there a way to drain node(and prevent reads) and upgrade sstables offline?

2013-02-22 Thread aaron morton
compaction throughput using nodetool >> multithreaded_compaction = true temporarily Unless you have SSD leave this guy alone. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 23/02/2013, at 6:04 AM, Michael Kjellman

Re: Size Tiered -> Leveled Compaction

2013-02-24 Thread aaron morton
6137 Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 23/02/2013, at 6:56 AM, Mike wrote: > Hello, > > Still doing research before we potentially move one of our column families > from Size Tiered->Leve

Re: found bottleneck but can we do these steps?

2013-02-24 Thread aaron morton
then run upgrade tables. Hope that helps, buck buck. ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 23/02/2013, at 9:56 AM, "Hiller, Dean" wrote: > So, it turns out we don't have enough I/o going on f

Re: disabling bloomfilter not working? or did I do this wrong?

2013-02-24 Thread aaron morton
tions.java Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 23/02/2013, at 12:10 PM, Bryan Talbot wrote: > I see from your read and write count that your nreldata CF has nearly equal > number of reads as writes.

Re: Mutation dropped

2013-02-24 Thread aaron morton
ot recommend using RF 2 and CL 1 unless you have a good understanding of how that affects your consistency and availability. If you are just starting out with cassandra, RF 3 and CL QUOURM is the best approach IMHO. Cheers ----- Aaron Morton Freelance Cassandra Developer

Re: How to read rows with composite keys in Hector?

2013-02-24 Thread aaron morton
For hector specific questions you may have bette luck at http://groups.google.com/group/hector-users Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 25/02/2013, at 4:47 AM, Mateus Ferreira e Freitas wrote: >

Re: Does Cassandra JDBC driver support result set fetching?

2013-02-24 Thread aaron morton
- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 25/02/2013, at 7:24 AM, Prabath Abeysekara wrote: > Hi, > > Does Cassandra JDBC driver support result set fetching? I did some background > research on the $su

Re: New CQL3 driver for Ruby

2013-02-24 Thread aaron morton
Thanks. I believe there is some effort towards creating a C lib for the native binary transport at apache con http://wiki.apache.org/apachecon/HackathonNA13 You could also ask on the developer list, someone will know. Cheers - Aaron Morton Freelance Cassandra Developer New

Re: Bulk Loading-Unable to select from CQL3 tables with NO "COMPACT STORAGE" option after Bulk Loading - Cassandra version 1.2.1

2013-02-26 Thread aaron morton
CQL 3 tables that do not use compact storage store use Composite Types , which other code may not be expecting. Take a look at the CQL 3 table definitions through cassandra-cli and you may see the changes you need to make when creating the SSTables. Cheers - Aaron Morton

Re: disabling bloomfilter not working? memory numbers don't add up?

2013-02-28 Thread aaron morton
lt;1meg. If this is the Heap memory reported by the JVM that all you can say is "since the server was started it has allocated at least 5.2 GB of memory" it's not "there is 5.2GB of live memory in use" Cheers - Aaron Morton Freelance Cassandra Developer New Z

Re: Retrieving local data

2013-02-28 Thread aaron morton
Take a look at the token function with the select statement http://www.datastax.com/docs/1.2/cql_cli/cql/SELECT Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 25/02/2013, at 10:06 AM, Everton Lima wrote: >

Re: cluster with cross data center and local

2013-02-28 Thread aaron morton
mple. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 25/02/2013, at 10:41 AM, Keith Wright wrote: > Hi all, > >I have a cluster with 2 data centers with an RF 2 keyspace using network > topology on 1.1.10.

Re: "Heap is N.N full." Immediately on startup

2013-02-28 Thread aaron morton
of 1-3seconds on nodes I have > not yet attended to I would look at the first. Search the user group for "correlate compaction gc" as a starting point. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com -

Re: please explain read path when key not in database

2013-02-28 Thread aaron morton
> This is my understanding from using cassandra for probably around 2 years Sounds about right. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 26/02/2013, at 7:43 AM, "Hiller, Dean" wrote:

Re: no backwards compatibility for thrift in 1.2.2? (we get utter failure)

2013-03-03 Thread aaron morton
Dean, Is this an issue with tables created using CQL 3 ? OR… An issue with tables created in 1.1.4 using the CLI not been readable after an in place upgrade to 1.2.2 ? I did a quick test and it worked. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand

Re: Select X amount of column families in a super column family in Cassandra using PHP?

2013-03-03 Thread aaron morton
heers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 2/03/2013, at 2:10 PM, Crocker Jordan wrote: > I'm using Kallaspriit's Cassandra/PHP library ( > https://github.com/kallaspriit/Cassandra-PHP-Client-Library). >

Re: Column Slice Query performance after deletions

2013-03-03 Thread aaron morton
ones from the problem. (Am guessing this is not something you do, just mentioning it). You next option is to change the data model so you don't use the same row all day. After that, consider a message queue. Cheers - Aaron Morton Freelance Cassandra Develope

Re: reading the updated values

2013-03-03 Thread aaron morton
> my question is how do i get the updated data in cassandra for last 1 hour or > so to be indexed in elasticsearch. You cannot. The best approach is to update elastic search at the same time you update cassandra. Cheers - Aaron Morton Freelance Cassandra Develop

Re: no backwards compatibility for thrift in 1.2.2? (we get utter failure)

2013-03-04 Thread aaron morton
ok, we are talking about all thrift / cli / hector / no CQL tables not been read after an upgrade. If you can get some repo steps that would be handy. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 4/03/2013, at

Re: Consistency level for system_auth keyspace

2013-03-04 Thread aaron morton
cluster wide, set of permissions. Using LOCAL or one could result in some requests that are rejected being allowed on other nodes. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 1/03/2013, at 6:40 AM, Jean-Armel

Re: Unable to instantiate cache provider org.apache.cassandra.cache.SerializingCacheProvider

2013-03-04 Thread aaron morton
What version are you using ? As of 1.1 off heap caches no longer require JNA https://github.com/apache/cassandra/blob/trunk/NEWS.txt#L327 Also the row and key caches are now set globally not per CF https://github.com/apache/cassandra/blob/trunk/NEWS.txt#L324 Cheers - Aaron

Re: backing up and restoring from only 1 replica?

2013-03-04 Thread aaron morton
That would be OK only if you never had node go down (e.g. a restart) or drop messages. It's not something I would consider trying. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 28/02/2013, at 3:21 PM, Mik

Re: Retrieving local data

2013-03-04 Thread aaron morton
Yes. You can get the token ranges via astynax and only ask for rows that are within the token ranges. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 28/02/2013, at 2:25 PM, Everton Lima wrote: > Ok aaron.

Re: Connection issues

2013-03-04 Thread aaron morton
Did you get this sorted ? Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 28/02/2013, at 2:25 AM, amulya rattan wrote: > I have set up cassandra on EC2 with default localhost settings. Everything > works fi

Re: Unable to instantiate cache provider org.apache.cassandra.cache.SerializingCacheProvider

2013-03-05 Thread aaron morton
Details are here https://issues.apache.org/jira/browse/CASSANDRA-3271 Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 4/03/2013, at 8:04 AM, Jason Wee wrote: > version 1.0.8 > > Just curious, what is the

Re: backing up and restoring from only 1 replica?

2013-03-05 Thread aaron morton
y. In specific cases it may not. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 4/03/2013, at 10:40 AM, Mike Koh wrote: > Thanks for the response. Could you elaborate more on the bad things that > happen during a

Re: anyone see this user-cassandra thread get answered...

2013-03-05 Thread aaron morton
Was probably this https://issues.apache.org/jira/browse/CASSANDRA-4597 Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 4/03/2013, at 2:05 PM, "Hiller, Dean" wrote: > I was reading > http://mail-arc

Re: Storage question

2013-03-05 Thread aaron morton
Check out the aforementioned astyanax and this http://www.datastax.com/dev/blog/cassandra-file-system-design Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 4/03/2013, at 1:38 PM, "Hiller, Dean" wrote: &g

Re: Consistent problem when solve Digest mismatch

2013-03-05 Thread aaron morton
orting-Lists-For-Humans/ Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 4/03/2013, at 4:30 PM, Jason Tang wrote: > Hi > > The timestamp provided by my client is unix timestamp (with ntp), and as I > sa

Re: hinted handoff disabling trade-offs

2013-03-05 Thread aaron morton
ure your data model is efficient, that you are doing the most efficient reads (see my presentation here http://www.datastax.com/events/cassandrasummit2012/presentations), and your caching is bang on. Then consider if you can tune the CL, and if your client is token aware so it directs traffic to

Re: Replacing dead node when num_tokens is used

2013-03-05 Thread aaron morton
AFAIK you just fire up the new one and let nature take it's course :) http://www.datastax.com/docs/1.2/operations/add_replace_nodes#replace-node i.e. you do not need to use -Dcassandra.replace_token. Hope that helps. - Aaron Morton Freelance Cassandra Developer New Ze

Re: old data / tombstones are not deleted after ttl

2013-03-05 Thread aaron morton
ssandra/db/compaction/CompactionManagerMBean.java#L67 Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 5/03/2013, at 1:52 AM, Michal Michalski wrote: > > I have read in the documentation, that after a major compa

Re: what size file for LCS is best for 300-500G per node?

2013-03-05 Thread aaron morton
Don't forget you can test things http://www.datastax.com/dev/blog/whats-new-in-cassandra-1-1-live-traffic-sampling Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 5/03/2013, at 7:37 AM, "Hiller, De

Re: *-ib-* files instead of *-he-* files?

2013-03-05 Thread aaron morton
another upgrade tables which will upgrade ALL the sstables for the CF. Or shut down the node, move the ib- files (keep the one with the highes number there) , start it without thrift and gossip, upgrade, shutdown, put the files back, restart. Cheers --------- Aaron Morton Freelance Cas

Re: anyone see this user-cassandra thread get answered...

2013-03-05 Thread aaron morton
bah, think I got confused by looking at the version in the email you linked to. if the update CF call is not working, and this is QA, run it with DEBUG logging and file a bug here https://issues.apache.org/jira/browse/CASSANDRA Thanks - Aaron Morton Freelance Cassandra

Re: any way to reset timestamp in cassandra to work around cassandra bug?

2013-03-05 Thread aaron morton
take a very good look at things first, and deleting the schema kind of sucks. Check the timestamps by looking at the CF's in the system key space. Turn on DEBUG logging when you do the schema migration and see the timestamp used in the update. Cheers ----- Aaron Morton

Re: Cassandra instead of memcached

2013-03-05 Thread aaron morton
disk. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 5/03/2013, at 9:51 AM, Drew Kutcharian wrote: > Thanks Ben, that article was actually the reason I started thinking about > removing memcached. > >

Re: Can I create a counter column family with many rows in 1.1.10?

2013-03-05 Thread aaron morton
Note that CQL 3 in 1.1 is compatible with CQL 3 in 1.2. Also you do not have to use CQL 3, you can still use the cassandra-cli to create CF's. The syntax you use to populate it depends on the client you are using. Cheers - Aaron Morton Freelance Cassandra Develope

Re: If I set 'listen_address' to 'localhost' I can't get Cassandra to broadcast on localhost

2013-10-31 Thread Aaron Morton
mmm, cassandra normally resolves the name to the IP address and binds to that. So it should just work if you are using localhost and that’s setup correctly. Can you just use 127.0.0.1 ? Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Ap

Re: Searching Cassandra

2013-10-31 Thread Aaron Morton
all of your data. Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 29/10/2013, at 10:27 am, Ari King wrote: > Hi, > > I've recently started with Cassandra I'm curious

Re: Too many open files with Cassandra 1.2.11

2013-10-31 Thread Aaron Morton
What’s in /etc/security/limits.conf ? and just for fun what does lsof -n | grep java | wc -l say ? Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 30/10/2013, at 12:21 am,

Re: Read repair

2013-10-31 Thread Aaron Morton
be involved in the read. Hope that helps. ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 30/10/2013, at 12:32 am, Baskar Duraikannu wrote: > Aaron > > Rack1 goes down and som

Re: CQL & selecting individual items from a map

2013-10-31 Thread Aaron Morton
r it https://issues.apache.org/jira/browse/CASSANDRA-5918?jql=labels%20%3D%20cql%20AND%20status%20in%20(Open%2C%20%22In%20Progress%22) May be a good idea to create one and request the feature. Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultan

Re: CF name length restrictions (CASSANDRA-4157 and CASSANDRA-4110)

2013-11-04 Thread Aaron Morton
ble file names. Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 1/11/2013, at 5:54 am, Peter Sanford wrote: > We're working on upgrading from 1.0.12 to 1.1.12. After upgrad

Re: Storage management during rapid growth

2013-11-04 Thread Aaron Morton
it will take to replace a node that completely fails. I’ve also seen people have a good time moving from SSD to 12 fast disks in a RAID10 config. You can mix HDD and SSD’s and have some hot CF’s on the SSD and others on the HDD. Hope that helps. - Aaron Morton New Zealand

Re: Heap almost full

2013-11-04 Thread Aaron Morton
s running on high performance 32-core, 128 GB RAM, 7 RAID-0 > 1TB disks (regular). With all those cores grab the TLAB setting from the 1.2 cassandra-env.sh file. Cheers --------- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassan

Re: How to generate tokens for my two node Cassandra cluster?

2013-11-04 Thread Aaron Morton
many nodes are in datacenter #1? 3 DC #1: Node #1:0 Node #2: 56713727820156410577229101238628035242 Node #3: 113427455640312821154458202477256070484 Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consul

Re: Not able to form a Cassandra cluster of two nodes in Windows?

2013-11-04 Thread Aaron Morton
ou are just starting put the simple thing is delete all the data and restart the machines. Hope that helps. - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 2/11/2013, at 6:02 am, Techy Te

Re: Cass 2.0.0: Extensive memory allocation when row_cache enabled

2013-11-06 Thread Aaron Morton
new heap may be too big depending on the number of cores. I would recommend trying 800M > prg01.visual.vm.png Shows the heap growing very quickly. This could be due to wide reads or a high write throughput. Hope that helps. - Aaron Morton New Zealand @aaronmorton Co

Re: CQL 'IN' predicate

2013-11-06 Thread Aaron Morton
and the number of nodes in low there is a chance the client starve others as they wait for all the tasks to be completed. So i tend to like asking for fewer rows. Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Con

Re: Config changes to leverage new hardware

2013-11-06 Thread Aaron Morton
mit log will work well with that many threads. May want to put the reads down as well. It’s easier to tune the system if you can provide some info on the workload. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting

Re: Cannot restrict PRIMARY KEY part bucket_id by IN relation as a collection is selected by the query

2013-11-11 Thread Aaron Morton
RY KEY( (mdid, bucket_id), map_key) ) Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 8/11/2013, at 1:05 am, pavli...@gmail.com wrote: > Hey guys, just started to learn Cassandra

Re: log info in console

2013-11-11 Thread Aaron Morton
I don’t use eclipse, but take a look at log4j-server.properties file and check it’s logging to stdout. If you cannot get it working just follow log file. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting

Re: sstableloader in Counter Columns

2013-11-11 Thread Aaron Morton
the data. > Is this the normal behaviour of sstableloader for counter column families? If > that is the case, we cannot run sstableloader in a live cluster, can we? I would be interested to know if you get the same result when using snapshots from all nodes. Cheers - Aar

Re: Getting into Too many open files issues

2013-11-11 Thread Aaron Morton
right thing to do but 32K files is a lot. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 8/11/2013, at 8:09 am, Arindam Barua wrote: > > I see 100 000 recommended

Re: Duplicate hard link - Cassandra 1.2.9

2013-11-11 Thread Aaron Morton
ste the full error from the system.log (it includes the thread). Sounds like it could be an issue with scrub / snapshot and JBOD. If you can reproduce it may be time to raise a ticket including the JBOD setup https://issues.apache.org/jira/browse/CASSANDRA Cheers ----- Aaron

Re: OOM while reading key cache

2013-11-11 Thread Aaron Morton
> -6 machines which 8gb RAM each and three 150GB disks each > -default heap configuration With 8GB the default heap is 2GB, try kicking that up to 4GB and a 600 to 800 MB new heap. I would guess for the data load you have 2GB is not enough. hope that helps. - Aaron

Re: Cass 2.0.0: Extensive memory allocation when row_cache enabled

2013-11-11 Thread Aaron Morton
es are going to the rows and they are getting invalidated out of the row cache. The row cache is not great for rows the update frequently and/or wide rows. How big are the rows ? use nodetool cfstats and nodetool cfhistograms. Cheers - Aaron Morton New Zealand @aaronmorton

Re: How would you model that?

2013-11-12 Thread Aaron Morton
Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 9/11/2013, at 12:56 am, Franc Carter wrote: > > How about something like using a time-range as the key (e.g an hour depending > on your

Re: java.io.FileNotFoundException when setting up internode_compression

2013-11-13 Thread Aaron Morton
IIRC there is a test for snappy when the node starts does that log an error ? And / or can you create a CF that uses snappy compression (it was the default for a while in 1.2). Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassa

Re: db file missing error

2013-11-17 Thread Aaron Morton
That still sounds like a race condition, can you create a ticket on https://issues.apache.org/jira/browse/CASSANDRA Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 15/11/2013, at

Re: Read inconsistency after backup and restore to different cluster

2013-11-19 Thread Aaron Morton
x27;ve made above, Also if you backup the system data it will bring along the tokens. This can be a pain if you want to change the cluster name. cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpick

Re: making sense of output from Eclipse Memory Analyzer tool taken from .hprof file

2013-11-19 Thread Aaron Morton
a.lang.Thread @ 0x717f083a8 MutationStage:21 - 498,081,544 (5.89%) bytes. > •java.lang.Thread @ 0x71b357e70 MutationStage:11 - 444,931,288 (5.26%) bytes. maybe very big rows and/or very big mutations. hope that helps. - Aaron Morton New Zealand @aaronmorton Co-Founder & Pr

Re: Error: Unable to search across multiple secondary index types

2013-11-20 Thread Aaron Morton
se/CASSANDRA Cheers --------- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 15/11/2013, at 10:22 pm, sielski wrote: > Hello, > > I’ve installed Cassandra 2.0.2 and I’m trying to query a cassandra table

Re: DESIGN QUESTION: Need to update only older data in cassandra

2013-11-20 Thread Aaron Morton
s you know it increases it’s fine. You can specify the timestamp for a column via either thrift or cql3. When the updates come in during the day if they have the older time stamp just send the write and it will be ignored. Cheers - Aaron Morton New Zealand @aaronmorton Co-F

Re: Disaster recovery question

2013-11-20 Thread Aaron Morton
ata on the node. I’m not sure the level DB error has to do with the commit log reply. >> 6) Our experience is that taking nodes down that have problems, then >> deleting data (subsets if we can see partial corruption) and re-adding is >> much safer (but our cluster is VERY

Re: Nodes not added to existing cluster

2013-11-20 Thread Aaron Morton
Check the networking. Hope that helps. --------- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 18/11/2013, at 8:36 pm, Skye Book wrote: > Hi there, > > I’m bringing this thread back as

Re: Adding nodes to a cluster and 2 minutes rule

2013-11-20 Thread Aaron Morton
was trying to figure out why, and how to check if after 2 minutes the > conditions to add more nodes are met or I have to wait more... any clues? If you see the new node as JOINING state ( cannot remember what that is in nodetool status) you should be ok to go. Cheers - Aaron

Re: How to set Cassandra config directory path

2013-11-25 Thread Aaron Morton
stax.com to let them know. > What I really want to do is to give the cassandra-topology.properties path to > Cassandra. Set the CASSANDRA_CONF env var in cassandra-in.sh Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cass

Re: Cannot TRUNCATE

2013-11-25 Thread Aaron Morton
If it’s just a test system nuke it and try again :) Was there more than one node at any time ? Does nodetool status show only one node ? Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle

Re: Config changes to leverage new hardware

2013-11-25 Thread Aaron Morton
ot look too bad. > Another interesting thing is that the linux disk cache doesn’t seem to be > growing in spite of a lot of free memory available. Things will only get paged in when they are accessed. Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Pr

Re: Is there any open source software for automatized deploy C* in PRD?

2013-11-25 Thread Aaron Morton
> Thanks, But I suppose it’s just for Debian? Am I right? There are debian and rpm packages, and people deploy them or the binary packages with with chef and similar tools. It may be easier to answer your question if you describe the specific platform / needs. cheers ----- Aa

Re: Migration Cassandra 2.0 to Cassandra 2.0.2

2013-11-25 Thread Aaron Morton
the binary package it creates the directory locations, installs the init scripts and makes it a lot easier to start and stop cassandra. I recommend using them. Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra

Re: Intermittent connection error

2013-11-26 Thread Aaron Morton
ces the following output: Looks like a node is getting evicted from the pool, try turning the logging level up to DEBUG see if it says anything. For DS driver specific questions you may have better luck using the mail list here https://github.com/datastax/java-driver Cheers -----

Re: 1.1.11: system keyspace is filling up

2013-11-26 Thread Aaron Morton
up, co-ordinator starts the writes, remote nodes process the request (no dropped messages), but the response is lost. These are tracked as timeouts on the MessagingServiceMBean. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache

Re: Large system.Migration CF after upgrade to 1.1

2013-11-26 Thread Aaron Morton
e (per cf) and index_interval (yaml). My talk called “In case of emergency break glass” at the summit in SF this year talks about this http://thelastpickle.com/speaking/2013/06/11/Speaking-Cassandra-Summit-SF-2013.html Long term moving to 1.2 will help. Hope that helps. --------- A

Re: While inserting data into Cassandra using Hector client

2013-11-28 Thread Aaron Morton
Hector is designed to use Column Families created via the thrift interface, e.g. using cassandra-cli Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 25/11/2013, at 8:51 pm, San

Re: Multiple writers writing to a cassandra node...

2013-11-28 Thread Aaron Morton
.0.0 with libQtCassandra library. > > Please upgrade to 2.0.3. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 26/11/2013, at 4:42 am, Krishna Chaitanya wrote: > Hello,

Re: Nodetool cleanup

2013-11-28 Thread Aaron Morton
es if they are overloaded. Cleanup is less intensive than repair, but it’s still a good idea to stagger it. If you need to run it on all machines (or you have very powerful machines) it’s probably going to be OK. Hope that helps. --------- Aaron Morton New Zealand @aaronmorton Co-Foun

Re: Multiple writers writing to a cassandra node...

2013-12-08 Thread Aaron Morton
IllegalRequestException does not existing in the server code in version 2.0. Is this thrown by the client ? InvalidRequestException is thrown in a number of places. Check you are using the client correctly. cheers - Aaron Morton New Zealand @aaronmorton Co-Founder

Re: Unable to run hadoop_cql3_word_count examples

2013-12-08 Thread Aaron Morton
does not use LOCAL_ONE, did you make a change? Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 3/12/2013, at 10:03 pm, Parth Patil wrote: > Hi, > I am new to Cassandra and I a

Re: Commitlog replay makes dropped and recreated keyspace and column family rows reappear

2013-12-08 Thread Aaron Morton
Do you have the logs from after the restart ? Did it include a "Drop Keyspace…” INFO level message ? Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 4/12/2013, at 2:44 am,

Re: CQL workaround for modifying a primary key

2013-12-08 Thread Aaron Morton
I just tested this with 1.2.9 and DROP TABLE took a snapshot and moved the existing files out of the dir. Do you have some more steps to reproduce ? Cheers A - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting

Re: Repair hangs - Cassandra 1.2.10

2013-12-09 Thread Aaron Morton
detool netstats to see if streams are being exchanged, then check the logs on those machines. cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 4/12/2013, at 10:24 pm, Tamar Rosen wrote: &g

Re: Murmur Long.MIN_VALUE token allowed?

2013-12-09 Thread Aaron Morton
AFAIK any value that is a valid output from murmor3 is a valid token. The Murmur3Partitioner set’s min and max to long min and max… public static final LongToken MINIMUM = new LongToken(Long.MIN_VALUE); public static final long MAXIMUM = Long.MAX_VALUE; Cheers - Aaron

Re: Exactly one wide row per node for a given CF?

2013-12-09 Thread Aaron Morton
her look at the data model. If you have to do it, you can try the ByteOrderedPartitioner which uses the row key as a token, given you total control of the row placement. Cheers --------- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassan

Re: Exactly one wide row per node for a given CF?

2013-12-09 Thread Aaron Morton
> Basically this desire all stems from wanting efficient use of memory. Do you have any real latency numbers you are trying to tune ? Otherwise this sounds a little like premature optimisation. Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Con

Re: Raid Issue on EC2 Datastax ami, 1.2.11

2013-12-09 Thread Aaron Morton
- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 6/12/2013, at 4:42 am, Philippe Dupont wrote: > Hi again, > > I have much more in formations on this case : > > We did furthe

Re: Drop keyspace via CQL hanging on master/trunk.

2013-12-10 Thread Aaron Morton
Looks like a bug, will try to fix today https://issues.apache.org/jira/browse/CASSANDRA-6472 Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 6/12/2013, at 10:25 am, Brian O&#

<    2   3   4   5   6   7   8   9   10   11   >