Re: Ant error in Eclipse when building Cassandra

2011-05-06 Thread Jonathan Ellis
Default stack is huge, so maven-ant-tasks-retrieve-build is probably recursing infinitely somewhere :( On Fri, May 6, 2011 at 2:42 PM, Ed Anuff wrote: > I finally got around to getting Eclipse set up to build Cassandra > following the directions on the wiki and it seems to be working, > Eclipse i

Re: Memory Usage During Read

2011-05-06 Thread Jonathan Ellis
You don't GC storm without legitimately having a too-full heap. It's normal to see occasional full GCs from fragmentation, but that will actually compact the heap and everything goes back to normal IF you had space actually freed up. You say you've played w/ memtable size but that would still be

Re: Ec2 Stress Results

2011-05-06 Thread Jonathan Ellis
On Fri, May 6, 2011 at 5:13 PM, Alex Araujo wrote: > I raised the default MAX_HEAP setting from the AMI to 12GB (~80% of > available memory). This is going to make GC pauses larger for no good reason. > raised > concurrent_writes to 300 based on a (perhaps arbitrary?) recommendation in > 'Cassan

Re: Ec2 Stress Results

2011-05-06 Thread Alex Araujo
Pardon the long delay - went on holiday and got sidetracked before I could return to this project. @Joaquin - The DataStax AMI uses a RAID0 configuration on an instance store's ephemeral drives. @Jonathan - you were correct about the client node being the bottleneck. I setup 3 XL client ins

Re: Migrating all rows from 0.6.13 to 0.7.5 over thrift?

2011-05-06 Thread Jeremy Hanna
Great! I just wanted to make sure you were getting the information you needed. On May 6, 2011, at 6:42 PM, Henrik Schröder wrote: > Well, I already completed the migration program. Using get_range_slices I > could migrate a few thousand rows per second, which means that migrating all > of our

Re: Migrating all rows from 0.6.13 to 0.7.5 over thrift?

2011-05-06 Thread Henrik Schröder
Well, I already completed the migration program. Using get_range_slices I could migrate a few thousand rows per second, which means that migrating all of our data would take a few minutes, and we'll end up with pristine datafiles for the new cluster. Problem solved! I'll see if I can create datafi

Re: Migrating all rows from 0.6.13 to 0.7.5 over thrift?

2011-05-06 Thread Jeremy Hanna
If you're able, go into the #cassandra channel on freenode (IRC) and talk to driftx or jbellis or aaron_morton about your problem. It could be that you don't have to do all of this based on a conversation there. On May 6, 2011, at 5:04 AM, Henrik Schröder wrote: > I'll see if I can make some e

Re: Running Cassandra across different Amazon EC2 regions

2011-05-06 Thread Sameer Farooqui
Thanks, Shasha. It looks like there are two ways to make Cassandra work across regions, changing the source code or using software like Vyatta and VIPs. ++ Changing the source code ++ Milind documents how to change the source code in 0.7.4 but warns that there are significant limitations to this

Re: Making a custom Cassandra RPM

2011-05-06 Thread Konstantin Naryshkin
I have subsequently gotten the RPM installed and working. I edited the SPEC to copy the CQL and apache-cassandra-thrift JARs into the proper location. Is it worth submitting a diff to the community or will it get rejected due to licenses? Konstantin - Original Message - From: "Konstant

Ant error in Eclipse when building Cassandra

2011-05-06 Thread Ed Anuff
I finally got around to getting Eclipse set up to build Cassandra following the directions on the wiki and it seems to be working, Eclipse isn't showing any errors except that when it fires off the automatic ant build I get the following error: maven-ant-tasks-retrieve-build: BUILD FAILED java.la

Re: caching change between 0.7.0 and 0.7.5

2011-05-06 Thread Paul Loy
Ok, thanks. On Fri, May 6, 2011 at 8:32 PM, Jonathan Ellis wrote: > Column objects are treated as immutable so it's quite likely you'll > get back the same Columns (and buffers) if your query hits a local > memtable. This was possible in 0.7.0 as well. > It's funny as this was a unit test that

Re: caching change between 0.7.0 and 0.7.5

2011-05-06 Thread Jonathan Ellis
Column objects are treated as immutable so it's quite likely you'll get back the same Columns (and buffers) if your query hits a local memtable. This was possible in 0.7.0 as well. (This only applies to the StorageProxy interface, if you're going over Thrift it will do a copy over the network.)

Memory Usage During Read

2011-05-06 Thread Serediuk, Adam
We're troubleshooting a memory usage problem during batch reads. We've spent the last few days profiling and trying different GC settings. The symptoms are that after a certain amount of time during reads one or more nodes in the cluster will exhibit extreme memory pressure followed by a gc stor

RE: New node not joining

2011-05-06 Thread Len Bucchino
While I agree that what you suggested is a very good idea the bootstrapping process _should_ work properly. Here is some additional detail on the original problem. If the current node that you are trying to bootstrap has itself listed in seeds in its yaml then it will be able to bootstrap on a

Re: CFHistograms?

2011-05-06 Thread Jonathan Ellis
Those are updated at compaction time. On Thu, May 5, 2011 at 11:38 PM, Xaero S wrote: > > Can someone point me to a document that explains how to interpret > CFHistograms output? i went through > http://narendrasharma.blogspot.com/2011/04/cassandra-07x-understanding-output-of.html > which is a go

Re: Native heap leaks?

2011-05-06 Thread Jonathan Ellis
On Thu, May 5, 2011 at 6:16 PM, aaron morton wrote: > Hannes, >        To get a baseline of behaviour set disk_access to standard. You will > probably want to keep it like that if you want better control over the memory > on the box. Changing disk access mode just gives you the illusion of more

Re: Making a custom Cassandra RPM

2011-05-06 Thread Konstantin Naryshkin
Sorry that I did not get back to you on the issue. Your suggestion worked and I was able to get the RPM to build. Unfortunately, it still does not work for me. I am getting the error described in https://issues.apache.org/jira/browse/CASSANDRA-2549 . I tried Cassandra 0.8 beta 1 tag (the one th

Cassandra and JCR

2011-05-06 Thread David Boxenhorn
I think this is a question specifically for Patricio Echagüe, though I welcome answers from anyone else who can contribute... We are considering using Magnolia as a CMS. Magnolia uses Jackrabbit for its data storage. Jackrabbit is a JCR implementation. Questions: 1. Can we plug Cassandra into JC

Filter on row iterator

2011-05-06 Thread cbert...@libero.it
Hi all, I have a column family with about 300 rows. Rows name are of 2 categories: number (eg: 12345) e_number (eg: e_12345) is there any way to extract only rows that are numbers? For the moment I'm iterating over all rows with a KeyRange and filtering client-side but I don't like this solution

Re: Migrating all rows from 0.6.13 to 0.7.5 over thrift?

2011-05-06 Thread Henrik Schröder
I'll see if I can make some example broken files this weekend. /Henrik Schröder On Fri, May 6, 2011 at 02:10, aaron morton wrote: > The difficulty is the different thrift clients between 0.6 and 0.7. > > If you want to roll your own solution I would consider: > - write an app to talk to 0.6 an

Re: Migrating all rows from 0.6.13 to 0.7.5 over thrift?

2011-05-06 Thread Henrik Schröder
Uhm, having a program that can talk to 0.6 and 0.7 servers at the same time is not the hard problem, it took way less than five minutes to copy in both generated clients in the same project and rename the C# namespaces. Two apps and write to disk inbetween? Maven? That's crazy talk. :-D What I was

Re: Migrating all rows from 0.6.13 to 0.7.5 over thrift?

2011-05-06 Thread Stephen Connolly
maven-shade-plugin could help with having two versions of thrift at the same time... but you'd need to build some stuff with maven, and some people don't like that idea - Stephen --- Sent from my Android phone, so random spelling mistakes, random nonsense words and other nonsense are a direct res