Re: Crash when uploading large data sets

2011-05-13 Thread Jonathan Ellis
You should upgrade to the latest Sun JVM. OpenJDK is almost a year behind in bug fixes. On Fri, May 13, 2011 at 11:40 AM, James Cipar wrote: > It is a 64 bit VM.  I didn't notice the hs_err_pid.log files since I'm > staring over ssh, so they're in my home directory instead of my working > direc

Re: Crash when uploading large data sets

2011-05-13 Thread James Cipar
It is a 64 bit VM. I didn't notice the hs_err_pid.log files since I'm staring over ssh, so they're in my home directory instead of my working directory. I've attached one of those below. I don't know much about Java, so I'm not sure how to interpret this file. # # An unexpected error has

Re: Crash when uploading large data sets

2011-05-12 Thread Jeffrey Kesselman
If this a 64bit VM? A 32bit Java VM with default c-heap settings can only actually use about 2GB of Java Heap. On Thu, May 12, 2011 at 8:08 PM, James Cipar wrote: > Oh, forgot this detail:  I have no swap configured, so swapping is not the > cause of the crash.  Could it be that I'm running out

Re: Crash when uploading large data sets

2011-05-12 Thread Jonathan Ellis
If it's a jvm crash there should be a hs_err_pid.log file left around in the directory you started Cassandra from. On Thu, May 12, 2011 at 6:15 PM, James Cipar wrote: > I'm using Cassandra 0.7.5, and uploading about 200 GB of data total (20 GB > unique data), to a cluster of 10 servers.  I'm usi

Re: Crash when uploading large data sets

2011-05-12 Thread James Cipar
Oh, forgot this detail: I have no swap configured, so swapping is not the cause of the crash. Could it be that I'm running out of memory on a 15GB machine? That seems unlikely. I grepped dmesg for "oom" and didn't see anything from the oom killer, and I used the instructions from the followi

Re: Crash when uploading large data sets

2011-05-12 Thread James Cipar
It looks like MAX_HEAP_SIZE is set in cassandra-env.sh to be half of my physical memory. These are 15GB VMs, so that's 7.5GB for Cassandra. I would have expected that to work, but I will override to 13 GB just to see what happens. I've also got the JNA thing set up. Do you think this would c

Re: Crash when uploading large data sets

2011-05-12 Thread Sameer Farooqui
The key JVM options for Cassandra are in cassandra.in.sh. What is your min and max heap size? The default setting of max heap size is 1GB. How much RAM do your nodes have? You may want to increase this setting. You can also set the -Xmx and -Xms options to the same value to keep Java from having

Crash when uploading large data sets

2011-05-12 Thread James Cipar
I'm using Cassandra 0.7.5, and uploading about 200 GB of data total (20 GB unique data), to a cluster of 10 servers. I'm using batch_mutate, and breaking the data up into chunks of about 10k records. Each record is about 5KB, so a total of about 50MB per batch. When I upload a smaller 2 GB da