Re: error during snapshot

So, the first time I ran into the issue, I added a 1G swap file and then I was able to snapshot just fine. Then after a few hours, I wasn't able to do snapshots again. So, I added a second swap file of 2G and was now able to snapshot just fine. My reason for adding and removing the 2G as part of

Re: error during snapshot

Interesting. Googling your error turns up http://stackoverflow.com/questions/1124771/how-to-solve-java-io-ioexception-error12-cannot-allocate-memory-calling-runt Why not just leave the swap on? It's usually a Good Thing to be able to page out unused memory, and use the ram for buffer cache inste

Re: error during snapshot

The thing is, that I'm not running close to being out of memory. The data from nodetool info is showing that only about half of the available heap space is being used and running free from the command line shows that I have plenty of RAM available and some usage of the 1G swap space which is alway

Re: error during snapshot

If you're running so close to the edge of running out of memory that creating a ln process pushes you over the edge, you should fix the broader cause instead of the specific symptom. :) On Tue, Apr 27, 2010 at 10:09 PM, Lee Parker wrote: > So, after reading the thread which Eric posted earlier, I

Re: error during snapshot

So, after reading the thread which Eric posted earlier, I have created a workaround for the issue. In my backup script, I add a swapfile with swapon, tell cassandra to create the snapshots, then remove the swapfile with swapoff. Then I continue with the rest of the work the backup script needs to

Re: error during snapshot

The system is a ubuntu server running 8.04 LTS. Now, I'm getting the problem again this evening even with the addition of the swap space. Lee Parker On Tue, Apr 27, 2010 at 1:13 PM, Jonathan Shook wrote: > The allocation of memory may have failed depending on the available virtual > memory, whe

Re: error during snapshot

The allocation of memory may have failed depending on the available virtual memory, whether or not the memory would have been subsequently accessed by the process. Some systems do the work of allocating physical pages only when they are accessed for the first time. I'm not sure if yours is one of

Re: error during snapshot

Adding a swapfile fixed the error, but it doesn't look as though the process is even using the swap file at all. Lee Parker On Tue, Apr 27, 2010 at 9:49 AM, Eric Hauser wrote: > Have you read this? > > http://forums.sun.com/thread.jspa?messageID=9734530 > >

Re: error during snapshot

Have you read this? http://forums.sun.com/thread.jspa?messageID=9734530 I don't think EC2 instances have any swap. On Tue, Apr 27, 2010 at 10:16 AM, Lee Parker wrote: > Can anyone help with this? It is preventing me from getting backups of

Re: error during snapshot

Can anyone help with this? It is preventing me from getting backups of our cluster. Lee Parker On Mon, Apr 26, 2010 at 10:02 PM, Lee Parker wrote: > I was attempting to get a snapshot on our cassandra nodes. I get the > following error every time I run nodetool ... snapshot. > > Exception in t

error during snapshot

I was attempting to get a snapshot on our cassandra nodes. I get the following error every time I run nodetool ... snapshot. Exception in thread "main" java.io.IOException: Cannot run program "ln": java.io.IOException: error=12, Cannot allocate memory at java.lang.ProcessBuilder.start(ProcessBuil