RE: OutOfMemory error on broker when rolling logs

2015-05-15 Thread Jeff Field
From: Jeff Field Sent: Thursday, May 14, 2015 11:17 AM To: 'users@kafka.apache.org' Subject: RE: OutOfMemory error on broker when rolling logs Replying to Jay's message, though some mailing list snafu made me not able to see it except through the archive. Apologies if it brea

RE: OutOfMemory error on broker when rolling logs

2015-05-14 Thread Jeff Field
Replying to Jay's message, though some mailing list snafu made me not able to see it except through the archive. Apologies if it breaks threading: I've confirmed that the Kafka process itself is running 64-bit, the information is included below. At this point I'm thinking it could be ulimit so w

Re: OutOfMemory error on broker when rolling logs

2015-05-13 Thread Jay Kreps
I think "java.lang.OutOfMemoryError: Map failed" has usually been "out of address space for mmap" if memory serves. If you sum the length of all .index files while the service is running (not after stopped), do they sum to something really close to 2GB? If so it is likely either that the OS/arch i