Thanks harsha for quick response. I don't see any other error. I used to see replica fetcher error but seems to be disappeared after setting replica fetcher threads to 2 as I have 2 partitions. Some times I see zookeeper session expiration. On Jan 14, 2015 8:02 PM, "Harsha" <ka...@harsha.io> wrote:
> Tousif, > Do you see any other errors in server.log > -Harsha > > On Wed, Jan 14, 2015, at 01:51 AM, Tousif wrote: > > Hello, > > > > I have configured kafka nodes to run via supervisord and see following > > exceptions > > and eventually brokers going out of memory. i have given enough memory > > and > > process 1 event/second. kafka goes down every day > > > > i'm wondering what configurastion is missing or need to be added > > > > Here are my cluster details: > > 2 brokers > > 1 zookeeper > > and 2 node apache storm > > > > > > INFO zookeeper state changed (SyncConnected) > > (org.I0Itec.zkclient.ZkClient) > > ERROR Closing socket for /10.0.0.11 because of error > > (kafka.network.Processor) > > java.io.IOException: Connection reset by peer > > at sun.nio.ch.FileDispatcher.read0(Native Method) > > at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:21) > > at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:198) > > at sun.nio.ch.IOUtil.read(IOUtil.java:171) > > at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:245) > > at kafka.utils.Utils$.read(Utils.scala:375) > > at > > > kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:54) > > at kafka.network.Processor.read(SocketServer.scala:347) > > at kafka.network.Processor.run(SocketServer.scala:245) > > at java.lang.Thread.run(Thread.java:662) > > [2015-01-13 23:43:37,962] INFO Closing socket connection to /10.0.0.11. > > (kafka.network.Processor) > > Error occurred during initialization of VM > > Could not reserve enough space for object heap > > Error occurred during initialization of VM > > Could not reserve enough space for object heap > > > > > > > > > > -- > > Regards, > > Tousif > > +918050227279 > > > > > > -- > > > > > > Regards > > Tousif Khazi >
