Limit on number of Kafka Topic

2013-03-26 Thread Suyog Rao
Hello, Wanted to check if there is any known limit on the # of topics in a Kafka cluster? I wanted to design a system which has say 5k topics and multi-threaded consumers reading messages from these topics. Does anyone have experience with such large topic size? I see in Kafka's page a test for th

Re: Kafka 0.8 build artifacts

2013-03-26 Thread Soby Chacko
Thanks Dragos!! Is the zkclient 0.2 change is pushed? I will see what I can do with the metrics jars locally. Thanks again!! Soby Chacko. On Tue, Mar 26, 2013 at 7:18 PM, Dragos Manolescu < dragos.manole...@servicenow.com> wrote: > Hi Soby -- > > As far as I can tell the zkclient dependency i

Re: Kafka 0.8 build artifacts

2013-03-26 Thread Dragos Manolescu
Hi Soby -- As far as I can tell the zkclient dependency is a leftover from 0.7.2. With the exception of the migration tool, which has a comment along these lines but I haven't looked into 0.8 uses the 0.2 version of the library (available from maven). I submitted a patch to address this, it is in

Kafka 0.8 build artifacts

2013-03-26 Thread Soby Chacko
Hello, I built kafka 0.8 with scala 2.9.2. However, I ran into some issues after publishing the 0.8-SNAPSHOT into my local maven repository. From my application, I simply depended on this new jar thinking that it would pull all the other dependencies transitively from a public maven repository. (I

Re: Connection reset by peer

2013-03-26 Thread Yonghui Zhao
kafka server is started by bin/kafka-server-start.sh. No gc setting. 在 2013-3-26 下午11:40,"Neha Narkhede" 写道: > Did you have a gc pause around that time on the server ? What are your > server's current gc settings ? > > Thanks, > Neha > > On Mon, Mar 25, 2013 at 8:48 PM, Yonghui Zhao > wrote: > >

Re: Connection reset by peer

2013-03-26 Thread Neha Narkhede
Did you have a gc pause around that time on the server ? What are your server's current gc settings ? Thanks, Neha On Mon, Mar 25, 2013 at 8:48 PM, Yonghui Zhao wrote: > Thanks Neha, btw have you seen this exception. We didn't restart any > service it happens in deep night. > > java.lang.Runtim