Mutli Consumers

2014-01-09 Thread Klaus Schaefers
props.put("zookeeper.connect", a_zookeeper); props.put("group.id", a_groupId); props.put("zookeeper.session.timeout.ms", "400"); props.put("zookeeper.sync.time.ms", "200"); props.put("auto.co

Re: Mutli Consumers

2014-01-09 Thread Klaus Schaefers
okeeper or > kafka? Also, any reason why you are lowering the zk session timeout in > your code? Can you share some of your logs? > > Joel > > On Thu, Jan 9, 2014 at 5:07 AM, Klaus Schaefers > wrote: > > Hi, > > > > how many consumers can I connect to a kafka clu

Velocity on local machine

2014-01-10 Thread Klaus Schaefers
encountered some issues when increasing the number of topics, lets say 100. In this case the consumer cannot connect the Zookeeper... Does anybody has an idea how to improve the performance? Thx, Klaus -- -- Klaus Schaefers Senior Optimization Manager Ligatus GmbH Hohenstaufenring 30-32 D

Re: Velocity on local machine

2014-01-10 Thread Klaus Schaefers
> around 3 million msgs/s when run on the same host and with hot disk caches. > > Regards, > Magnus > > > 2014/1/10 Klaus Schaefers > > > Hi, > > > > I am currently benchmarking Kafka against ActiveMQ and I got some results > > the surprised my quite

Re: Velocity on local machine

2014-01-10 Thread Klaus Schaefers
; > Regards, > Magnus > > [1]: https://github.com/edenhill/librdkafka/tree/master/examples > > > > 2014/1/10 Klaus Schaefers > > > Hi, > > > > I have close to 2k messages per second. My machine is just a (BG 4-core > i5 > > but I would expect more m

Re: Velocity on local machine

2014-01-13 Thread Klaus Schaefers
Hi, I am using kafka-0.8.0-src. Cheers, Klaus On Fri, Jan 10, 2014 at 8:48 PM, Neha Narkhede wrote: > What version of Kafka are you benchmarking? > > > On Fri, Jan 10, 2014 at 8:36 AM, Klaus Schaefers < > klaus.schaef...@ligatus.com> wrote: > > > Hi, > >

Re: Kafka Web Console

2014-03-05 Thread Klaus Schaefers
; https://github.com/claudemamo/kafka-web-console/tree/v1.0. Tested on > > Chrome. > > > > Enjoy, > > > > Claude > > > -- -- Klaus Schaefers Senior Optimization Manager Ligatus GmbH Hohenstaufenring 30-32 D-50674 Köln Tel.: +49 (0) 221 / 569

Message Timeout

2014-06-27 Thread Klaus Schaefers
Hi, I am new to Kafka and I have a question how Kafka handles scenarios where no consumer is available. Can I configure Kafka in such a way that the messages will be dropped after x seconds? Otherwise I would be afraid that the queues would overflow... Cheers, Klaus -- -- Klaus Schaefers