Re: Producer waiting ~15 mins before disconnecting.

2015-05-19 Thread 4mayank
on loss on idle > connections. > (as a positive side effect it also helps keeping connections alive through > NAT/firewalls/LBs) > > If this is not available in the client in question I suggest you file an > issue (JIRA). > > Regards, > Magnus > > > 2015-05-19 21:3

Producer waiting ~15 mins before disconnecting.

2015-05-19 Thread 4mayank
I am using kafka 0.8.2.1 old producer. When one of the kafka node in the remote cluster is down the producer is waiting about 15 minutes before it disconnects and tries to connect to another node. (kafka takes < 1 min to change leaders). Producer config used: request.required.acks=1 partitioner.cl

Using different IPs for clients and kafka inter-node communication

2015-04-22 Thread 4mayank
I have a 3-node setup where each kafka/zookeeper node has two network interfaces - one globally routeable (10.x.x.x) and one internal (192.168.x.x). I would like the kafka nodes to use the internal interface to talk to its neighboring brokers (faster and more efficient) and use the globally routeab

Re: Consumer offsets in offsets topic 0.8.2

2015-04-14 Thread 4mayank
ed. It will > throw ZK exception, which is very confusing. KAFKA-1951 was opened for > this but was not checked in. > > Thanks. > > Jiangjie (Becket) Qin > > On 4/13/15, 9:55 AM, "4mayank" <4may...@gmail.com> wrote: > > >I did a similar change

Re: Consumer offsets in offsets topic 0.8.2

2015-04-13 Thread 4mayank
I did a similar change - moved from High Level Consumer to Simple Consumer. Howerver kafka-consumer-offset-checker.sh throws an exception. Its searching the zk path /consumers// which does not exist on any of my zk nodes. Is there any other tool for getting the offset lag when using Simple Consume

Re: java api code and javadoc

2014-10-16 Thread 4mayank
ub.com/apache/kafka#building-javadocs-and-scaladocs > > From: 4mayank <4may...@gmail.com> > Sent: Wednesday, October 15, 2014 11:38 AM > To: users@kafka.apache.org > Subject: java api code and javadoc > > Hi > > I downloaded

java api code and javadoc

2014-10-15 Thread 4mayank
Hi I downloaded kafka 0.8.1.1 src and went through some documentation and wikis, but could not find any documentation (javadoc or other) on the java API - info on classes like SimpleConsumer, MessageAndOffset etc. Nor could I locate the source code (.java). I see only scala files. Can anyone prov