Re: Kafka partitions are piled up for Consumer

2017-07-06 Thread Naanu Bora
I am observing the same with our .10.2 cluster where consumers are hanged for those partitions where the current offset's data gets deleted due to retention. It looks like a bug to me. Thanks! On Jul 6, 2017 9:23 AM, "Ghosh, Achintya (Contractor)" < achintya_gh...@comcast.com> wrote: > Hi, > > I

Multiple controller in 10.2

2017-05-29 Thread Naanu Bora
Hi, Our cluster in production (10.2) is running into multiple controllers. Rebooting helps temporarily but after few days it again runs into same multiple controller issue. Is there any way to re elect the controller? Thanks

Re: Increase partion in 10.2, unknownpartition error

2017-05-19 Thread Naanu Bora
And it seems that the partition files are missing in leader broker..is there any way I can recover this topic since delete topic seems to have issues ? On May 19, 2017 8:40 AM, "Naanu Bora" wrote: > Hi, > I am using kafka manager to increase the partion of a topic. After

Increase partion in 10.2, unknownpartition error

2017-05-19 Thread Naanu Bora
Hi, I am using kafka manager to increase the partion of a topic. After increasing the number of partitions I am seeing following error for one partition and writes to this partition hangs. Logs in leader of partition 3: While recording the replica LEO, the partition testtopic-2 hasn't been c

How to increase replication factor in kafka 10.2

2017-04-26 Thread Naanu Bora
Hi, In our team some developers created topics with replication factor as 1 by mistake and number of partition in the range of 20-40. How to increase the replication factor to 3 for those topics now? Do we need to come up with a manual assignment plan for each of the partitions? Is there any qui

Producer callback not called for small percentage of the messages

2017-04-07 Thread Naanu Bora
Hi All, I am using kafka java client 0.8.2 and I am observing that for a small percentage of the the send call, the onCompletion method of the callback is not getting called. How can it be possible? I was under the impression that since kafka uses tcp internally , based on tcp ack , all callback

Understanding producer connections

2017-03-30 Thread Naanu Bora
Hi, I am a new user of kafka. My client library is on 0.8.2 and I want to understand how one producer instance running on a multi threaded environment in a single jvm creating 300+ connections to the leader broker. The producer instance is closed only when the jvm exits. This producer is writi