Re: Kafka consumers in cluster

Thanks Kamal, >Yes, it gets called on every re-balance. >-- Kamal On Thu, Aug 4, 2016 at 10:54 AM, sat wrote: > Hi Kamal, > > Thanks for your prompt response. Does our custom partition assignor gets > called during every rebalancing. > > Thanks and Regards > A.SathishKumar > > > > >Implement

Re: KafkaConsumer blocks indefinitely when server settings are wrong

Thanks Ewan, but I wonder why is it not fixed yet, seems like a very easy fix - make metadata fetch as part of the code executed in Future and have a timeout. Basically there is more then one issue and both are very critical. Sent from my iPhone > On Aug 3, 2016, at 01:04, Ewen Cheslack-Postava

how to know which process is writing to a specific topic?

hi, guys I have many process running on YARN writing to / reading from different topics. How can I know which process is writing to my topic? (Or knowing the host:port of the producer is also OK). Is there any log? or other way? thanks for your reply in advance~ -- 李斯宁

Re: KafkaConsumer blocks indefinitely when server settings are wrong

Hi Ewen, The producer doesn't have the same issue, right? It will eventually throw a TimeoutException: https://github.com/apache/kafka/blob/trunk/clients/src/main/java/org/apache/kafka/clients/producer/KafkaProducer.java#L515 Ismael On Wed, Aug 3, 2016 at 6:04 AM, Ewen Cheslack-Postava wrote: