Pausing a partition in Kafka Consumer

Hi all, In the javadoc for KafkaConsumer#pause it's stated that, Suspend fetching from the requested partitions. Future calls to poll(long) >

Unable to produce after upgrading to 0.10.0.X

I am seeing this in error in producer logs after upgrading broker to 0.10.0 from 0.8 version , In producer side i still use 0..8 version of producer api. Any suggestions to fix this. ?. 2016-08-19 22:18:30.598 c.y.a.t.s.o.KafkaMessageSender pool-10-thread-5 [WARN] caught exception when sending ms

RE: Consumer failure and producer topic deduplication

here is a scala test which produces UNKNOWN_MEMBER_ID @Test def testJoinGroupUnknownConsumerNewGroup() {val joinGroupResult = joinGroup(groupId, memberId, DefaultSessionTimeout, protocolType, protocols) val joinGroupErrorCode = joinGroupResult.errorCode assertEquals(Errors.UNKNOWN_ME

Consumer failure and producer topic deduplication

Hi, I am using Kafka for a fairly specific use case with a need for a lot of control. I use the new KafkaConsumer to consume events from input topic, process the data and publish to multiple different topics. The use case requires fairly strict delivery and consistency guarantees. All messa

Kafka metrics always reporting zero

I am running a distributed connector with a custom MetricReporter class. The metric reporter is able to listen to kafka metrics and is logging them on the console. However, values for all metrics are that are being reported are either zero or infinity. The values do not change for a significant per