Re: How to work around log compaction error (0.8.2.2)

2016-04-28 Thread Rakesh Vidyadharan
Hi Manikumar, No, we are not using compression on our topics. I will try out Todd Palino’s suggestion regarding the offsets topic. Thanks Rakesh On 27/04/2016 23:34, "Manikumar Reddy" wrote: >Hi, > > Are you enabling log compaction on a topic with compressed messages? > If yes, then that

Re: How to work around log compaction error (0.8.2.2)

2016-04-27 Thread Manikumar Reddy
Hi, Are you enabling log compaction on a topic with compressed messages? If yes, then that might be the reason for the exception. 0.8.2.2 Log Compaction does not support compressed messages. This got fixed in 0.9.0.0 (KAFKA-1641, KAFKA-1374) Check below mail thread for some corrective action

How to work around log compaction error (0.8.2.2)

2016-04-27 Thread Rakesh Vidyadharan
Hello, We enabled log compaction on a few topics, as we want to preserve permanently the latest versions of messages published to specific topics. After enabling compaction, the log cleaner thread dies with the same error for the topics we tried it on. It looks like kafka has starting offset