Re: Log cleaner patch (KAFKA-1641) on 0.8.2.1

2015-03-16 Thread Marc Labbe
So far no. It happens periodically and seems to resolve when we restart the broker (only to eventually reappear). There are a couple of things I need to get out of the way in our setup first but I'll see what I can do to reproduce it. We had a couple of bad shutdowns performed and brokers restarte

Re: Log cleaner patch (KAFKA-1641) on 0.8.2.1

2015-03-13 Thread Joel Koshy
+1 - if you have a way to reproduce that would be ideal. We don't know the root cause of this yet. Our guess is a corner case around shutdowns, but not sure. On Fri, Mar 13, 2015 at 03:13:45PM -0700, Jun Rao wrote: > Is there a way that you can reproduce this easily? > > Thanks, > > Jun > > On

Re: Log cleaner patch (KAFKA-1641) on 0.8.2.1

2015-03-13 Thread Jun Rao
Is there a way that you can reproduce this easily? Thanks, Jun On Fri, Mar 13, 2015 at 8:13 AM, Marc Labbe wrote: > No exactly, the topics are compacted but messages are not compressed. > > I get the exact same error though. Any other options I should consider? > We're on 0.8.2.0 and we also h

Re: Log cleaner patch (KAFKA-1641) on 0.8.2.1

2015-03-13 Thread Mayuresh Gharat
I suppose that the patch for KAFKA-1641 had a fix for this issue. Also it might be worth looking at Kafka-1755. Thanks, Mayuresh On Fri, Mar 13, 2015 at 8:13 AM, Marc Labbe wrote: > No exactly, the topics are compacted but messages are not compressed. > > I get the exact same error though. Any

Re: Log cleaner patch (KAFKA-1641) on 0.8.2.1

2015-03-13 Thread Marc Labbe
No exactly, the topics are compacted but messages are not compressed. I get the exact same error though. Any other options I should consider? We're on 0.8.2.0 and we also had this on 0.8.1.1 before. marc On Fri, Mar 13, 2015 at 10:47 AM, Jun Rao wrote: > Did you get into that issue for the sam

Re: Log cleaner patch (KAFKA-1641) on 0.8.2.1

2015-03-13 Thread Jun Rao
Did you get into that issue for the same reason as in the jira, i.e., somehow compressed messages were sent to the compact topics? Thanks, Jun On Fri, Mar 13, 2015 at 6:45 AM, Marc Labbe wrote: > Hello, > > we're often seeing log cleaner exceptions reported in KAFKA-1641 and I'd > like to know

Log cleaner patch (KAFKA-1641) on 0.8.2.1

2015-03-13 Thread Marc Labbe
Hello, we're often seeing log cleaner exceptions reported in KAFKA-1641 and I'd like to know if it's safe to apply the patch from that issue resolution to 0.8.2.1? Reference: https://issues.apache.org/jira/browse/KAFKA-1641 Also there are 2 patches in there, I suppose I should be using only the