Re: Controlled shutdown

2015-11-05 Thread Vadim Bobrov
gt; Regards, > Prabhjot > > On Thu, Nov 5, 2015 at 4:22 PM, Gleb Zhukov wrote: > > > Hi, Vadim. Do you see something like this: "zookeeper state changed > > (Expired)" in kafka's logs? > > > > On Wed, Nov 4, 2015 at 6:33 PM, Vadim Bobrov > >

Re: Controlled shutdown

2015-11-05 Thread Vadim Bobrov
quot; in kafka's logs? > > On Wed, Nov 4, 2015 at 6:33 PM, Vadim Bobrov > wrote: > > > Hi, > > > > does anyone know in what cases Kafka will take itself down? I have a > > cluster of 2 nodes that went down (not crashed) this night in a > controlled >

Controlled shutdown

2015-11-04 Thread Vadim Bobrov
Hi, does anyone know in what cases Kafka will take itself down? I have a cluster of 2 nodes that went down (not crashed) this night in a controlled and orderly shutdown as far as I can tell, except it wasn't controlled by me Thanks Vadim

Re: OffsetCommitRequest not received

2015-09-18 Thread Vadim Bobrov
) [2015-09-18 15:44:14,432] TRACE Processor id 2 selection time = 300358143 ns (kafka.network.Processor) could this silence from 355 to 432 be a sign of trouble? (no significant GC activity around this time) On Fri, Sep 18, 2015 at 4:07 PM, Vadim Bobrov wrote: > Hi, > > I am trying

OffsetCommitRequest not received

2015-09-18 Thread Vadim Bobrov
Hi, I am trying to commit offsets manually to kafka and it sometimes works sometimes not. What I found in kafka-request.log for the successful attempt is this: [2015-09-18 15:22:38,031] TRACE [KafkaApi-0] Handling request: Name: OffsetCommitRequest; Version: 1; CorrelationId: 0; ClientId: chaos-t

Re: Offset not committed

2015-07-15 Thread Vadim Bobrov
it is pretty random On Wed, Jul 15, 2015 at 4:22 PM, Jiangjie Qin wrote: > I’m not sure if it is related to running in cloud. Do you see this > disconnection issue always happening on committing offsets or it happens > randomly? > > Jiangjie (becket) qin > > On 7/15/15, 12

Re: Offset not committed

2015-07-15 Thread Vadim Bobrov
On 7/15/15, 11:40 AM, "Vadim Bobrov" wrote: > > >caught it, thanks for help! > >any ideas what to do? > > > >TRACE 2015-07-15 18:37:58,070 [chaos-akka.actor.jms-dispatcher-1019 ] > >kafka.network.BoundedByteBufferSend - 113 bytes written. > &

Re: Offset not committed

2015-07-15 Thread Vadim Bobrov
(ForkJoinPool.java:1979) at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) On Wed, Jul 15, 2015 at 1:36 PM, Vadim Bobrov wrote: > thanks Joel and Jiangjie, > I have figured it out. In addition to my log4j 2 config file I also needed > a log4j 1 config file

Re: Offset not committed

2015-07-15 Thread Vadim Bobrov
ave log4j appender defined and the loggers are directed > > to the correct appender? > > > > Thanks, > > > > Jiangjie (Becket) Qin > > > > On 7/15/15, 8:10 AM, "Vadim Bobrov" wrote: > > > > >Thanks Jiangjie, > > > > >

Re: Offset not committed

2015-07-15 Thread Vadim Bobrov
ere is any exception thrown. > > Thanks, > > Jiangjie (Becket) Qin > > On 7/14/15, 11:06 AM, "Vadim Bobrov" wrote: > > >just caught this error again. I issue commitOffsets - no error but no > >committng offsets either. __consumer_offsets watching sh

Re: Fwd: Offset not committed

2015-07-14 Thread Vadim Bobrov
to the offsets topic - unless > you are seeing errors in the logs, the offset commit should succeed > (if you are indeed explicitly committing offsets). > > Thanks, > > Joel > > On Tue, Jul 14, 2015 at 12:19:01PM -0400, Vadim Bobrov wrote: > > Thanks, Joel, I will bu

Re: Fwd: Offset not committed

2015-07-14 Thread Vadim Bobrov
hould succeed > (if you are indeed explicitly committing offsets). > > Thanks, > > Joel > > On Tue, Jul 14, 2015 at 12:19:01PM -0400, Vadim Bobrov wrote: > > Thanks, Joel, I will but regardless of my findings the basic problem will > > still be there: there is n

Re: Fwd: Offset not committed

2015-07-14 Thread Vadim Bobrov
on your consumer? > Also, can you consume the offsets topic while you are committing > offsets and see if/what offsets are getting committed? > (http://www.slideshare.net/jjkoshy/offset-management-in-kafka/32) > > Thanks, > > Joel > > On Tue, Jul 14, 2015 at 11:12:03AM -0

Fwd: Offset not committed

2015-07-14 Thread Vadim Bobrov
I am trying to replace ActiveMQ with Kafka in our environment however I have encountered a strange problem that basically prevents from using Kafka in production. The problem is that sometimes the offsets are not committed. I am using Kafka 0.8.2.1, offset storage = kafka, high level consumer, aut

Offset not committed

2015-07-13 Thread Vadim Bobrov
I am trying to replace ActiveMQ with Kafka in our environment however I have encountered a strange problem that basically prevents from using Kafka in production. The problem is that sometimes the offsets are not committed. I am using Kafka 0.8.2.1, offset storage = kafka, high level consumer, aut