at the last of the container's log, prints these: 2016-08-21 19:57:01 [WARN ](o.a.s.s.k.KafkaSystemProducer :66 ) Retrying send messsage due to RetriableException - org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition.. Turn on debugging to get a full stack trace 2016-08-21 19:57:11 [WARN ](o.a.s.s.k.KafkaSystemProducer :66 ) Retrying send messsage due to RetriableException - org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition.. Turn on debugging to get a full stack trace 2016-08-21 19:57:21 [WARN ](o.a.s.s.k.KafkaSystemProducer :66 ) Retrying send messsage due to RetriableException - org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition.. Turn on debugging to get a full stack trace 2016-08-21 19:57:31 [WARN ](o.a.s.s.k.KafkaSystemProducer :66 ) Retrying send messsage due to RetriableException - org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition.. Turn on debugging to get a full stack trace 2016-08-21 19:57:41 [WARN ](o.a.s.s.k.KafkaSystemProducer :66 ) Retrying send messsage due to RetriableException - org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition.. Turn on debugging to get a full stack trace 2016-08-21 19:57:51 [WARN ](o.a.s.s.k.KafkaSystemProducer :66 ) Retrying send messsage due to RetriableException - org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition.. Turn on debugging to get a full stack trace 2016-08-21 19:58:01 [WARN ](o.a.s.s.k.KafkaSystemProducer :66 ) Retrying send messsage due to RetriableException - org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition.. Turn on debugging to get a full stack trace 2016-08-21 19:58:11 [WARN ](o.a.s.s.k.KafkaSystemProducer :66 ) Retrying send messsage due to RetriableException - org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition.. Turn on debugging to get a full stack trace 2016-08-21 19:58:21 [WARN ](o.a.s.s.k.KafkaSystemProducer :66 ) Retrying send messsage due to RetriableException - org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition.. Turn on debugging to get a full stack trace 2016-08-21 19:58:31 [WARN ](o.a.s.s.k.KafkaSystemProducer :66 ) Retrying send messsage due to RetriableException - org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition.. Turn on debugging to get a full stack trace 2016-08-21 19:58:41 [WARN ](o.a.s.s.k.KafkaSystemProducer :66 ) Retrying send messsage due to RetriableException - org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition.. Turn on debugging to get a full stack trace 2016-08-21 19:58:51 [WARN ](o.a.s.s.k.KafkaSystemProducer :66 ) Retrying send messsage due to RetriableException - org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition.. Turn on debugging to get a full stack trace 2016-08-21 19:59:01 [WARN ](o.a.s.s.k.KafkaSystemProducer :66 ) Retrying send messsage due to RetriableException - org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition.. Turn on debugging to get a full stack trace
On Sun, Aug 21, 2016 at 7:38 PM, 李斯宁 <lisin...@gmail.com> wrote: > hi, guys > I'm using samza in realtime process. After running for about 10 hours, > some containers paused and not processing. > > When I looked into the log, I found a lot of > > 2016-08-21 10:03:07 [WARN ](o.a.k.c.p.i.Sender :257) Got > error produce response with correlation id 490345 on topic-partition > test3_a2_mobileDictClient_android_uid_imei-3, retrying (17 attempts left). > Error: NOT_LEADER_FOR_PARTITION > 2016-08-21 10:03:07 [WARN ](o.a.k.c.p.i.Sender :257) Got > error produce response with correlation id 490345 on topic-partition > test3_a2_mobileDictClient_android_uid_imei-4, retrying (18 attempts left). > Error: NOT_LEADER_FOR_PARTITION > 2016-08-21 10:03:07 [WARN ](o.a.k.c.p.i.Sender :257) Got > error produce response with correlation id 490345 on topic-partition > test3_a2_mobileDictClient_android_uid_imei-6, retrying (18 attempts left). > Error: NOT_LEADER_FOR_PARTITION > 2016-08-21 10:03:07 [WARN ](o.a.k.c.p.i.Sender :257) Got > error produce response with correlation id 490346 on topic-partition > test3_a2_mobileDictClient_android_uid_imei-3, retrying (16 attempts left). > Error: NOT_LEADER_FOR_PARTITION > 2016-08-21 10:03:07 [WARN ](o.a.k.c.p.i.Sender :257) Got > error produce response with correlation id 490346 on topic-partition > test3_a2_mobileDictClient_android_uid_imei-4, retrying (17 attempts left). > Error: NOT_LEADER_FOR_PARTITION > 2016-08-21 10:03:07 [WARN ](o.a.k.c.p.i.Sender :257) Got > error produce response with correlation id 490346 on topic-partition > test3_a2_mobileDictClient_android_uid_imei-6, retrying (17 attempts left). > Error: NOT_LEADER_FOR_PARTITION > > ... > > 2016-08-21 10:49:01 [WARN ](o.a.s.s.k.KafkaSystemProducer :66 ) Retrying > send messsage due to RetriableException - > org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is > not the leader for that topic-partition.. Turn on debugging to get a full > stack trace > 2016-08-21 10:49:11 [WARN ](o.a.s.s.k.KafkaSystemProducer :66 ) Retrying > send messsage due to RetriableException - > org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is > not the leader for that topic-partition.. Turn on debugging to get a full > stack trace > 2016-08-21 10:49:21 [WARN ](o.a.s.s.k.KafkaSystemProducer :66 ) Retrying > send messsage due to RetriableException - > org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is > not the leader for that topic-partition.. Turn on debugging to get a full > stack trace > 2016-08-21 10:49:31 [WARN ](o.a.s.s.k.KafkaSystemProducer :66 ) Retrying > send messsage due to RetriableException - > org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is > not the leader for that topic-partition.. Turn on debugging to get a full > stack trace > 2 > > This happens since "rush hour" for new messages produced to kafka. May be > this is a bug of kafka / samza? > > kafka version: 0.10.0.0 > > kafka config and part of paused log are attached. > > > -- 李斯宁
