Which version of Kafka are you using? Any error in the controller and the state-change log?
Thanks, Jun On Fri, Nov 21, 2014 at 5:59 PM, Shangan Chen <[email protected]> wrote: > In the initial state all replicas are in isr list， but sometimes when I > check the topic state, the replica can never become isr even if actually it > is synchronized. I saw in the log, the leader print expand isr request，but > did not work. I found a interesting thing, the shrink and expand request > happened just after the controller switch. I don't know whether it is > related, and the controller log is overwrite, so I can not verify. Is there > anything I can do to trigger the isr update? Currently, I alter the > zookeeper partition state, and it works, but it really need a lot of manual > work to do as I have quite a lot of topics in my cluster. Some useful > information is as follows. > > *my replica lag config for default:* > > replica.lag.time.max.ms=10000 > replica.lag.max.messages=4000 > > *controller info:* > > [zk: localhost:2181(CONNECTED) 4] get /kafka08/controller > {"version":1,"brokerid":29,"timestamp":"1416608404008"} > cZxid = 0x5a4c85923 > ctime = Sat Nov 22 06:20:04 CST 2014 > mZxid = 0x5a4c85923 > mtime = Sat Nov 22 06:20:04 CST 2014 > pZxid = 0x5a4c85923 > cversion = 0 > dataVersion = 0 > aclVersion = 0 > ephemeralOwner = 0x5477ba622cb6c7d > dataLength = 55 > numChildren = 0 > > > *topic info:* > > Topic:org.nginx PartitionCount:48 ReplicationFactor:2 Configs: > Topic: org.nginx Partition: 0 Leader: 17 Replicas: > 17,32 Isr: 17,32 > Topic: org.nginx Partition: 1 Leader: 18 Replicas: > 18,33 Isr: 18,33 > Topic: org.nginx Partition: 2 Leader: 19 Replicas: > 19,34 Isr: 34,19 > Topic: org.nginx Partition: 3 Leader: 20 Replicas: > 20,35 Isr: 35,20 > Topic: org.nginx Partition: 4 Leader: 21 Replicas: > 21,36 Isr: 21,36 > Topic: org.nginx Partition: 5 Leader: 22 Replicas: > 22,17 Isr: 17,22 > Topic: org.nginx Partition: 6 Leader: 23 Replicas: > 23,18 Isr: 18,23 > Topic: org.nginx Partition: 7 Leader: 24 Replicas: > 24,19 Isr: 24,19 > Topic: org.nginx Partition: 8 Leader: 25 Replicas: > 25,20 Isr: 25,20 > Topic: org.nginx Partition: 9 Leader: 26 Replicas: > 26,21 Isr: 26,21 > Topic: org.nginx Partition: 10 Leader: 27 Replicas: > 27,22 Isr: 27,22 > Topic: org.nginx Partition: 11 Leader: 28 Replicas: > 28,23 Isr: 28,23 > Topic: org.nginx Partition: 12 Leader: 29 Replicas: > 29,24 Isr: 29 > Topic: org.nginx Partition: 13 Leader: 30 Replicas: > 30,25 Isr: 30,25 > Topic: org.nginx Partition: 14 Leader: 31 Replicas: > 31,26 Isr: 26,31 > Topic: org.nginx Partition: 15 Leader: 32 Replicas: > 32,27 Isr: 27,32 > Topic: org.nginx Partition: 16 Leader: 33 Replicas: > 33,28 Isr: 33,28 > Topic: org.nginx Partition: 17 Leader: 34 Replicas: > 34,29 Isr: 29,34 > Topic: org.nginx Partition: 18 Leader: 35 Replicas: > 35,30 Isr: 30,35 > Topic: org.nginx Partition: 19 Leader: 36 Replicas: > 36,31 Isr: 31,36 > Topic: org.nginx Partition: 20 Leader: 17 Replicas: > 17,32 Isr: 17,32 > Topic: org.nginx Partition: 21 Leader: 18 Replicas: > 18,33 Isr: 18,33 > Topic: org.nginx Partition: 22 Leader: 19 Replicas: > 19,34 Isr: 34,19 > Topic: org.nginx Partition: 23 Leader: 20 Replicas: > 20,35 Isr: 35,20 > Topic: org.nginx Partition: 24 Leader: 21 Replicas: > 21,36 Isr: 21,36 > Topic: org.nginx Partition: 25 Leader: 22 Replicas: > 22,17 Isr: 17,22 > Topic: org.nginx Partition: 26 Leader: 23 Replicas: > 23,18 Isr: 18,23 > Topic: org.nginx Partition: 27 Leader: 24 Replicas: > 24,19 Isr: 24,19 > Topic: org.nginx Partition: 28 Leader: 25 Replicas: > 25,20 Isr: 25,20 > Topic: org.nginx Partition: 29 Leader: 26 Replicas: > 26,21 Isr: 26,21 > Topic: org.nginx Partition: 30 Leader: 27 Replicas: > 27,22 Isr: 27,22 > Topic: org.nginx Partition: 31 Leader: 28 Replicas: > 28,23 Isr: 28,23 > Topic: org.nginx Partition: 32 Leader: 29 Replicas: > 29,24 Isr: 29 > Topic: org.nginx Partition: 33 Leader: 30 Replicas: > 30,25 Isr: 30,25 > Topic: org.nginx Partition: 34 Leader: 31 Replicas: > 31,26 Isr: 26,31 > Topic: org.nginx Partition: 35 Leader: 32 Replicas: > 32,27 Isr: 27,32 > Topic: org.nginx Partition: 36 Leader: 33 Replicas: > 33,28 Isr: 33,28 > Topic: org.nginx Partition: 37 Leader: 34 Replicas: > 34,29 Isr: 29,34 > Topic: org.nginx Partition: 38 Leader: 35 Replicas: > 35,30 Isr: 30,35 > Topic: org.nginx Partition: 39 Leader: 36 Replicas: > 36,31 Isr: 31,36 > Topic: org.nginx Partition: 40 Leader: 17 Replicas: > 17,32 Isr: 17,32 > Topic: org.nginx Partition: 41 Leader: 18 Replicas: > 18,33 Isr: 33,18 > Topic: org.nginx Partition: 42 Leader: 19 Replicas: > 19,34 Isr: 34,19 > Topic: org.nginx Partition: 43 Leader: 20 Replicas: > 20,35 Isr: 35,20 > Topic: org.nginx Partition: 44 Leader: 21 Replicas: > 21,36 Isr: 21,36 > Topic: org.nginx Partition: 45 Leader: 22 Replicas: > 22,17 Isr: 17,22 > Topic: org.nginx Partition: 46 Leader: 23 Replicas: > 23,18 Isr: 18,23 > Topic: org.nginx Partition: 47 Leader: 24 Replicas: > 24,19 Isr: 24,19 > > -- > have a good day! > chenshang'an >
