Here’s the topic description:
Topic:blumfrub PartitionCount:15 ReplicationFactor:5 Configs:
Topic: blumfrub Partition: 0 Leader: 1001 Replicas: 1001,0,1,2,3
Isr: 0,1001,1,2,3
Topic: blumfrub Partition: 1 Leader: 0 Replicas: 0,1,2,3,4
Isr: 0,1,2,3,4
Topic: blumfrub Partition: 2 Leader: 1 Replicas: 1,2,3,4,1001
Isr: 1001,1,2,3,4
Topic: blumfrub Partition: 3 Leader: 2 Replicas: 2,3,4,1001,0
Isr: 0,1001,2,3,4
Topic: blumfrub Partition: 4 Leader: 0 Replicas: 3,4,1001,0,1
Isr: 0,1001,1,3,4
Topic: blumfrub Partition: 5 Leader: 4 Replicas: 4,1001,0,1,2
Isr: 0,1001,1,2,4
Topic: blumfrub Partition: 6 Leader: 1001 Replicas: 1001,1,2,3,4
Isr: 1001,1,2,3,4
Topic: blumfrub Partition: 7 Leader: 0 Replicas: 0,2,3,4,1001
Isr: 0,1001,2,3,4
Topic: blumfrub Partition: 8 Leader: 1 Replicas: 1,3,4,1001,0
Isr: 0,1001,1,3,4
Topic: blumfrub Partition: 9 Leader: 2 Replicas: 2,4,1001,0,1
Isr: 0,1001,1,2,4
Topic: blumfrub Partition: 10 Leader: 0 Replicas: 3,1001,0,1,2
Isr: 0,1001,1,2,3
Topic: blumfrub Partition: 11 Leader: 4 Replicas: 4,0,1,2,3
Isr: 0,1,2,3,4
Topic: blumfrub Partition: 12 Leader: 1001 Replicas: 1001,2,3,4,0
Isr: 0,1001,2,3,4
Topic: blumfrub Partition: 13 Leader: 0 Replicas: 0,3,4,1001,1
Isr: 0,1001,1,3,4
Topic: blumfrub Partition: 14 Leader: 1 Replicas: 1,4,1001,0,2
Isr: 0,1001,1,2,4
1001 is the new broker.
-jeremy
> On Dec 9, 2016, at 8:55 PM, Jeremy Hansen <[email protected]> wrote:
>
> I added a new host to kafka. Partitions that fall on this new host have a
> very high lag and I’m trying to understand why this would be and how to fix
> it.
>
> iloveconsuming blumfrub 0 5434682
> 7416933 1982251
> iloveconsuming_kf0001.host.com-1481225033576-47393b55-0
> iloveconsuming blumfrub 1 7416828
> 7416875 47
> iloveconsuming_kf0001.host.com-1481225033769-17152bca-0
> iloveconsuming blumfrub 2 7416799
> 7416848 49
> iloveconsuming_kf0001.host.com-1481225033791-77a30285-0
> iloveconsuming blumfrub 3 7416898
> 7416903 5
> iloveconsuming_kf0001.host.com-1481225033822-d088f844-0
> iloveconsuming blumfrub 4 7416891
> 7416925 34
> iloveconsuming_kf0001.host.com-1481225033846-78f8e5b5-0
> iloveconsuming blumfrub 5 7416843
> 7416883 40
> iloveconsuming_kf0001.host.com-1481225033869-54027178-0
> iloveconsuming blumfrub 6 5434720
> 7416896 1982176
> iloveconsuming_kf0001.host.com-1481225033891-cc3f6bf6-0
> iloveconsuming blumfrub 7 7416896
> 7416954 58
> iloveconsuming_kf0001.host.com-1481225033915-79b49de8-0
> iloveconsuming blumfrub 8 7416849
> 7416898 49
> iloveconsuming_kf0001.host.com-1481225033939-1fe784c0-0
> iloveconsuming blumfrub 9 7416898
> 7416917 19
> iloveconsuming_kf0001.host.com-1481225033961-40cc3185-0
> iloveconsuming blumfrub 10 35457186
> 35457221 35
> iloveconsuming_kf0001.host.com-1481225033998-a817062e-0
> iloveconsuming blumfrub 11 7416866
> 7416909 43
> iloveconsuming_kf0001.host.com-1481225034020-7a15999e-0
> iloveconsuming blumfrub 12 5434739
> 7416907 1982168
> iloveconsuming_kf0001.host.com-1481225034043-badde97c-0
> iloveconsuming blumfrub 13 7416818
> 7416865 47
> iloveconsuming_kf0001.host.com-1481225034066-6e77e3dc-0
> iloveconsuming blumfrub 14 7416901
> 7416947 46
> iloveconsuming_kf0002.host.com-1481225107317-32355c51-0
>
> Why do the partitions that fall on the newly added host so lagged?
>
> Thanks
> -jeremy