Which version of Kafka are you using? How did you run the tool exactly? Can you share the command line?
On Tue, Dec 13, 2016 at 6:05 PM, Jeremy Hansen <jer...@skidrow.la> wrote: > The new host has been in place for over a week. Lag is still high on > partitions that exist on that new host. Should I attempt another reassign? > > Thanks > -jeremy > > > On Dec 13, 2016, at 5:43 PM, Apurva Mehta <apu...@confluent.io> wrote: > > > > How did you add the host and when did you measure the lag? If you used > the > > reassign-partitions script, it will move partitions to the new host, but > > the data copy will take time. in that period, those partitions will lag. > > However, once the reassign-partitions script finishes, the partitions on > > the new replica should be caught up and no longer demonstrate any lag. > > > >> On Fri, Dec 9, 2016 at 8:58 PM, Jeremy Hansen <jer...@skidrow.la> > wrote: > >> > >> Here’s the topic description: > >> > >> Topic:blumfrub PartitionCount:15 ReplicationFactor:5 Configs: > >> Topic: blumfrub Partition: 0 Leader: 1001 Replicas: > >> 1001,0,1,2,3 Isr: 0,1001,1,2,3 > >> Topic: blumfrub Partition: 1 Leader: 0 Replicas: > >> 0,1,2,3,4 Isr: 0,1,2,3,4 > >> Topic: blumfrub Partition: 2 Leader: 1 Replicas: > >> 1,2,3,4,1001 Isr: 1001,1,2,3,4 > >> Topic: blumfrub Partition: 3 Leader: 2 Replicas: > >> 2,3,4,1001,0 Isr: 0,1001,2,3,4 > >> Topic: blumfrub Partition: 4 Leader: 0 Replicas: > >> 3,4,1001,0,1 Isr: 0,1001,1,3,4 > >> Topic: blumfrub Partition: 5 Leader: 4 Replicas: > >> 4,1001,0,1,2 Isr: 0,1001,1,2,4 > >> Topic: blumfrub Partition: 6 Leader: 1001 Replicas: > >> 1001,1,2,3,4 Isr: 1001,1,2,3,4 > >> Topic: blumfrub Partition: 7 Leader: 0 Replicas: > >> 0,2,3,4,1001 Isr: 0,1001,2,3,4 > >> Topic: blumfrub Partition: 8 Leader: 1 Replicas: > >> 1,3,4,1001,0 Isr: 0,1001,1,3,4 > >> Topic: blumfrub Partition: 9 Leader: 2 Replicas: > >> 2,4,1001,0,1 Isr: 0,1001,1,2,4 > >> Topic: blumfrub Partition: 10 Leader: 0 Replicas: > >> 3,1001,0,1,2 Isr: 0,1001,1,2,3 > >> Topic: blumfrub Partition: 11 Leader: 4 Replicas: > >> 4,0,1,2,3 Isr: 0,1,2,3,4 > >> Topic: blumfrub Partition: 12 Leader: 1001 Replicas: > >> 1001,2,3,4,0 Isr: 0,1001,2,3,4 > >> Topic: blumfrub Partition: 13 Leader: 0 Replicas: > >> 0,3,4,1001,1 Isr: 0,1001,1,3,4 > >> Topic: blumfrub Partition: 14 Leader: 1 Replicas: > >> 1,4,1001,0,2 Isr: 0,1001,1,2,4 > >> > >> 1001 is the new broker. > >> > >> -jeremy > >> > >> > >> > >>> On Dec 9, 2016, at 8:55 PM, Jeremy Hansen <jer...@skidrow.la> wrote: > >>> > >>> I added a new host to kafka. Partitions that fall on this new host > have > >> a very high lag and I’m trying to understand why this would be and how > to > >> fix it. > >>> > >>> iloveconsuming blumfrub 0 > >> 5434682 7416933 1982251 > iloveconsuming_kf0001.host. > >> com-1481225033576-47393b55-0 > >>> iloveconsuming blumfrub 1 > >> 7416828 7416875 47 > iloveconsuming_kf0001.host. > >> com-1481225033769-17152bca-0 > >>> iloveconsuming blumfrub 2 > >> 7416799 7416848 49 > iloveconsuming_kf0001.host. > >> com-1481225033791-77a30285-0 > >>> iloveconsuming blumfrub 3 > >> 7416898 7416903 5 > iloveconsuming_kf0001.host. > >> com-1481225033822-d088f844-0 > >>> iloveconsuming blumfrub 4 > >> 7416891 7416925 34 > iloveconsuming_kf0001.host. > >> com-1481225033846-78f8e5b5-0 > >>> iloveconsuming blumfrub 5 > >> 7416843 7416883 40 > iloveconsuming_kf0001.host. > >> com-1481225033869-54027178-0 > >>> iloveconsuming blumfrub 6 > >> 5434720 7416896 1982176 > iloveconsuming_kf0001.host. > >> com-1481225033891-cc3f6bf6-0 > >>> iloveconsuming blumfrub 7 > >> 7416896 7416954 58 > iloveconsuming_kf0001.host. > >> com-1481225033915-79b49de8-0 > >>> iloveconsuming blumfrub 8 > >> 7416849 7416898 49 > iloveconsuming_kf0001.host. > >> com-1481225033939-1fe784c0-0 > >>> iloveconsuming blumfrub 9 > >> 7416898 7416917 19 > iloveconsuming_kf0001.host. > >> com-1481225033961-40cc3185-0 > >>> iloveconsuming blumfrub 10 > >> 35457186 35457221 35 > iloveconsuming_kf0001.host. > >> com-1481225033998-a817062e-0 > >>> iloveconsuming blumfrub 11 > >> 7416866 7416909 43 > iloveconsuming_kf0001.host. > >> com-1481225034020-7a15999e-0 > >>> iloveconsuming blumfrub 12 > >> 5434739 7416907 1982168 > iloveconsuming_kf0001.host. > >> com-1481225034043-badde97c-0 > >>> iloveconsuming blumfrub 13 > >> 7416818 7416865 47 > iloveconsuming_kf0001.host. > >> com-1481225034066-6e77e3dc-0 > >>> iloveconsuming blumfrub 14 > >> 7416901 7416947 46 > iloveconsuming_kf0002.host. > >> com-1481225107317-32355c51-0 > >>> > >>> Why do the partitions that fall on the newly added host so lagged? > >>> > >>> Thanks > >>> -jeremy > >> > >> > >
