Hello,
Has anyone successfully made replication throttling work? I am doing the
following on Apache Kafka 3.5
./kafka_2.13-3.7.1/bin/kafka-configs.sh \
--bootstrap-server $BROKERS \
--entity-type brokers \
--entity-default \
--alter \
--add-config leader.replication.throttled.rate=50000000 \
--command-config client.properties
./kafka_2.13-3.7.1/bin/kafka-configs.sh \
--bootstrap-server $BROKERS \
--entity-type brokers \
--entity-default \
--alter \
--add-config follower.replication.throttled.rate=50000000 \
--command-config client.properties
TOPICS=$(./kafka_2.13-3.7.1/bin/kafka-topics.sh --bootstrap-server
$BROKERS --list --command-config client.properties)
for TOPIC in $TOPICS; do
echo "Applying throttle to topic: $TOPIC"
./kafka_2.13-3.7.1/bin/kafka-configs.sh \
--bootstrap-server $BROKERS \
--entity-type topics \
--entity-name $TOPIC \
--alter \
--add-config
leader.replication.throttled.replicas=*,follower.replication.throttled.replicas=*
\
--command-config client.properties
done
I have verified that the settings are visible when describing dynamic
configs for both topic and broker. If I then stop a broker to build up a
replication backlog and restart I still see a burst in replication bytes
in/out well beyond 50MB.
Many Thanks,
Jason