Producer distributes messages uniformly across the partitions. This does not work very well when some of the brokers are much slower than others. Is there a way to temporarily avoid such slow brokers?
While async producers, I could avoid producers that have lot more messages in their internal queue compared to others (through my own Partitioners). But the queue size is not available. tried to maintain my own estimate of queue size using 'CallbackHandler', but API does not seem to provide enough info (it provides partition id, but not broker id. plus, CallbackHandler seems to be removed in 0.8). any suggestions? Kafka version : 0.7.1 thanks, Raghu.
