*Kafka v1.1.0*

Hi,


I have been experimenting with the transactional producer in Kafka and have
a question related to it.


We are moving towards storing partition offsets outside of Kafka. We have a
lot of consumers reading off few busy topics. We started seeing a lot of
traffic on the __consumer_offsets topic, due to which the brokers became
extremely hot. We found out there is no way to change the partition count
of that topic, other than to create a new cluster with desired config and
migrate data to it - this is not practical for us (not in the short term,
at least).


Given this, I believe I can't use the transactional producer since it
assumes offsets are written to the Kafka topic. Is that correct? What are
my options?


Thanks
Tushar

Reply via email to