Hi Kafka User and Dev team,
I do not see any API to change the producer configuration dynamically at run-time after the producer object has been created. We have situation where our pool is deployed in private cloud (open stack VMs), and we need to manage the lifecycle of the Producer respect to configuration change. Because one pool of machines ( eg search vs payment vs checkout) might have different configuration for same topic and we manage this using internal tool Cloud Configuration Management. Basically, this software notifies us when there is configuration changed happen for the producer. This is need in beginning when we are tuning new pool. Basically we need to be able to restart producer without losing data (we use async with batch mode). Also, we have 4 producers connected to same kafka brokers within one JVM and have true round robin (write to each partition via event count % number of partition), does Kafka Producer maintain TCP connections per Producer object or does Producer have global set of TCP connections shared among producers ? Majority of our Producers will be on VMs (open stack), is there any TCP tuning you guys recommend ? Please let us know answers to questions. We are still on Kafka 0.8. Thanks, Bhavesh