How many partitions in your topic? Are you talking about Producing or Consuming? All those factors will determine the number of TCP connections to your Kafka cluster.
In any event, Kafka can support lots, and lots, and lots, of connections (I've run systems with hundreds of connections to a 3-broker Kafka cluster). Almost certainly you'll hit bottlenecks elsewhere in your system before you cause Kafka problems. If in doubt, be sure to monitor your Kafka system (CPU, IO, RAM etc, etc). Be sure to keep an eye on Zookeeper too, as it also has more work to do, as the number of connections to Kafka increases. Philip ----------------------------------------- http://www.philipotoole.com On Wednesday, July 23, 2014 10:43 AM, Nickolas Simi <ns...@blinkx.com> wrote: Hello All, I hope that this is the right place for this question, I am trying to determine if I have a separate connection per kafka topic that I want to consume if that would cause any performance, or usage problems for my kafka servers or the clients? Thank you, Nick The information and attachments in this email may contain privileged, proprietary and confidential information for its intended recipients. If you have received this email in error, please notify the sender and delete the email. The contents of this message are subject to written reconfirmation from an authorized representative of blinkx.
