Re: Kafka Scalability & Partition

2015-11-13 Thread Prabhjot Bharaj
Hi, Having such a model will not scale. I think it it's mentioned in earlier posts as well as some wikis available out there Kafka works very well if you have more partitions, so you can massively parallel writes to Kafka. Also, your application need not send partition ids/numbers, unless you've

Kafka Scalability & Partition

2015-11-13 Thread Thamaraikannan Subramanian
All, I am looking for clarifications. I want to have Highly Scalable Kafka Environment, but I will have my topics without Partitions as my Application mayn't send the Partition Id. My question, will the Kafka Scale (Kafka Clusters) when there are Multiple Topics but they doesn't have any Partitio