Re: Question regarding topic creation

2014-10-05 Thread Jun Rao
In 0.8.x, a topic doesn't necessarily get created on every broker. Each topic can have one or more partitions. Each partition can have one or more replicas. In general, the replicas are spread over the brokers in a cluster. The producer obtains the metadata of a topic to determine which broker to s

Re: Question regarding topic creation

2014-10-03 Thread Gwen Shapira
By "created in all 10 brokers" you mean 10 partitions? Or 10 replicas for each partition? You can create a topic with either option, or both. By specifing partition number and number of replicas when creating the topic or by setting a default for all future topics. In my opinion, 10 replicas is

Question regarding topic creation

2014-10-03 Thread Sreenivasulu Nallapati
Hello, I am new to Kafka and trying to evaluate for one of our use case. I have a basic question regarding topic. Assume we have a 10 broker cluster. If a create a Topic, will it be created in all 10 brokers? If not, how it manages internally if we try to send a message to that perticular topic?