Re: Log size and retention

2014-03-25 Thread Jun Rao
Yes, on average, each broker will host (total partitions * replication factor) /brokers partitions. Thanks, Jun On Tue, Mar 25, 2014 at 12:04 AM, Tom Amon wrote: > Not really, it doesn't say anything about replication. Should I assume that > replication follows the same rules? In other words,

Re: Log size and retention

2014-03-25 Thread Tom Amon
Not really, it doesn't say anything about replication. Should I assume that replication follows the same rules? In other words, the maximum number of partitions on a single node is (partitions/brokers * replication factor)? Does the f

Re: Log size and retention

2014-03-24 Thread Jun Rao
Does the following help? https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-HowdoIchoosethenumberofpartitionsforatopic ? Thanks, Jun On Mon, Mar 24, 2014 at 4:26 PM, Tom Amon wrote: > Hi All, > > I'm trying to tune the log retention size and have a question. > > I have a replication f

Log size and retention

2014-03-24 Thread Tom Amon
Hi All, I'm trying to tune the log retention size and have a question. I have a replication factor of 3 on a cluster of 5 brokers. How many partitions will a broker host? Is there any way to tell? Or do I have to assume that each broker will host all partitions and size accordingly? Thanks much