Re: Best partition configuration

2013-08-21 Thread Philip O'Toole
1 topic. I don't understand the second question. Philip On Aug 21, 2013, at 9:52 AM, Tom Brown wrote: > Philip, > > How many topics per broker (just one?) And what is the read/write profile > of your setup? > > --Tom > > > On Wed, Aug 21, 2013 at 12:24 PM, Philip O'Toole wrote: > >> On

Re: Best partition configuration

2013-08-21 Thread Jay Kreps
Hey Tom, I tried to expand the FAQ on this, let me know if you feel like it answers your question: https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-HowdoIchoosethenumberofpartitionsforatopic%3F Folks--let me know if I missed anything there. I tried to give both a simple answer and a mor

Re: Best partition configuration

2013-08-21 Thread Tom Brown
Philip, How many topics per broker (just one?) And what is the read/write profile of your setup? --Tom On Wed, Aug 21, 2013 at 12:24 PM, Philip O'Toole wrote: > On Wed, Aug 21, 2013 at 10:06:50AM -0400, Tom Brown wrote: > > I have not been able to find reliable advice regarding how many > par

Re: Best partition configuration

2013-08-21 Thread Philip O'Toole
On Wed, Aug 21, 2013 at 10:06:50AM -0400, Tom Brown wrote: > I have not been able to find reliable advice regarding how many partitions > should exist on a single broker. How many partitions have you used, and > what kind of throughput have you seen? We settled on 8 per broker, and usually run 3 b

RE: Best partition configuration

2013-08-21 Thread Yu, Libo
[mailto:tombrow...@gmail.com] Sent: Wednesday, August 21, 2013 10:07 AM To: users@kafka.apache.org Subject: Best partition configuration I have not been able to find reliable advice regarding how many partitions should exist on a single broker. How many partitions have you used, and what kind of throughput

Best partition configuration

2013-08-21 Thread Tom Brown
I have not been able to find reliable advice regarding how many partitions should exist on a single broker. How many partitions have you used, and what kind of throughput have you seen? Thanks in advance! --Tom