Re: Cluster config

2016-08-02 Thread Guozhang Wang
Which Kafka version are you using and how many consumers? Guozhang On Thu, Jul 28, 2016 at 1:57 PM, Kessiler Rodrigues wrote: > The replication factor is 4. > > > > > On Jul 28, 2016, at 5:55 PM, David Garcia wrote: > > > > What is your replication for these topics? > > > > On 7/28/16, 3:03 PM

Re: Cluster config

2016-07-28 Thread Kessiler Rodrigues
The replication factor is 4. > On Jul 28, 2016, at 5:55 PM, David Garcia wrote: > > What is your replication for these topics? > > On 7/28/16, 3:03 PM, "Kessiler Rodrigues" wrote: > >Hey guys, > >I have > 5k topics with 5 partitions each in my cluster today. > >My actual clu

Re: Cluster config

2016-07-28 Thread David Garcia
What is your replication for these topics? On 7/28/16, 3:03 PM, "Kessiler Rodrigues" wrote: Hey guys, I have > 5k topics with 5 partitions each in my cluster today. My actual cluster configuration is: 6 brokers - 16 vCPUs, 14.4 GB Nowadays, I’m having so

Cluster config

2016-07-28 Thread Kessiler Rodrigues
Hey guys, I have > 5k topics with 5 partitions each in my cluster today. My actual cluster configuration is: 6 brokers - 16 vCPUs, 14.4 GB Nowadays, I’m having some lags when the consumer tries to do rebalance and sometimes even kafka doesn’t get up. What would be a best cluster configurati