RE: Problems with replication and performance

2016-07-27 Thread Krzysztof Nawara
se of everyone else. Krzysiek From: David Garcia [dav...@spiceworks.com] Sent: 28 July 2016 00:13 To: users@kafka.apache.org Subject: Re: Problems with replication and performance Sounds like you might want to go the partition route: http://www.confluent.io/blog/how-to-choose-the-number-

Re: Problems with replication and performance

2016-07-27 Thread David Garcia
Sounds like you might want to go the partition route: http://www.confluent.io/blog/how-to-choose-the-number-of-topicspartitions-in-a-kafka-cluster/ If you lose a broker (and you went the topic route), the probability that an arbitrary topic was on the broker is higher than if you had gone the pa

Problems with replication and performance

2016-07-27 Thread Krzysztof Nawara
Hi! I've been testing Kafka. I've hit some problems, but I can't really understand what's going on, so I'd like to ask for your help. Situation - we want to decide whether to go for many topics/a couple of partitions or the other way around, so I'be trying to benchmark both cases. During tests