Hi,
We are getting the below exceptions while trying to get the last offset of
a topic. The code being used is taken from here:
https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example
We are finding the lead broker and getting the offsets and noticing the
failures due to th
The metrics for checking that would better be "buffer-available-bytes"
instead of "bufferpool-wait-ratio", checking on its value approaching 0.
Guozhang
On Wed, May 6, 2015 at 3:02 AM, mete wrote:
> Hey Guozhang,
>
> I could go with both of the options, eventually i want to detect if there
> is
Hello,
I am having a most annoying issue. I am trying to create a local cluster
via docker for development. I am using docker compose. I have zookeeper and
kafka in seperate containers using docker linkages to set up communication.
I have a seperate service that is trying to produce onto a topic.
Sent it too early..
We have around 5K topics and 75K partitions, with a replication factor of
3. One of our brokers went down due to disk space issues for logs. After
fixing that, the broker would not come up and throw Out Of Memory issues
while reading index files. It turned out that we had to tu
We had a situation where the kafka 0.8.2 broker would not come up
A consumer thread can consume multiple partitions. This is not unusual, in
practice.
In the example you gave, if multiple high-level consumers are using the
same group id, they will automatically rebalance the partition assignment
between them as consumers dynamically join and leave the group. S
I noticed similar behavior on similar small 3 Kafka broker with 3 ZooKeeper
node cluster, Kafka 0.8.1.1 and ZooKeeper 3.4.6, with ~5K topics, most of
them with single partition, replication factor of 1, and most of them
unused for long time, but brokers are busy and performance especially
producer
Hi,
I've started playing with Kafka_2.10-0.8.2.1 (a cluster of 3 VM nodes). I
found a strange behaviour: Inbound throughput was about 60 thousand messages
per second for a partition with 50 partitions. But after adding topics with
950 partitions total, the performance dropped under 25 thousand
Hey Guozhang,
I could go with both of the options, eventually i want to detect if there
is a problem and isolate it from the rest of the system. And i am trying to
decide what would be the appropriate metrics to do that.
Best
On Wed, May 6, 2015 at 6:35 AM, Guozhang Wang wrote:
>1. KAFKA
