Hi Dave,
When I tested Kafka, I also observed negative latency sometimes. I guess it is
because the slight clock difference between producers and consumers.
Btw, what is your typical producer-to-consumer latency? My system has an
average of 250 milliseconds. I cannot reduce it anymore.
Best,
Dear Kafka guys,
I measured the latency of kafka system. The producer, kafka servers, and
consumer were running on different machines (AWS EC2 instances). The
producer-to-consumer latency is around 250 milliseconds. Is it a normal value
for kafka system. Can I do better and how? Any comments or
@kafka.apache.org
Subject: Re: Kafka Fault Tolerance Test
This is un-expected. Any error logs / exceptions did you see from the clients
when they can no longer send / fetch from brokers?
Guozhang
On Mon, Jul 18, 2016 at 8:59 AM, Luo, Chao wrote:
> Dear Kafka fans,
>
> I have a concern of test
Dear Kafka fans,
I have a concern of testing Kafka fault tolerance. Or may I did not configure
it right.
I have two kafka servers and one zookeeper, which are running on three
different AWS EC2 instances. I created a topic with one partition and two
replica. First, the two kafka servers were r
it to Kafka Topics, using Kafka
Producer at the end.
Thanks,
Snehal
On 13 July 2016 at 13:31, Luo, Chao wrote:
> Dear Kafka guys,
>
> I just started to build up a Kafka system two weeks ago. Here I have a
> question about how to design/implement the producer.
>
> In my
@kafka.apache.org
Subject: Re: Role of Producer
Could you write them a client that uses the Kafka producer?
You could also write some restful services that send the data to kafka.
If they use MQ you could listen to MQ and send to Kafka.
On Wed, Jul 13, 2016 at 9:31 PM, Luo, Chao wrote:
> Dear Ka
Dear Kafka guys,
I just started to build up a Kafka system two weeks ago. Here I have a question
about how to design/implement the producer.
In my system, there are many data providers. I need to collect real-time data
from them and store it in a NoSQL database. The problem is that different da
