Let's say a consumer wants to fetch 1000 bytes and there are two messages
in the broker each of 600 bytes. The broker will give 1000 bytes to the
consumer. The consumer will only be able to use the first 600 bytes since
the remaining 400 bytes doesn't form a full message.
0.7 jmx are documented in
Thank you Jun,
What could a partial message be? A consumer fetching for messages on an
empty queue and receiving a message representing that fact?
As an example below i just ran a test using the producer & consumer shells
and JMXTerm. NumProduceRequests went from 13, 14 to 15 as i added values
on
Is the data consumed more than once from different consumers? If that's not
the case, byteout could be a bit larger than bytein since we could return a
partial message to the consumer. The partial message will be ignored in the
consumer though.
Thanks,
Jun
On Tue, Apr 29, 2014 at 2:13 PM, Arnau
We are using Kafka 0.7.1 and i believe replication isn't available for this
version (correct me if i am wrong)...
Basically we want to be able to measure the rate of consumption for some
particular topic and make sure that this rate is about the same as the rate
of production for that topic. Which
Done, let me know if you want more changes.
Tim
On Tue, Apr 29, 2014 at 1:54 PM, Sergiy Zuban wrote:
> Could someone please update Perl client information at
> https://cwiki.apache.org/confluence/display/KAFKA/Clients#Clients-Perl
>
> 1. GZIP and Snappy compression supported
> 2. Update formatt
Could someone please update Perl client information at
https://cwiki.apache.org/confluence/display/KAFKA/Clients#Clients-Perl
1. GZIP and Snappy compression supported
2. Update formatting to match other clients formatting:
- make Maintainer/License bold
- convert author's name to a mailto: hype
Are you using 0.8? BytesOut will include the traffic for replication. If
you have no consumer and replication factor is 2, BytesOut should be
exactly double of BytesIn.
On Tue, Apr 29, 2014 at 1:26 PM, Arnaud Lawson wrote:
> Hello,
>
> After graphing the cumulative values of Bytesin and Bytesout
Hello,
After graphing the cumulative values of Bytesin and Bytesout for one of our
Kafka topics, we've noticed that the Bytesout values are sometimes greater
than the Bytesin values. We are not really sure how this would be possible
if the max that a consumer can consume would be what has been put
looking to see if someone has implemented an inMemory style broker such
that i can junit my producer and consumer code in absence of a real kafka
broker listening somewhere. The scaffolding of having to spin up even a
singleton broker and zk for the purpose of continuous build and junit test
is hea
For 2), do you have a topic with at least 2 replicas?
Yes, all of our topics are configured with a replication factor of 3.
Here's the output of --describe on one of them:
Topic:QProcTopic4 PartitionCount:16 ReplicationFactor:3 Configs:
Topic: QProcTopic4 Partition: 0 Leader: 0 Replicas: 0,1,2 I
Hi Mike,
Do you just need a socket server which someone can talk to following the
kafka server protocol or you need other funtionalities of the server?
Guozhang
On Tue, Apr 29, 2014 at 10:41 AM, Mike Marzo
wrote:
> Is there any good mock impls of kafka that can be leveraged in junit tests?
>
Is there any good mock impls of kafka that can be leveraged in junit tests?
Hi Chris,
Kafka producer doesn't require zookeeper anymore, so you can simply
connect to one of the brokers directly.
Tim
On Tue, Apr 29, 2014 at 9:23 AM, Chris Helck wrote:
> I have a few newbie questions. I need to create a Producer that sends
> messages to Kafka brokers.
>
> Does a machine
I have a few newbie questions. I need to create a Producer that sends messages
to Kafka brokers.
Does a machine running a Kafka client (Producer) need its own instance of
ZooKeeper running? Or does is simply connect to the ZooKeeper that is running
remotely with the Kafka brokers?
The Apache Kafka community is pleased to announce the general availability
release of Apache Kafka 0.8.1.1.
The 0.8.1.1 is a maintenance release with bug fixes for the 0.8.1 release.
Changes in this release:
https://archive.apache.org/dist/kafka/0.8.1.1/RELEASE_NOTES.html.
Apache Kafka is high-
15 matches
Mail list logo
