Is the data consumed more than once from different consumers? If that's not
the case, byteout could be a bit larger than bytein since we could return a
partial message to the consumer. The partial message will be ignored in the
consumer though.

Thanks,

Jun


On Tue, Apr 29, 2014 at 2:13 PM, Arnaud Lawson <arnaud.law...@velos.io>wrote:

> We are using Kafka 0.7.1 and i believe replication isn't available for this
> version (correct me if i am wrong)...
>
> Basically we want to be able to measure the rate of consumption for some
> particular topic and make sure that this rate is about the same as the rate
> of production for that topic. Which JMX metrics could be appropriate for
> this - for Kafka 0.7? Thanks.
>
>
> On Tue, Apr 29, 2014 at 4:28 PM, Bae, Jae Hyeon <metac...@gmail.com>
> wrote:
>
> > Are you using 0.8? BytesOut will include the traffic for replication. If
> > you have no consumer and replication factor is 2, BytesOut should be
> > exactly double of BytesIn.
> >
> >
> > On Tue, Apr 29, 2014 at 1:26 PM, Arnaud Lawson <arnaud.law...@velos.io
> > >wrote:
> >
> > > Hello,
> > >
> > > After graphing the cumulative values of Bytesin and Bytesout for one of
> > our
> > > Kafka topics, we've noticed that the Bytesout values are sometimes
> > greater
> > > than the Bytesin values. We are not really sure how this would be
> > possible
> > > if the max that a consumer can consume would be what has been put on
> the
> > > queue for that topic. Any explanations? Thanks.
> > >
> > > --
> > >
> > > ​Arnaud Lawson​
> > > ,
> > > ​
> > > Systems Operations Engineer
> > > *VELOS*
> > > Accelerating Machine Learning.
> > >
> > > 440 9th AVE, 11TH FLOOR, NEW YORK, NY 10001
> > > C: (240) 393 - 6703
> > > F: 646.349.4063
> > > E: arnaud.law...@velos.io
> > > W: www.velos.io
> > >
> >
>
>
>
> --
>
> ​Arnaud Lawson​
> ,
> ​
> Systems Operations Engineer
> *VELOS*
> Accelerating Machine Learning.
>
> 440 9th AVE, 11TH FLOOR, NEW YORK, NY 10001
> C: (240) 393 - 6703
> F: 646.349.4063
> E: arnaud.law...@velos.io
> W: www.velos.io
>

Reply via email to