Is the data consumed more than once from different consumers? If that's not the case, byteout could be a bit larger than bytein since we could return a partial message to the consumer. The partial message will be ignored in the consumer though.
Thanks, Jun On Tue, Apr 29, 2014 at 2:13 PM, Arnaud Lawson <arnaud.law...@velos.io>wrote: > We are using Kafka 0.7.1 and i believe replication isn't available for this > version (correct me if i am wrong)... > > Basically we want to be able to measure the rate of consumption for some > particular topic and make sure that this rate is about the same as the rate > of production for that topic. Which JMX metrics could be appropriate for > this - for Kafka 0.7? Thanks. > > > On Tue, Apr 29, 2014 at 4:28 PM, Bae, Jae Hyeon <metac...@gmail.com> > wrote: > > > Are you using 0.8? BytesOut will include the traffic for replication. If > > you have no consumer and replication factor is 2, BytesOut should be > > exactly double of BytesIn. > > > > > > On Tue, Apr 29, 2014 at 1:26 PM, Arnaud Lawson <arnaud.law...@velos.io > > >wrote: > > > > > Hello, > > > > > > After graphing the cumulative values of Bytesin and Bytesout for one of > > our > > > Kafka topics, we've noticed that the Bytesout values are sometimes > > greater > > > than the Bytesin values. We are not really sure how this would be > > possible > > > if the max that a consumer can consume would be what has been put on > the > > > queue for that topic. Any explanations? Thanks. > > > > > > -- > > > > > > Arnaud Lawson > > > , > > > > > > Systems Operations Engineer > > > *VELOS* > > > Accelerating Machine Learning. > > > > > > 440 9th AVE, 11TH FLOOR, NEW YORK, NY 10001 > > > C: (240) 393 - 6703 > > > F: 646.349.4063 > > > E: arnaud.law...@velos.io > > > W: www.velos.io > > > > > > > > > -- > > Arnaud Lawson > , > > Systems Operations Engineer > *VELOS* > Accelerating Machine Learning. > > 440 9th AVE, 11TH FLOOR, NEW YORK, NY 10001 > C: (240) 393 - 6703 > F: 646.349.4063 > E: arnaud.law...@velos.io > W: www.velos.io >
