Yes, I meant messages stored in the broker. We have the feeling that some messages are being lost in the mirrormaker process, and I'd like to make sure that's not happening. As the deployment is really young, we still haven't deleted any messages, so the number of messages in FE and BE should be the same, that's why I was thinking about that metric. But if we don't have it, I'm looking for new approaches...
On Thu, Feb 13, 2014 at 5:01 PM, Jun Rao <jun...@gmail.com> wrote: > Do you mean the # messages stored in the broker (since old messages are > deleted automatically)? We don't have that jmx right now, but it's probably > useful to add one. We do have a jmx on # unconsumed messages for a given > consumer. > > Thanks, > > Jun > > > On Thu, Feb 13, 2014 at 5:18 AM, Tomas Nunez <nu...@pythian.com> wrote: > > > Or even simpler: Is there any way to know the number of messages in a > > topic, in a server? Is that "kafka.logs.topic -> CurrentOffset"? If not, > > what does that "CurrentOffset" means? > > > > > > On Tue, Feb 11, 2014 at 7:08 PM, Tomas Nunez <nu...@pythian.com> wrote: > > > > > Yes, but this counts how many messages went in that topic, right? This > > > should always be increasing and never decreasing, if I understand > > correctly. > > > > > > I'm asking that because in my kafka configuration I have 18 topics, and > > in > > > all of them but one this metric is increasing. There is a topic where > > this > > > metric is going up and down like crazy, and I'm worried that something > > may > > > be wrong with it. > > > > > > And strangely this happens in 4 of 5 servers. There is a server where > > this > > > topic is only increasing, never decreasing... > > > > > > > > > > > > On Tue, Feb 11, 2014 at 6:49 PM, Neha Narkhede < > neha.narkh...@gmail.com > > >wrote: > > > > > >> Yes. All jmx beans start from 0 on broker startup. > > >> > > >> Thanks, > > >> Neha > > >> > > >> > > >> On Tue, Feb 11, 2014 at 9:42 AM, Tomas Nunez <nu...@pythian.com> > wrote: > > >> > > >> > Then I guess mi next question is: > > >> > The jmx metric "Kafka -> kafka.BrokerTopicStat.<topic_name> -> > > >> MessagesIn" > > >> > counts how many messages went in that topic since kafka was started, > > >> and it > > >> > will reset to 0 when I restart the service, right? > > >> > > > >> > Same thing for Kafka -> kafka.BrokerAllTopicStat -> MessagesIn, > right? > > >> > > > >> > Thanks! > > >> > > > >> > > > >> > On Tue, Feb 11, 2014 at 5:35 PM, Tomas Nunez <nu...@pythian.com> > > wrote: > > >> > > > >> > > Yup... I read both of them, but I saw much more data in the jmx > and > > I > > >> was > > >> > > trying to understant it to make the most of them :) > > >> > > > > >> > > But I'll settle knowing that is the useful data. Thank you both! > > >> > > > > >> > > > > >> > > On Tue, Feb 11, 2014 at 5:05 PM, Jun Rao <jun...@gmail.com> > wrote: > > >> > > > > >> > >> These are the 0.8 jmx. The 0.7 one can be found in > > >> > >> > > >> > >> > > >> > > > >> > > > https://cwiki.apache.org/confluence/display/KAFKA/Operations#Operations-Monitoring > > >> > >> > > >> > >> Thanks, > > >> > >> > > >> > >> Jun > > >> > >> > > >> > >> > > >> > >> On Tue, Feb 11, 2014 at 6:51 AM, Andrew Otto <o...@wikimedia.org > > > > >> > wrote: > > >> > >> > > >> > >> > Here tis! > > >> > >> > > > >> > >> > https://kafka.apache.org/documentation.html#monitoring > > >> > >> > > > >> > >> > > > >> > >> > On Feb 11, 2014, at 6:50 AM, Tomas Nunez <nu...@pythian.com> > > >> wrote: > > >> > >> > > > >> > >> > > Hi! > > >> > >> > > > > >> > >> > > Sorry if this question has already been answered, but I've > > search > > >> > the > > >> > >> > > archives, the project page and the wiki unsuccessfully. > > >> > >> > > > > >> > >> > > I'd like to know the meaning of the jmx exposed metrics. I > can > > >> guess > > >> > >> > based > > >> > >> > > on the name but I'd like to be sure. Plus, some of them seem > to > > >> be > > >> > >> reset > > >> > >> > > when I restart the server (or when a new file is created in > the > > >> > topic > > >> > >> > > directory, I'm not sure), and some of them don't. > > >> > >> > > > > >> > >> > > Is there a doc anywhere with this info? > > >> > >> > > > > >> > >> > > PD: I'm using 0.7.2 and I know 0.8 changes some things, but I > > >> guess > > >> > >> the > > >> > >> > > basic stuff will remain the same... > > >> > >> > > > > >> > >> > > -- > > >> > >> > > > > >> > >> > > > > >> > >> > > -- > > >> > >> > > > > >> > >> > > > > >> > >> > > > > >> > >> > > > >> > >> > > > >> > >> > > >> > > > > >> > > > > >> > > > >> > -- > > >> > > > >> > > > >> > -- > > >> > > > >> > > > >> > > > >> > > > >> > > > > > > > > > > -- > > > > > > -- > > > > > > > > > -- --
