Do you mean the # messages stored in the broker (since old messages are deleted automatically)? We don't have that jmx right now, but it's probably useful to add one. We do have a jmx on # unconsumed messages for a given consumer.
Thanks, Jun On Thu, Feb 13, 2014 at 5:18 AM, Tomas Nunez <nu...@pythian.com> wrote: > Or even simpler: Is there any way to know the number of messages in a > topic, in a server? Is that "kafka.logs.topic -> CurrentOffset"? If not, > what does that "CurrentOffset" means? > > > On Tue, Feb 11, 2014 at 7:08 PM, Tomas Nunez <nu...@pythian.com> wrote: > > > Yes, but this counts how many messages went in that topic, right? This > > should always be increasing and never decreasing, if I understand > correctly. > > > > I'm asking that because in my kafka configuration I have 18 topics, and > in > > all of them but one this metric is increasing. There is a topic where > this > > metric is going up and down like crazy, and I'm worried that something > may > > be wrong with it. > > > > And strangely this happens in 4 of 5 servers. There is a server where > this > > topic is only increasing, never decreasing... > > > > > > > > On Tue, Feb 11, 2014 at 6:49 PM, Neha Narkhede <neha.narkh...@gmail.com > >wrote: > > > >> Yes. All jmx beans start from 0 on broker startup. > >> > >> Thanks, > >> Neha > >> > >> > >> On Tue, Feb 11, 2014 at 9:42 AM, Tomas Nunez <nu...@pythian.com> wrote: > >> > >> > Then I guess mi next question is: > >> > The jmx metric "Kafka -> kafka.BrokerTopicStat.<topic_name> -> > >> MessagesIn" > >> > counts how many messages went in that topic since kafka was started, > >> and it > >> > will reset to 0 when I restart the service, right? > >> > > >> > Same thing for Kafka -> kafka.BrokerAllTopicStat -> MessagesIn, right? > >> > > >> > Thanks! > >> > > >> > > >> > On Tue, Feb 11, 2014 at 5:35 PM, Tomas Nunez <nu...@pythian.com> > wrote: > >> > > >> > > Yup... I read both of them, but I saw much more data in the jmx and > I > >> was > >> > > trying to understant it to make the most of them :) > >> > > > >> > > But I'll settle knowing that is the useful data. Thank you both! > >> > > > >> > > > >> > > On Tue, Feb 11, 2014 at 5:05 PM, Jun Rao <jun...@gmail.com> wrote: > >> > > > >> > >> These are the 0.8 jmx. The 0.7 one can be found in > >> > >> > >> > >> > >> > > >> > https://cwiki.apache.org/confluence/display/KAFKA/Operations#Operations-Monitoring > >> > >> > >> > >> Thanks, > >> > >> > >> > >> Jun > >> > >> > >> > >> > >> > >> On Tue, Feb 11, 2014 at 6:51 AM, Andrew Otto <o...@wikimedia.org> > >> > wrote: > >> > >> > >> > >> > Here tis! > >> > >> > > >> > >> > https://kafka.apache.org/documentation.html#monitoring > >> > >> > > >> > >> > > >> > >> > On Feb 11, 2014, at 6:50 AM, Tomas Nunez <nu...@pythian.com> > >> wrote: > >> > >> > > >> > >> > > Hi! > >> > >> > > > >> > >> > > Sorry if this question has already been answered, but I've > search > >> > the > >> > >> > > archives, the project page and the wiki unsuccessfully. > >> > >> > > > >> > >> > > I'd like to know the meaning of the jmx exposed metrics. I can > >> guess > >> > >> > based > >> > >> > > on the name but I'd like to be sure. Plus, some of them seem to > >> be > >> > >> reset > >> > >> > > when I restart the server (or when a new file is created in the > >> > topic > >> > >> > > directory, I'm not sure), and some of them don't. > >> > >> > > > >> > >> > > Is there a doc anywhere with this info? > >> > >> > > > >> > >> > > PD: I'm using 0.7.2 and I know 0.8 changes some things, but I > >> guess > >> > >> the > >> > >> > > basic stuff will remain the same... > >> > >> > > > >> > >> > > -- > >> > >> > > > >> > >> > > > >> > >> > > -- > >> > >> > > > >> > >> > > > >> > >> > > > >> > >> > > >> > >> > > >> > >> > >> > > > >> > > > >> > > >> > -- > >> > > >> > > >> > -- > >> > > >> > > >> > > >> > > >> > > > > > > -- > > > -- > > > >