Or even simpler: Is there any way to know the number of messages in a topic, in a server? Is that "kafka.logs.topic -> CurrentOffset"? If not, what does that "CurrentOffset" means?
On Tue, Feb 11, 2014 at 7:08 PM, Tomas Nunez <nu...@pythian.com> wrote: > Yes, but this counts how many messages went in that topic, right? This > should always be increasing and never decreasing, if I understand correctly. > > I'm asking that because in my kafka configuration I have 18 topics, and in > all of them but one this metric is increasing. There is a topic where this > metric is going up and down like crazy, and I'm worried that something may > be wrong with it. > > And strangely this happens in 4 of 5 servers. There is a server where this > topic is only increasing, never decreasing... > > > > On Tue, Feb 11, 2014 at 6:49 PM, Neha Narkhede <neha.narkh...@gmail.com>wrote: > >> Yes. All jmx beans start from 0 on broker startup. >> >> Thanks, >> Neha >> >> >> On Tue, Feb 11, 2014 at 9:42 AM, Tomas Nunez <nu...@pythian.com> wrote: >> >> > Then I guess mi next question is: >> > The jmx metric "Kafka -> kafka.BrokerTopicStat.<topic_name> -> >> MessagesIn" >> > counts how many messages went in that topic since kafka was started, >> and it >> > will reset to 0 when I restart the service, right? >> > >> > Same thing for Kafka -> kafka.BrokerAllTopicStat -> MessagesIn, right? >> > >> > Thanks! >> > >> > >> > On Tue, Feb 11, 2014 at 5:35 PM, Tomas Nunez <nu...@pythian.com> wrote: >> > >> > > Yup... I read both of them, but I saw much more data in the jmx and I >> was >> > > trying to understant it to make the most of them :) >> > > >> > > But I'll settle knowing that is the useful data. Thank you both! >> > > >> > > >> > > On Tue, Feb 11, 2014 at 5:05 PM, Jun Rao <jun...@gmail.com> wrote: >> > > >> > >> These are the 0.8 jmx. The 0.7 one can be found in >> > >> >> > >> >> > >> https://cwiki.apache.org/confluence/display/KAFKA/Operations#Operations-Monitoring >> > >> >> > >> Thanks, >> > >> >> > >> Jun >> > >> >> > >> >> > >> On Tue, Feb 11, 2014 at 6:51 AM, Andrew Otto <o...@wikimedia.org> >> > wrote: >> > >> >> > >> > Here tis! >> > >> > >> > >> > https://kafka.apache.org/documentation.html#monitoring >> > >> > >> > >> > >> > >> > On Feb 11, 2014, at 6:50 AM, Tomas Nunez <nu...@pythian.com> >> wrote: >> > >> > >> > >> > > Hi! >> > >> > > >> > >> > > Sorry if this question has already been answered, but I've search >> > the >> > >> > > archives, the project page and the wiki unsuccessfully. >> > >> > > >> > >> > > I'd like to know the meaning of the jmx exposed metrics. I can >> guess >> > >> > based >> > >> > > on the name but I'd like to be sure. Plus, some of them seem to >> be >> > >> reset >> > >> > > when I restart the server (or when a new file is created in the >> > topic >> > >> > > directory, I'm not sure), and some of them don't. >> > >> > > >> > >> > > Is there a doc anywhere with this info? >> > >> > > >> > >> > > PD: I'm using 0.7.2 and I know 0.8 changes some things, but I >> guess >> > >> the >> > >> > > basic stuff will remain the same... >> > >> > > >> > >> > > -- >> > >> > > >> > >> > > >> > >> > > -- >> > >> > > >> > >> > > >> > >> > > >> > >> > >> > >> > >> > >> >> > > >> > > >> > >> > -- >> > >> > >> > -- >> > >> > >> > >> > >> > > -- --
