Hey Ravi,
I think what you want is available via log4j and jmx. Log4j is
pluggable you can plug in any java code at runtime you want to handle
the log events. JMX can be called in any way you like too.
-Jay
On Mon, Jun 23, 2014 at 11:51 PM, ravi singh wrote:
> Primarily we want to log below dat
Most of these are available via JMX and others can be available via
zookeeper. I'm not sure why/how you would monitor "messages being deleted
by the broker". In general, monitoring via JMX is preferable to scraping
logs.
Thanks,
Neha
On Mon, Jun 23, 2014 at 11:51 PM, ravi singh wrote:
> Primar
Primarily we want to log below date(although this is not the exhaustive
list):
+ any error/exception during kafka start/stop
+ any error/exception while broker is running
+ broker state changes like leader re-election, broker goes down,
+ Current live brokers
+ new topic creation
+ when messages a
Hi Ravi
You’ve probably seen this already but I thought I’d point it out just in case:
https://kafka.apache.org/documentation.html#monitoring. In our case we are
using https://github.com/pingles/kafka-riemann-reporter to send metrics to
Riemann but you could get the metrics through JMX to send
What kind of broker metrics are you trying to push to this centralized
logging framework?
Thanks,
Neha
On Jun 23, 2014 8:51 PM, "ravi singh" wrote:
> Thanks Guozhang/Neha for replies.
> Here's my use case:
>
> We use proprietary application logging in our apps. We are planning to use
> Kafka br
Thanks Guozhang/Neha for replies.
Here's my use case:
We use proprietary application logging in our apps. We are planning to use
Kafka brokers in production , but apart from the logs which are already
logged using log4j in kafka we want to log the broker stats using our
centralized application lo
Ravi,
Our goal is to provide the best implementation of a set of useful
abstractions and features in Kafka. The motivation behind this philosophy
is performance and simplicity at the cost of flexibility. In most cases, we
can argue that the loss in flexibility is minimal since you can always get
t
I am not sure I understand your question. Could you elaborate more on your
needs?
Guozhang
On Sat, Jun 21, 2014 at 9:24 AM, ravi singh wrote:
> How do I intercept Kakfa broker operation so that features such as
> security,logging,etc can be implemented as a pluggable filter. For example
> we h
