Re: kafka monitoring

2013-10-24 Thread Simon Hørup Eskildsen
This is per broker. What we do is use JMXtrans (https://github.com/jmxtrans/jmxtrans) to pull this data into statsd. To get all messages into the cluster at once, we sum over all the brokers in Graphite. On Thu, Oct 24, 2013 at 4:49 AM, Kane Kane wrote: > I see this MBean: > "kafka.server":nam

Re: Flush configuration per topic

2013-10-16 Thread Simon Hørup Eskildsen
. > > Thanks, > > Jun > > > On Tue, Oct 15, 2013 at 5:47 PM, Simon Hørup Eskildsen > wrote: > > > Do you mean that it's possible to override log configurations per topic > in > > trunk? > > > > Yeah, you're right. :-) I wasn't sure what

Re: Flush configuration per topic

2013-10-15 Thread Simon Hørup Eskildsen
in the same order), nor even > durability (if you have replication > 1), but just recoverability on a > single server in the event of a hard machine crash. > > -Jay > > > On Tue, Oct 15, 2013 at 2:07 PM, Simon Hørup Eskildsen > wrote: > > > 0.8, we're not on

Re: Flush configuration per topic

2013-10-15 Thread Simon Hørup Eskildsen
0.8, we're not on master, but we definitely can be. On Tue, Oct 15, 2013 at 5:03 PM, Jay Kreps wrote: > Hey Simon, > > What version of Kafka are you using? > > -Jay > > > On Tue, Oct 15, 2013 at 9:56 AM, Simon Hørup Eskildsen > wrote: > > > Hi Kafkas!

Flush configuration per topic

2013-10-15 Thread Simon Hørup Eskildsen
Hi Kafkas! Reading through the documentation and code of Kafka, it seems there is no feature to set flushing interval (messages/time) for a specific topic. I am interested in this to get consistency for certain topics by flushing after every message, while having eventual consistency for other top