Re: Flush configuration per topic

2013-10-26 Thread Felix GV
Ok cool, thanks Jun :) -- Felix On Fri, Oct 25, 2013 at 11:34 PM, Jun Rao wrote: > Yes, there won't be any feature development in 0.7. > > Thanks, > > Jun > > > On Fri, Oct 25, 2013 at 6:32 PM, Felix GV wrote: > > > Hi guys, > > > > I don't see log.flush.interval being available on per-topic

Re: Flush configuration per topic

2013-10-25 Thread Jun Rao
Yes, there won't be any feature development in 0.7. Thanks, Jun On Fri, Oct 25, 2013 at 6:32 PM, Felix GV wrote: > Hi guys, > > I don't see log.flush.interval being available on per-topic basis in 0.7.2 > either (only the time interval is configurable per topic), as in 0.8. > > Is it correct

Re: Flush configuration per topic

2013-10-25 Thread Felix GV
Hi guys, I don't see log.flush.interval being available on per-topic basis in 0.7.2 either (only the time interval is configurable per topic), as in 0.8. Is it correct to say that this is only going to be available in 0.8.1 and isn't available in 0.7.x? Thanks a lot guys (: ... -- Felix On Fr

Re: Flush configuration per topic

2013-10-18 Thread Jay Kreps
Both. On Thursday, October 17, 2013, Steve Morin wrote: > Is there only time delay or can it be set to flush for every message with > the obvious performance hit? > > > On Wed, Oct 16, 2013 at 9:49 AM, Jay Kreps > > wrote: > > > Yes, the change in trunk is that all log configurations are automati

Re: Flush configuration per topic

2013-10-17 Thread Steve Morin
Is there only time delay or can it be set to flush for every message with the obvious performance hit? On Wed, Oct 16, 2013 at 9:49 AM, Jay Kreps wrote: > Yes, the change in trunk is that all log configurations are automatically > available at both the log level and the global default level and

Re: Flush configuration per topic

2013-10-16 Thread Jay Kreps
Yes, the change in trunk is that all log configurations are automatically available at both the log level and the global default level and can be set at topic creation time or changed later without bouncing any servers. -Jay On Tue, Oct 15, 2013 at 5:47 PM, Simon Hørup Eskildsen wrote: > Do you

Re: Flush configuration per topic

2013-10-16 Thread Simon Hørup Eskildsen
That's only the time delay. There seems to be no option to persist on every message. On Wed, Oct 16, 2013 at 12:05 AM, Jun Rao wrote: > In 0.8, we do have "log.flush.interval.ms.per.topic" (see > http://kafka.apache.org/documentation.html#brokerconfigs for details). > > Thanks, > > Jun > > > On

Re: Flush configuration per topic

2013-10-15 Thread Jun Rao
In 0.8, we do have "log.flush.interval.ms.per.topic" (see http://kafka.apache.org/documentation.html#brokerconfigs for details). Thanks, Jun On Tue, Oct 15, 2013 at 5:47 PM, Simon Hørup Eskildsen wrote: > Do you mean that it's possible to override log configurations per topic in > trunk? > > Y

Re: Flush configuration per topic

2013-10-15 Thread Simon Hørup Eskildsen
Do you mean that it's possible to override log configurations per topic in trunk? Yeah, you're right. :-) I wasn't sure what to call it if not consistency, even though I know that sort of has another meaning in this context. On Tue, Oct 15, 2013 at 6:53 PM, Jay Kreps wrote: > Yeah, looks like

Re: Flush configuration per topic

2013-10-15 Thread Jay Kreps
Yeah, looks like you are right, we don't have the per-topic override in 0.8 :-( All log configurations are overridable in trunk which will be 0.8.1. Just to be totally clear this setting does not impact consistency (i.e. all replicas will have the same messages in the same order), nor even durabi

Re: Flush configuration per topic

2013-10-15 Thread Simon Hørup Eskildsen
0.8, we're not on master, but we definitely can be. On Tue, Oct 15, 2013 at 5:03 PM, Jay Kreps wrote: > Hey Simon, > > What version of Kafka are you using? > > -Jay > > > On Tue, Oct 15, 2013 at 9:56 AM, Simon Hørup Eskildsen > wrote: > > > Hi Kafkas! > > > > Reading through the documentation a

Re: Flush configuration per topic

2013-10-15 Thread Jay Kreps
Hey Simon, What version of Kafka are you using? -Jay On Tue, Oct 15, 2013 at 9:56 AM, Simon Hørup Eskildsen wrote: > Hi Kafkas! > > Reading through the documentation and code of Kafka, it seems there is no > feature to set flushing interval (messages/time) for a specific topic. I am > interest