Re: kafka log flush questions

2015-08-07 Thread Tao Feng
Thanks Ben for the detail explanation. -Tao On Fri, Aug 7, 2015 at 3:28 AM, Ben Stopford wrote: > Hi Tao > > 1. I am wondering if the fsync operation is called by the last two routines > internally? > => Yes > > 2. If log.flush.interval.ms is not specified, is it true that Kafka let OS > to hand

Re: kafka log flush questions

2015-08-07 Thread Ben Stopford
Hi Tao 1. I am wondering if the fsync operation is called by the last two routines internally? => Yes 2. If log.flush.interval.ms is not specified, is it true that Kafka let OS to handle pagecache flush in background? => Yes 3. If we specify ack=1 and ack=-1 in new producer, do those request onl

kafka log flush questions

2015-08-06 Thread Tao Feng
Hi , I am trying to understand the Kafka log flush behavior. My understanding is when the broker specifies broker config param "log.flush.interval.ms", it will specify log config param "flush.ms" internally. In logManager logic, when the log exceed flush.ms, it will call Log.flush which will call