FW: fsync behaviour

2014-08-20 Thread Manjunath Shivakumar
Hi, Cross posting to devs for elaboration. Thanks, Manju From: Manjunath Shivakumar [manjunath.shivaku...@betfair.com] Sent: 20 August 2014 02:00 To: us...@kafka.apache.org Subject: fsync behaviour Hi, I wanted to understand the exact behaviour of kafka

Kafka Topic segregation

2014-08-21 Thread Manjunath Shivakumar
Hi, Is it possible to configure different topics to be hosted on different data directories? We have different topics with hugely different data throughput rates, so we were looking to segregate the writes to separate hard discs. Thanks, Manju __

Offset Request with timestamp

2014-09-02 Thread Manjunath Shivakumar
Hi, My usecase is to fetch the offsets for a given topic from X milliseconds ago. If I use the offset api https://cwiki.apache.org/confluence/display/KAFKA/A+Guide+To+The+Kafka+Protocol#AGuideToTheKafkaProtocol-OffsetAPI to do this and pass in a timestamp of (now() - X), I get the earliest offse

Log.scala

2014-09-26 Thread Manjunath Shivakumar
Hi Guys, Just looking at the following snippet https://github.com/apache/kafka/blob/7847e9c703f3a0b70519666cdb8a6e4c8e37c3a7/core/src/main/scala/kafka/log/Log.scala#L259 Presumably this is when the follower is appending to its own log fetching from the leader. ( appendInfo.firstOffset < nextOf