Re: Kafka broker not respecting log.roll.hours?

2013-05-02 Thread Dan Frankowski
Someone pointed out a particularly easy fix: don't reuse files after a restart. Done. I really like that. Simple. Any chance of this happening any time soon? On Sun, Apr 28, 2013 at 2:04 AM, Swapnil Ghike wrote: > @Dan: Upon restart of the broker, if a segment already has data, the > broker res

RE: javadoc error when ./sbt publish-package

2013-05-02 Thread Gray, Alex
To get around this error, modify the file "project/Build.scala" by removing these lines: -javacOptions ++= Seq("-Xlint:unchecked", "-source", "1.5"), -javacOptions ++= Seq("-Xlint:deprecation"), This will allow "./sbt publish-local" to run successfully. Alex Gray -Original Message--

C++ Kafka producer library for windows

2013-05-02 Thread Ankit Jain
Hi All, I need to write a C++ based Kafka producer in Windows for producing data in Kafka. I came across some C++ library (https://github.com/quipo/kafka-cpp) in the Kafka's website but I need to know whether it will run on windows or not. Also I want to know if yes, then does it allow to conn

Re: consuming only half the messages produced

2013-05-02 Thread Jun Rao
In this case, you have a replication factor of 1. So, each partition has only 1 replica. There are two possibilities: (1) The producer didn't send all messages. (2) The producer successfully sent all messages, but the consumer didn't receive all messages. Could you first check the producer log and

RE: consuming only half the messages produced

2013-05-02 Thread Rob Withers
Regarding the partitions created: > topic: unittest-test-msgpartition: 0leader: 0 replicas: 0 isr: 0 > topic: unittest-test-msgpartition: 1leader: 1 replicas: 1 isr: 1 > topic: unittest-test-msgpartition: 2leader: 0 replicas: 0

RE: consuming only half the messages produced

2013-05-02 Thread Rob Withers
Yes, I mean we can only consume half the messages produced. I followed the high-level consumer example here: https://cwiki.apache.org/confluence/display/KAFKA/Consumer+Group+Example. Let me give a more complete scenario: - We run 3 zookeepers - We run 2 brokers - We do not have a topic defined,