Re:Re: Kafka server occure java.nio.BufferUnderflowException

I guess this may cause by incompatible versions. Could you list your kafka server, zookeeper and librdkafka versions? Xianping At 2014-01-22 23:11:05,"Jun Rao" wrote: >This could also be an implementation issue with the wire protocol in the c >library. Could you dump out the bytes in the r

Kafka request.log size is increasing continuously

Hi I have created one node kafka cluster and one topic name test1. Then I started ConsoleProducer and ConsoleConsumer.Both started successfully.But what I see is in the /kafka/kafka_2.8.0-0.8.0/logs/ directory -rw-rw-r-- 1 admin admin5203 Jan 23 15:37 controller.log *-rw-rw-r-- 1 admin admin

Re: Kafka request.log size is increasing continuously

Well, the consumer keeps sending fetch requests even when there are no more messages. Even fetch request will only block on the broker for up to max.wait.time. Also, the producer periodically issues metadata requests, which are also logged in kafka-request.log. Thanks, Jun On Thu, Jan 23, 2014

Re: Kafka request.log size is increasing continuously

It means my free disk size will keep on reducing till Producer and Consumer will be running?Is there any way to stop the increment in file size (kafka-request.log)? On Thu, Jan 23, 2014 at 8:37 PM, Jun Rao wrote: > Well, the consumer keeps sending fetch requests even when there are no more > m

Re: Java major.minor version error

Hi Abhinav, I just compiled and ran a consumer in java with maven and it worked fine. [root@localhost ~]# java -version java version "1.6.0_29" Java(TM) SE Runtime Environment (build 1.6.0_29-b11) Java HotSpot(TM) 64-Bit Server VM (build 20.4-b02, mixed mode) I did this using https://github.com/

Re: Jira issues

Hello, Last evening Jira was having all kinds of "issues" and errors. It seems while I was trying to create an issue for rack-aware replication, I created issues 1215-1225. Can you please delete all the duplicates? I will attach my patch to 1215. Sorry for the inconvenience, Joris

Re: Jira issues

Hi Joris, I will go in and delete the duplicates. Can you please use the patch review tool https://cwiki.apache.org/confluence/display/KAFKA/Kafka+patch+review+toolso that the patch is also in review board for folks to better/more easily review the changes (or just also post the patch to review bo

Re: Jira issues

it looks like 1215 is messed up too there is no workflow (doesn't look like it can be resolved), maybe just create a new JIRA issue and start off fresh? /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly

Re: Jira issues

will do. Thanks! On Thu, Jan 23, 2014 at 9:42 AM, Joe Stein wrote: > it looks like 1215 is messed up too there is no workflow (doesn't look like > it can be resolved), maybe just create a new JIRA issue and start off > fresh? > > /*** > Joe Stein > Fou

Regarding question Kafka metrics. Issue with unclean leader election rate

This is wrt question Kafka metrics. Issue with unclean leader election rate (http://www.marshut.com/inkitk/kafka-metrics-issue-with-unclean-leader-election-rate.html) We use Kafka 0.8.0

--csv-reporter-enabled for kafka-consumer-performance.sh

Hi, I've been trying to add --csv-reporter-enabled option for kafka-consumer-performance.sh by going through he following steps, but unable to add it: (1) Added the code (copied from ProducerPerformance.scala in the same directory) to perf/src/main/scala/kafka/perf/ConsumerPerformance.scala (2)

Kafka metrics. Issue with unclean leader election rate

Yes we use 0.8.0 release

Re: Kafka rebalancing causes Zookeeper to fail

When you say "use a larger session timeout", which session timeout do you refer to? Is it the zookeeper session timeout variable that we define when creating a Kafka consumer? Or is there a different session timeout? As for downgrading, that is currently not an option for the time being, so I will

num.partitions

Hi team, I believe num.partitions is for automatic topic creation. Is that right? The default number of partition for kafka-create-topic.sh is 1. So Will num.partitions impact kafka-create-topic.sh? Thanks. Regards, Libo

Re: num.partitions

Yes, they are separate. /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop / On Thu, Jan 2

Apache Samza talk in LA on Feb 18

Hi All, I would be giving a talk on Samza in LA on Feb 18th at 6:30 PM. The talk would cover Samza internals, how it works with Kafka and Yarn and use cases at Linkedin. The venue for the talk would be at Shopzilla (12200 Olympic Blvd, 4th floor, Los Angeles). I look forward to seeing people in

Re: Kafka request.log size is increasing continuously

The producer/consumer log compaction/retention can be set in log4j. Guozhang On Thu, Jan 23, 2014 at 7:57 AM, Monika Garg wrote: > It means my free disk size will keep on reducing till Producer and Consumer > will be running?Is there any way to stop the increment in file size > (kafka-request

Re: Java major.minor version error

Hi Joe, There was a wrong kafka release picked up from our local repo. Sorry for bugging you with the no-issue. On Thu, Jan 23, 2014 at 10:43 PM, Joe Stein wrote: > Hi Abhinav, > > I just compiled and ran a consumer in java with maven and it worked fine. > > [root@localhost ~]# java -version >

Re: Kafka metrics. Issue with unclean leader election rate

What's the output of list topic on that topic? Thanks, Jun On Thu, Jan 23, 2014 at 10:27 AM, Arathi Maddula wrote: > Yes we use 0.8.0 release >

Re: --csv-reporter-enabled for kafka-consumer-performance.sh

Are there any errors? Were you able to get reporting working for ProducerPerformance? Thanks, Jun On Thu, Jan 23, 2014 at 10:52 AM, Kazue Watanabe wrote: > Hi, > > I've been trying to add --csv-reporter-enabled option for > kafka-consumer-performance.sh by going through he following steps, but

Re: Kafka rebalancing causes Zookeeper to fail

zookeeper.session.timeout.ms in consumer config. Thanks, Jun On Thu, Jan 23, 2014 at 11:24 AM, Ahmed H. wrote: > When you say "use a larger session timeout", which session timeout do you > refer to? Is it the zookeeper session timeout variable that we define when > creating a Kafka consumer? O