RE: High level consumer does not consumes in 0.8.0 version

2014-01-16 Thread Hussain Pirosha
;t need to commit offset on every message, which is inefficient on ZK. Thanks, Jun On Thu, Jan 16, 2014 at 7:14 AM, Hussain Pirosha < hussain.piro...@impetus.co.in> wrote: > Hello, > > While running the high level consumer mentioned on > https://cwiki.apache.org/confluence/

High level consumer does not consumes in 0.8.0 version

2014-01-16 Thread Hussain Pirosha
Hello, While running the high level consumer mentioned on https://cwiki.apache.org/confluence/display/KAFKA/Consumer+Group+Example using 0.8.0 release. The consumer does not receive any messages and blocks on stream.hasNext() call. I have pasted the client side logs at https://gist.github.co

RE: Identifying broker and partition for a message

2013-07-10 Thread Hussain Pirosha
This is not supported in 0.7 version, see this thread for further details. http://search-hadoop.com/m/4TaT4dTQDe2/hussain/v=threaded Thanks, Hussain -Original Message- From: Hisham Mardam-Bey [mailto:his...@mate1inc.com] Sent: Thursday, July 11, 2013 9:49 AM To: users@kafka.apache.org Su

RE: How to get partition information from Kafka Stream?

2013-06-27 Thread Hussain Pirosha
hu, Jun 27, 2013 at 7:27 AM, Hussain Pirosha wrote: > A source produces data in kafka at different stages of execution. Topic is > partitioned by number of execution stages. > Partition number shall give us that information. > > Eg. 0 specifies data received by source, #last part

RE: How to get partition information from Kafka Stream?

2013-06-27 Thread Hussain Pirosha
future release. How do you plan to use this info? Thanks, Jun On Thu, Jun 27, 2013 at 7:13 AM, Hussain Pirosha < hussain.piro...@impetus.co.in> wrote: > After retrieving a kafka stream or kafka message how to get the > corresponding partition number to which it belongs ? I am

How to get partition information from Kafka Stream?

2013-06-27 Thread Hussain Pirosha
After retrieving a kafka stream or kafka message how to get the corresponding partition number to which it belongs ? I am using kafka version 0.7.2. More specifically kafka.consumer.KafkaStream and kafka.message.MessageAndMetaData classes, does not provide API to retrieve partition number. Are t