Re: how to wait next log message on the partition queue

It won't throw OffsetOutOfRange error when you pass the latest offset to the fetch request, the resulting fetch response message set would be empty. You can wait for message to be available either manually [or] by configuring *maxWait* in fetch request. On Mon, May 25, 2015 at 3:50 PM, Nipur Patod

How Producer handles Network Connectivity Issues

Hi, I have a cluster of 3 Kafka brokers and a remote producer. Producer started to send messages to *SampleTopic*. Then I blocked the network connectivity between the Producer and the leader node for the topic *SampleTopic* but network connectivity is healthy between the cluster and producer i

Re: Subscription request for Apache Kafka User list

Thanks Guozhang, On May 25, 2015 9:46 PM, "Guozhang Wang" wrote: > Hi Nipur, > > You can take a look at: http://kafka.apache.org/contact.html > > It is self-service. > > Guozhang > > On Mon, May 25, 2015 at 1:48 AM, Nipur Patodi > wrote: > > > Hi, > > > > Can you please add my name in apache Kaf

Re: Subscription request for Apache Kafka User list

Hi Nipur, You can take a look at: http://kafka.apache.org/contact.html It is self-service. Guozhang On Mon, May 25, 2015 at 1:48 AM, Nipur Patodi wrote: > Hi, > > Can you please add my name in apache Kafka user list? > > Thanks, > > _Nipur > -- -- Guozhang

Re: Replication tools to move topics/partitions gradually

Thanks Todd. Let us know when these tools are announced. On Sun, May 24, 2015 at 11:00 PM, Todd Palino wrote: > See, this is why I should never say anything :) > > The version I have right now is very limited - it only does a clone (we > needed it for some hardware testing) and a leader balance

RE: Can't open console producer

Can you do a git status? I accidentally did something similar the other day while copying commands from the quickstart guide. "> bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test" "> filename" will truncate filename to zero length and all subsequent commands will not return

Re: Can't open console producer

Have you tried checking logs? Check if you find some thing in server.log. Make sure your zookeeper and broker instance is up and running. On May 25, 2015 8:31 PM, "单车" wrote: > type the command : > > bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test > but, return nothing,li

Can't open console producer

type the command : > bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test but, return nothing,like: [root@master1 kafka_2.10-0.8.2.1]# bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test [root@master1 kafka_2.10-0.8.2.1]# why?

Subscription request for Apache Kafka User list

Hi, Can you please add my name in apache Kafka user list? Thanks, _Nipur

Re: Architecture for multiple consumers of a given message

i had the same scenario , i creatd multiple consumers on the same topic with different group.id configured there for each consumer and then it started behaving as topic for me. On 5/25/15, Daniel Compton wrote: > Hi Warren > > If you're using the high level consumer, then you can just have multip

Re: [Announcement] Hermes - pub / sub broker built on top of Kafka

Thanks for the feedback. We will improve our documentation to make it clear what guarantees we concentrate on and what are the tradeoffs. And think of some catchy way to describe the system :) 2015-05-25 10:02 GMT+02:00 Daniel Compton : > Hi Adam > > No problem, I'm glad you had a good break :) >

Re: how to wait next log message on the partition queue

Adding to Xiao , If you are using a low level consumer (simple consumer), then for scenario #1 consumer will get OffsetOutOfRange error with error code 1. Please find more details at this link Thanks, _NIpur On M

Re: how to wait next log message on the partition queue

The default behavior of high level consumer is to wait until next message come along. If you want to change this behavior you can change the consumer setting consumer.timeout.ms to some value that is greater than -1 On Mon, 25 May 2015 at 16:57 Ganesh Nikam wrote: > HI All, > > I have basic ques

how to wait next log message on the partition queue

HI All, I have basic question on kafka partition. Lets say I have one topic with partition 0. There is one producer which is producing log messages for this topic and there is one consumer also which is consuming messages on this topic. Assuming consumer is faster, after some time it reaches t

Getting Kafka High Level Consumer Id

Consider the high level consumer example https://cwiki.apache.org/confluence/display/KAFKA/Consumer+Group+Example. Using JAVA API, Is it possible to fetch the consumer id for this particular consumer as displayed in ConsumerOffsetCheck "Owner" field? Thanks, Rahul.

Re: [Announcement] Hermes - pub / sub broker built on top of Kafka

Hi Adam No problem, I'm glad you had a good break :) I think the goals and tradeoffs that Hermes chose provide a useful system, I'm just not sure reliable is quite the right word to use when describing it. When I think of 'reliable' in the context of a message queue I think of guaranteed delivery

Re: Need some guidance in how to solve this problem.

Hi Guozhang, Thanks for your input. That would be a great solution if it wasn't that more than one client could be connected via WebSocket. Hence, a single client can only tell what they've consumed and the consumer is shared for everyone connected. Is there any other way I can go about this prob