Re: Multiple Topics and Consumer Groups

A consumer can belong to only one consumer group. https://kafka.apache.org/documentation.html#intro_consumers On Mon, Mar 28, 2016 at 11:01 AM, Vinod Kakad wrote: > Hi, > > I wanted to know if same consumer can be in two consumer groups. > > OR > > How the multiple topic subscription for consume

Multiple Topics and Consumer Groups

Hi, I wanted to know if same consumer can be in two consumer groups. OR How the multiple topic subscription for consumer group works. Thanks & Regards, Vinod Kakad.

Re: Leader was set to -1 for some topic partitions

After enabling unclean leader election then all topic partitions are having leaders. Enabling unclean leader election may cause slight data loss but saves from lots of offline partitions. My assumptions towards solving issue: Earlier, we have enabled controlled shutdown and disabled unclean leader

Re: Offset after message deletion

It will continue from the latest offset. offset is a increasing, contiguous sequence number per partition. On Mon, Mar 28, 2016 at 9:11 AM, Imre Nagi wrote: > Hi All, > > I'm new in kafka. So, I have a question related to kafka offset. > > From the kafka documentation in here >

Offset after message deletion

Hi All, I'm new in kafka. So, I have a question related to kafka offset. >From the kafka documentation in here , it said : > The Kafka cluster retains all published messages—whether or not they have > been consumed—for a configurable period of time. Fo

Re: Unexpected response on SyncGroup call

Makes sense. Thanks! (and now how to find out how to turn off that signature for mailing lists ;-)) On Sun, Mar 27, 2016 at 10:54 AM, Dana Powers wrote: > Agree, it's a bit confusing based on wiki alone right now. I think of > MemberAssignment as a double-serialized field: first serialize to by

Re: Altered retention.ms not working

Added the Kafka version and updated the command used. Regards, Saurav From: "Datta, Saurav" mailto:sda...@paypal.com>> Date: Sunday, March 27, 2016 at 10:22 AM To: "users@kafka.apache.org" mailto:users@kafka.apache.org>> Subject: Altered retention.ms not working

Altered retention.ms not working

Hi all, We had configured our topics with an incorrect retention.ms of 864. With this, we observed the consumers are unable to receive any data after approximate 2.4 hours; this ties in to 864/1000/60/60. Later we altered the retention.ms to 8640 (an extra 0), but the consumers ar

Re: Unexpected response on SyncGroup call

Agree, it's a bit confusing based on wiki alone right now. I think of MemberAssignment as a double-serialized field: first serialize to bytes using the MemberAssignment definition (version, topics, partitions, etc); then serialize the bytes into a request. It's the second serialization step that ad

Re: Unexpected response on SyncGroup call

Ah. That makes sense. That also means that on the outgoing request, this part should be coded as ? These parts of the documentation aren't entirely clear on what is part of the client/server protocol and what is part of the (client-side only) consumer group implementation. I'll put my request and

Proper way of handling connectivity issues

Hi All, I am having a kafka client (using 0.8.1) connecting to a server (running 0.8.0). After a while, we see many log messages and log grow to ~50G - while the server is not loaded. The exception is: ERROR Closing socket for /<> because of error (kafka.network.Processor) kafka.common.KafkaExce