Hello Surender, do you use the high level consumer, low level consumer, or using connector provided by Spark / Hadoop?
On Wed, Nov 25, 2015 at 1:29 AM, Kudumula, Surender < surender.kudum...@hpe.com> wrote: > Hi Prabhjot > Thanks for your quick response. I never get any response to my queries:( . > Anyway my issue here is I have my kafka running as part of hdp cluster. I > have my producer in the same cluster producing to a topic in kafka and > consumer which is on another node trying to consume the messages from the > same topic. The issue I have here is when I run the command line consumer > it consumes all the messages whereas my java client consumer doesn’t > consume a single message. Any ideas please? > > > -----Original Message----- > From: Prabhjot Bharaj [mailto:prabhbha...@gmail.com] > Sent: 24 November 2015 18:24 > To: d...@kafka.apache.org > Cc: users@kafka.apache.org > Subject: Re: kafka producer and client use same groupid > > Hi Surender, > > Please elaborate on your design > Consumers don't talk to producers directly, Kafka is a brokered system, > and Kafka sits between producers and consumers Also, consumers consume from > partitions of a topic and producers write to partitions in a topic These > partitions and the logical abstraction -topic-reside on Kafka and zookeeper > respectively > > Thanks, > Prabhjot > On Nov 24, 2015 11:38 PM, "Kudumula, Surender" <surender.kudum...@hpe.com> > wrote: > > > Hi all > > Is there anyway we can ensure in 0.8 that kafka remote producer and > > remote consumer work on the same groupId as my java consumer cannot > > consume messages from remote producer. Thanks > > > > > > > > > -- Muqtafi Akhmad Software Engineer Traveloka