Jeffrey,
The new Java consumer was incomplete in the 0.8.2 clients JAR, so it
doesn't work in any scenario. If you are using 0.10.1 brokers, my
recommendation is to use 0.10.1 client jars. It will be much easier than
using the soon to be deprecated Scala consumer.
Ismael
On Wed, Feb 8, 2017 at 8:06 PM, Jeffrey Zhang <xiuyan.zh...@salesforce.com>
wrote:
> Hi ismael, the reason is that we have our own Java package which sits
> on top of Kafka Java 0.8.2.
> I m new to Kafka and Scala. So to clarify, do I have to use Kafka
> scala client 0.8.2 in order to talk to server v0.10.1? If yes, where
> can I find the Kafka scala client?
> Thanks
> Jeffrey
>
> > On Feb 8, 2017, at 11:34 AM, Ismael Juma <ism...@juma.me.uk> wrote:
> >
> > As Manikumar said, you need to use the Scala consumer if the client is
> > v0.8.2.x. The Java consumer is only supported from 0.9.0.0. Is there a
> > reason why you can't upgrade your client?
> >
> > Ismael
> >
> > On Wed, Feb 8, 2017 at 5:28 PM, Jeffrey Zhang <
> xiuyan.zh...@salesforce.com>
> > wrote:
> >
> >> Hi Hans, thanks for your reply.
> >>
> >> Here is what I see -
> >>
> >> for the Kafka client v0.8.2.2, the consumer.poll method returns an
> object
> >> of Map<String, ConsumerRecords> while it returns ConsumerRecords from
> Kafka
> >> Server v0.10.1.1.
> >> that is why Kafka client v0.8.2.2 now does not work with my Kafka Kafka
> >> Server v0.10.1.1.
> >>
> >> Were you saying that you have a way to change the returned format for
> >> consumer.poll for v0.8.2.2?
> >> If yes, pls advice how I could do it.
> >>
> >> regarding Deserializer, I use the following
> >> from kafka-clients-0.8.2.2.jar. How to change it?
> >>
> >>
> >> props.put("key.deserializer","org.apache.kafka.common.serialization.
> >> StringDeserializer");
> >>
> >> props.put("value.deserializer","org.apache.kafka.common.serialization.
> >> StringDeserializer");
> >>
> >> thanks a lot.
> >>
> >> Jeffrey
> >>
> >>
> >>
> >>> On Wed, Feb 8, 2017 at 8:46 AM, <h...@confluent.io> wrote:
> >>>
> >>> 0.8.x Java clients are supported for both producing and consuming with
> a
> >>> 0.10.x broker.
> >>>
> >>> If you are seeing data when you poll but it's just in a different
> format
> >>> between 0.8 and 0.10 consumers then you might not be using the same (or
> >>> compatible) serdes libraries to deserialize the messages.
> >>>
> >>> -hans
> >>>
> >>> Sent from my iPhone
> >>>
> >>>> On Feb 8, 2017, at 8:17 AM, Manikumar <manikumar.re...@gmail.com>
> >> wrote:
> >>>>
> >>>> Are you using new java consumer API? It is officially released as
> part
> >>> of
> >>>> 0.9 release.
> >>>> 0.8.2.2 java consumer code may not be usable. You have to use old
> scala
> >>>> consumer API.
> >>>>
> >>>> On Wed, Feb 8, 2017 at 9:35 PM, Jeffrey Zhang <
> >>> xiuyan.zh...@salesforce.com>
> >>>> wrote:
> >>>>
> >>>>> Any insight about these two versions, v0822 vs. v0101, of the Kafka
> >>>>> behaviors as described below?
> >>>>> Thanks
> >>>>>
> >>>>> Jeffrey
> >>>>>
> >>>>>> On Feb 7, 2017, at 7:42 PM, Jeffrey Zhang <
> >> xiuyan.zh...@salesforce.com
> >>>>
> >>>>> wrote:
> >>>>>>
> >>>>>> hi
> >>>>>>
> >>>>>> I have difficulty to have Kafka Client 0.8.2.2 to consume the
> >> messages
> >>>>> on a Kafka Server 0.10.1.1, though I could produce message from this
> >>> client
> >>>>> 0.8.2.2 to the same server 0.10.1.1.
> >>>>>>
> >>>>>> My questions:
> >>>>>> 1) could Kafka Client 0.8.2.2 be able to consume the messages from
> >>>>> Server 0.10.1.1?
> >>>>>> 1.1) If yes, would you pls provide an example?
> >>>>>> 1.2) if no, do you have any work-around for these two versions to
> >> talk
> >>>>> in the way I described above?
> >>>>>>
> >>>>>> Note that I see the returned object from poll method at 0.8.2.2 is
> >>> quite
> >>>>> different from that from 0.10.1.1...
> >>>>>>
> >>>>>> thanks for your help
> >>>>>> Jeffrey
> >>>>>>
> >>>>>
> >>>
> >>
>
