I was actually referring to kafka-simple-consumer-shell.sh. Please make sure that you pass the same fetch size that you configured your high level consumer with, to the kafka-simple-consumer-shell with the --fetchsize option.
Thanks, Neha On Wed, Feb 26, 2014 at 6:26 PM, Dan Hoffman <hoffman...@gmail.com> wrote: > The kafka-console-consumer is fine. > > On Wednesday, February 26, 2014, Neha Narkhede <neha.narkh...@gmail.com> > wrote: > > > Actually I meant the simple consumer shell that ships with kafka in the > bin > > directory. > > > > > > On Wed, Feb 26, 2014 at 6:17 PM, Dan Hoffman <hoffman...@gmail.com> > wrote: > > > > > I haven't tried that yet. But since the high level consumer can consume > > it, > > > should it matter who published it? > > > > > > On Wednesday, February 26, 2014, Neha Narkhede < > neha.narkh...@gmail.com> > > > wrote: > > > > > > > Do you see the same issue if you send snappy data using the console > > > > producer instead of librdkafka? > > > > > > > > > > > > On Wed, Feb 26, 2014 at 5:58 PM, Dan Hoffman <hoffman...@gmail.com > > > <javascript:;>> > > > > wrote: > > > > > > > > > Publisher (using librdkafka C api) has sent both gzip and snappy > > > > compressed > > > > > messages. I find that the java Simple Consumer ( > > > > > > > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example# > > > > > ) > > > > > is unable to read the snappy ones, while the High Level one is. > Is > > > this > > > > > expected? Is there something you have to do in order to handle the > > > > snappy > > > > > messages? There is no error messages provided, it simply acts as > if > > > > there > > > > > are no further messages. > > > > > > > > > > > > > > >
