Re: having problem with 0.8 gzip compression

2013-07-11 Thread Scott Wang
Ok, the problem solved, I think it might be because some of the jar files that I was using were "OLD". I was building the producer and consumer under the 0.7 environment except swapping out the kafka jar file. Now, I created a whole new environment and pull in all the jar files from the 0.8. Th

Re: having problem with 0.8 gzip compression

2013-07-11 Thread Scott Wang
re-run with trace logs > enabled in your producer and paste that output? Broker logs also if > you can? > > Thanks, > > Joel > > On Wed, Jul 10, 2013 at 10:23 AM, Scott Wang > wrote: > > Jun, > > > > I did a test this morning and got a very interesting

Re: having problem with 0.8 gzip compression

2013-07-10 Thread Scott Wang
ing command on one of the log files of your topic > and attach the output? > > bin/kafka-run-class.sh kafka.tools.DumpLogSegments --files > /tmp/kafka-logs/testtopic-0/.log > > Thanks, > > Jun > > > On Tue, Jul 9, 2013 at 3:23 PM, Scott Wang < >

Re: having problem with 0.8 gzip compression

2013-07-09 Thread Scott Wang
Another piece of information, the snappy compression also does not work. Thanks, Scott On Tue, Jul 9, 2013 at 11:07 AM, Scott Wang < scott.w...@rumbleentertainment.com> wrote: > I just try it and it still not showing up, thanks for looking into this. > > Thanks, > Scott &

Re: having problem with 0.8 gzip compression

2013-07-09 Thread Scott Wang
I just try it and it still not showing up, thanks for looking into this. Thanks, Scott On Tue, Jul 9, 2013 at 8:06 AM, Jun Rao wrote: > Could you try starting the consumer first (and enable gzip in the > producer)? > > Thanks, > > Jun > > > On Mon, Jul 8,

Re: having problem with 0.8 gzip compression

2013-07-08 Thread Scott Wang
On Mon, Jul 8, 2013 at 9:07 PM, Jun Rao wrote: > Did you start the consumer before the producer? Be default, the consumer > gets only the new data? > > Thanks, > > Jun > > > On Mon, Jul 8, 2013 at 2:53 PM, Scott Wang < > scott.w...@rumbleentertainment.com>

having problem with 0.8 gzip compression

2013-07-08 Thread Scott Wang
I am testing with Kafka 0.8 beta and having problem of receiving message in consumer. There is no error so does anyone have any insights. When I commented out the "compression.code" everything works fine. My producer: public class TestKafka08Prod { public static void main(String [] args) {