Re: kafka producer-perf-test.sh compression-codec not working

2015-08-25 Thread Prabhjot Bharaj
megroup.com erik.helle...@cmegroup.com>>> > Cc: "us...@kafka.apache.org<mailto:us...@kafka.apache.org> us...@kafka.apache.org<mailto:us...@kafka.apache.org>>" < > us...@kafka.apache.org<mailto:us...@kafka.apache.org> us...@kafka.apache.org<mailto:us...@kaf

Re: kafka producer-perf-test.sh compression-codec not working

2015-08-25 Thread Helleren, Erik
...@kafka.apache.org>" mailto:us...@kafka.apache.org>>, "dev@kafka.apache.org<mailto:dev@kafka.apache.org>" mailto:dev@kafka.apache.org>> Subject: Re: kafka producer-perf-test.sh compression-codec not working Hi Erik, Thanks for your inputs. How can we measure ro

Re: kafka producer-perf-test.sh compression-codec not working

2015-08-25 Thread Prabhjot Bharaj
lto:us...@kafka.apache.org>>, " > dev@kafka.apache.org<mailto:dev@kafka.apache.org>" <mailto:dev@kafka.apache.org>> > Subject: Re: kafka producer-perf-test.sh compression-codec not working > > Hi Erik, > > I have put my efforts on the produce side till now, Tha

Re: kafka producer-perf-test.sh compression-codec not working

2015-08-25 Thread Helleren, Erik
"dev@kafka.apache.org<mailto:dev@kafka.apache.org>" mailto:dev@kafka.apache.org>> Subject: Re: kafka producer-perf-test.sh compression-codec not working Hi Erik, I have put my efforts on the produce side till now, Thanks for making me aware that consumer will decompress automa

Re: kafka producer-perf-test.sh compression-codec not working

2015-08-25 Thread Helleren, Erik
Hi Prabhjot, There are two important things to know about kafka compression: First uncompression happens automatically in the consumer (https://cwiki.apache.org/confluence/display/KAFKA/Compression) so you should see ascii returned on the consumer side. The best way to see if compression has happe

Re: kafka producer-perf-test.sh compression-codec not working

2015-08-25 Thread Prabhjot Bharaj
Hi Erik, I have put my efforts on the produce side till now, Thanks for making me aware that consumer will decompress automatically. I'll also consider your point on creating real-life messages But, I have still have one confusion - Why would the current ProducerPerformance.scala compress an Ar