Re: kafka producer-perf-test.sh compression-codec not working

2015-08-25 Thread Prabhjot Bharaj
t;, " > d...@kafka.apache.org<mailto:d...@kafka.apache.org>" <mailto:d...@kafka.apache.org>> > Subject: Re: kafka producer-perf-test.sh compression-codec not working > > Hi Erik, > > Thanks for your inputs. > > How can we measure round trip latenc

Re: kafka producer-perf-test.sh compression-codec not working

2015-08-25 Thread Helleren, Erik
ers@kafka.apache.org>" mailto:users@kafka.apache.org>>, "d...@kafka.apache.org<mailto:d...@kafka.apache.org>" mailto:d...@kafka.apache.org>> Subject: Re: kafka producer-perf-test.sh compression-codec not working Hi Erik, Thanks for your inputs. How can we meas

Re: kafka producer-perf-test.sh compression-codec not working

2015-08-25 Thread Prabhjot Bharaj
lto:users@kafka.apache.org>>, " > d...@kafka.apache.org<mailto:d...@kafka.apache.org>" <mailto:d...@kafka.apache.org>> > Subject: Re: kafka producer-perf-test.sh compression-codec not working > > Hi Erik, > > I have put my efforts on the produce side till now, Tha

Re: kafka producer-perf-test.sh compression-codec not working

2015-08-25 Thread Helleren, Erik
, "d...@kafka.apache.org<mailto:d...@kafka.apache.org>" mailto:d...@kafka.apache.org>> Subject: Re: kafka producer-perf-test.sh compression-codec not working Hi Erik, I have put my efforts on the produce side till now, Thanks for making me aware that consumer will decompress a

Re: kafka producer-perf-test.sh compression-codec not working

2015-08-25 Thread Prabhjot Bharaj
Hi Erik, I have put my efforts on the produce side till now, Thanks for making me aware that consumer will decompress automatically. I'll also consider your point on creating real-life messages But, I have still have one confusion - Why would the current ProducerPerformance.scala compress an Ar

Re: kafka producer-perf-test.sh compression-codec not working

2015-08-25 Thread Helleren, Erik
Hi Prabhjot, There are two important things to know about kafka compression: First uncompression happens automatically in the consumer (https://cwiki.apache.org/confluence/display/KAFKA/Compression) so you should see ascii returned on the consumer side. The best way to see if compression has happe

kafka producer-perf-test.sh compression-codec not working

2015-08-25 Thread Prabhjot Bharaj
Hi, I have bene trying to use kafka-producer-perf-test.sh to arrive at certain benchmarks. When I try to run it with --compression-codec values of 1, 2 and 3, I notice increased throughput compared to NoCompressionCodec But, When I checked the Producerperformance.scala, I saw that the the `produc