[ https://issues.apache.org/jira/browse/KAFKA-1253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13936300#comment-13936300 ]
Jay Kreps commented on KAFKA-1253: ---------------------------------- Also, in case helpful, here was my java code to test gzip performance: {noformat} package org.apache.kafka; import java.io.BufferedInputStream; import java.io.FileInputStream; import java.io.FileOutputStream; import java.util.zip.GZIPOutputStream; public class Gzip { public static void main(String[] args) throws Exception { GZIPOutputStream output = new GZIPOutputStream(new FileOutputStream("/dev/null")); BufferedInputStream input = new BufferedInputStream(new FileInputStream(args[0])); byte[] bytes = new byte[64 * 1024]; while (true) { int read = input.read(bytes); if (read < 0) return; output.write(bytes); } } } {noformat} > Implement compression in new producer > ------------------------------------- > > Key: KAFKA-1253 > URL: https://issues.apache.org/jira/browse/KAFKA-1253 > Project: Kafka > Issue Type: Sub-task > Components: producer > Reporter: Jay Kreps > Assignee: Guozhang Wang > Attachments: KAFKA-1253.patch, KAFKA-1253_2014-02-21_16:15:21.patch, > KAFKA-1253_2014-02-21_17:55:52.patch, KAFKA-1253_2014-02-24_13:31:50.patch, > KAFKA-1253_2014-02-26_17:31:30.patch, KAFKA-1253_2014-03-06_17:48:11.patch, > KAFKA-1253_2014-03-07_16:34:33.patch, KAFKA-1253_2014-03-10_14:35:56.patch, > KAFKA-1253_2014-03-10_14:39:58.patch, KAFKA-1253_2014-03-10_15:27:47.patch, > KAFKA-1253_2014-03-14_13:46:40.patch, KAFKA-1253_2014-03-14_17:39:53.patch, > compression-fix.patch > > -- This message was sent by Atlassian JIRA (v6.2#6252)