[ 
https://issues.apache.org/jira/browse/KAFKA-1253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13936300#comment-13936300
 ] 

Jay Kreps commented on KAFKA-1253:
----------------------------------

Also, in case helpful, here was my java code to test gzip performance:
{noformat}
package org.apache.kafka;

import java.io.BufferedInputStream;
import java.io.FileInputStream;
import java.io.FileOutputStream;
import java.util.zip.GZIPOutputStream;

public class Gzip {
    public static void main(String[] args) throws Exception {
        GZIPOutputStream output = new GZIPOutputStream(new 
FileOutputStream("/dev/null"));
        BufferedInputStream input = new BufferedInputStream(new 
FileInputStream(args[0]));
        byte[] bytes = new byte[64 * 1024];
        while (true) {
            int read = input.read(bytes);
            if (read < 0)
                return;
            output.write(bytes);
        }
    }
}
{noformat}

> Implement compression in new producer
> -------------------------------------
>
>                 Key: KAFKA-1253
>                 URL: https://issues.apache.org/jira/browse/KAFKA-1253
>             Project: Kafka
>          Issue Type: Sub-task
>          Components: producer 
>            Reporter: Jay Kreps
>            Assignee: Guozhang Wang
>         Attachments: KAFKA-1253.patch, KAFKA-1253_2014-02-21_16:15:21.patch, 
> KAFKA-1253_2014-02-21_17:55:52.patch, KAFKA-1253_2014-02-24_13:31:50.patch, 
> KAFKA-1253_2014-02-26_17:31:30.patch, KAFKA-1253_2014-03-06_17:48:11.patch, 
> KAFKA-1253_2014-03-07_16:34:33.patch, KAFKA-1253_2014-03-10_14:35:56.patch, 
> KAFKA-1253_2014-03-10_14:39:58.patch, KAFKA-1253_2014-03-10_15:27:47.patch, 
> KAFKA-1253_2014-03-14_13:46:40.patch, KAFKA-1253_2014-03-14_17:39:53.patch, 
> compression-fix.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to