Re: Unable to consume Snappy compressed messages with Simple Consumer

2014-02-27 Thread Dan Hoffman
that worked! My publisher is sending 1MB payload and compressing it with snappy. I would have thought that with compression that it would have fit into the 10 bytes default of the sample code. I guess not! Thanks. On Thu, Feb 27, 2014 at 1:37 AM, Jun Rao wrote: > Try making the last pa

Re: Unable to consume Snappy compressed messages with Simple Consumer

2014-02-26 Thread Jun Rao
Try making the last parameter in the following call larger (say to 1,000,000). .addFetch(a_topic, a_partition, readOffset, 10) Thanks, Jun On Wed, Feb 26, 2014 at 9:32 PM, Dan Hoffman wrote: > I'm not sure what you mean - could you be more specific in terms what I > might need to adjust

Re: Unable to consume Snappy compressed messages with Simple Consumer

2014-02-26 Thread Dan Hoffman
I'm not sure what you mean - could you be more specific in terms what I might need to adjust in the simple consumer example code? On Thu, Feb 27, 2014 at 12:24 AM, Jun Rao wrote: > Are you using a fetch size larger than the whole compressed unit? > > Thanks, > > Jun > > > On Wed, Feb 26, 2014 a

Re: Unable to consume Snappy compressed messages with Simple Consumer

2014-02-26 Thread Jun Rao
Are you using a fetch size larger than the whole compressed unit? Thanks, Jun On Wed, Feb 26, 2014 at 5:40 PM, Dan Hoffman wrote: > Publisher (using librdkafka C api) has sent both gzip and snappy compressed > messages. I find that the java Simple Consumer ( > > https://cwiki.apache.org/conf