I am using Camus to get compressed Snappy messages into HDFS. However, I can't get records in HDFS even though CamusJob was completed successfully. Getting uncompressed AVRO messages into HDFS is fine.
According to Neha's post, the consumer should be * agnostic to compression.* http://geekmantra.wordpress.com/2013/03/28/compression-in-kafka-gzip-or-snappy/ Kafka console consumer can handle compression w/o any issue. Camus uses SimpleConsumer. I am not sure if it can handle compression correctly. Again, thanks for the help in advance. Best, Wayne Zhu
