I think I need to write both store and load functions. It appears that only intermediate output that is stored on temp location can be compressed using:
SET mapred.compress.map.output true; SET mapred.output.compression org.apache.hadoop.io.compress.SnappyCodec; Any pointers as to how I can store and load using snappy would be helpful. On Thu, Apr 26, 2012 at 12:32 PM, Mohit Anchlia <mohitanch...@gmail.com>wrote: > I am able to write with Snappy compression. But I don't think pig > provides anything to read such records. Can someone suggest or point me to > relevant code that might help me write LoadFunc for it?
