Paul Wilkinson created HADOOP-8582: -------------------------------------- Summary: Improve error reporting for GZIP-compressed SequenceFiles with missing native libraries. Key: HADOOP-8582 URL: https://issues.apache.org/jira/browse/HADOOP-8582 Project: Hadoop Common Issue Type: Improvement Components: io Environment: Centos 5.8, Java 6 Update 26 Reporter: Paul Wilkinson Priority: Minor
At present it is not possible to write or read block-compressed SequenceFiles using the GZIP codec without the native libraries being available. The SequenceFile.Writer code checks for the availability of native libraries and throws a useful exception, but the SequenceFile.Reader doesn't do the same: Exception in thread "main" java.io.EOFException at java.util.zip.GZIPInputStream.readUByte(GZIPInputStream.java:249) at java.util.zip.GZIPInputStream.readUShort(GZIPInputStream.java:239) at java.util.zip.GZIPInputStream.readHeader(GZIPInputStream.java:142) at java.util.zip.GZIPInputStream.<init>(GZIPInputStream.java:58) at java.util.zip.GZIPInputStream.<init>(GZIPInputStream.java:67) at org.apache.hadoop.io.compress.GzipCodec$GzipInputStream$ResetableGZIPInputStream.<init>(GzipCodec.java:95) at org.apache.hadoop.io.compress.GzipCodec$GzipInputStream.<init>(GzipCodec.java:104) at org.apache.hadoop.io.compress.GzipCodec.createInputStream(GzipCodec.java:173) at org.apache.hadoop.io.compress.GzipCodec.createInputStream(GzipCodec.java:183) at org.apache.hadoop.io.SequenceFile$Reader.init(SequenceFile.java:1591) at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1493) at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1480) at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1475) at test.SequenceReader.read(SequenceReader.java:23) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira