NPE when running a Hive query with storage in S3

[Ravuri, Venkata Puneet]

Hi,

I am using a Hadoop 2.4.1 + Hive 0.13 setup.
I have a non-partitioned table whose storage location is S3. Its schema 
information:-
SerDe Library:                    
org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe
InputFormat:                     org.apache.hadoop.hive.ql.io.RCFileInputFormat
OutputFormat:                  org.apache.hadoop.hive.ql.io.RCFileOutputFormat

When I run a count(*) on this table, I get a NullPointerException. Following is 
the exception stack:-
Error: java.lang.NullPointerException
               at 
org.apache.hadoop.fs.s3native.NativeS3FileSystem$NativeS3FsInputStream.close(NativeS3FileSystem.java:147)
               at 
java.io.BufferedInputStream.close(BufferedInputStream.java:472)
               at java.io.FilterInputStream.close(FilterInputStream.java:181)
               at org.apache.hadoop.io.IOUtils.cleanup(IOUtils.java:237)
               at org.apache.hadoop.io.IOUtils.closeStream(IOUtils.java:254)
               at 
org.apache.hadoop.hive.ql.io.RCFile$Reader.close(RCFile.java:1998)
               at 
org.apache.hadoop.hive.ql.io.RCFileRecordReader.close(RCFileRecordReader.java:211)
               at 
org.apache.hadoop.hive.ql.io.CombineHiveRecordReader.doClose(CombineHiveRecordReader.java:72)
               at 
org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader.close(HiveContextAwareRecordReader.java:110)
               at 
org.apache.hadoop.hive.shims.HadoopShimsSecure$CombineFileRecordReader.initNextRecordReader(HadoopShimsSecure.java:267)
               at 
org.apache.hadoop.hive.shims.HadoopShimsSecure$CombineFileRecordReader.next(HadoopShimsSecure.java:174)
               at 
org.apache.hadoop.mapred.MapTask$TrackedRecordReader.moveToNext(MapTask.java:198)
               at 
org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:184)
               at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:52)
               at 
org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:430)
               at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342)
               at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:167)
               at java.security.AccessController.doPrivileged(Native Method)
               at javax.security.auth.Subject.doAs(Subject.java:415)
               at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
               at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)

Is there anything I'm missing in the configurations or classpath?


Thanks and Regards,
Puneet