The codec have to be in the TaskTrackers hadoop lib. listed in there io.compression.codes, and you have the restart the TaskTracker for it pick this up.
On Thu, Mar 22, 2012 at 7:42 AM, Zizon Qiu <zzd...@gmail.com> wrote: > seems the tasktracker could not > locate org.apache.hadoop.io.compress.SnappyCodec. > did you deploy on every tasktracker or package into the mapreduce job jar? > > On Thu, Mar 22, 2012 at 7:30 PM, hadoop hive <hadooph...@gmail.com> wrote: >> >> HI Folks, >> >> i follow all ther steps and build and install snappy and after creating >> sequencetable when i m insert overwrite the data into this table its >> throwing this error. >> >> >> java.io.IOException: Cannot create an instance of InputFormat class >> org.apache.hadoop.mapred.TextInputFormat as specified in mapredWork! >> at >> org.apache.hadoop.hive.ql.io.HiveInputFormat.getInputFormatFromCache(HiveInputFormat.java:197) >> at >> org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:236) >> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:338) >> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307) >> at org.apache.hadoop.mapred.Child.main(Child.java:170) >> Caused by: java.lang.RuntimeException: Error in configuring object >> at >> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93) >> at >> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64) >> at >> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117) >> at >> org.apache.hadoop.hive.ql.io.HiveInputFormat.getInputFormatFromCache(HiveInputFormat.java:193) >> ... 4 more >> Caused by: java.lang.reflect.InvocationTargetException >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) >> at java.lang.reflect.Method.invoke(Method.java:597) >> at >> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88) >> ... 7 more >> Caused by: java.lang.IllegalArgumentException: Compression codec >> org.apache.hadoop.io.compress.SnappyCodec not found. >> at >> org.apache.hadoop.io.compress.CompressionCodecFactory.getCodecClasses(CompressionCodecFactory.java:96) >> at >> org.apache.hadoop.io.compress.CompressionCodecFactory.(CompressionCodecFactory.java:134) >> at >> org.apache.hadoop.mapred.TextInputFormat.configure(TextInputFormat.java:41) >> ... 12 more >> Caused by: java.lang.ClassNotFoundException: >> org.apache.hadoop.io.compress.SnappyCodec >> at java.net.URLClassLoader$1.run(URLClassLoader.java:200) >> at java.security.AccessController.doPrivileged(Native Method) >> at java.net.URLClassLoader.findClass(URLClassLoader.java:188) >> at java.lang.ClassLoader.loadClass(ClassLoader.java:307) >> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) >> at java.lang.ClassLoader.loadClass(ClassLoader.java:252) >> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320) >> at java.lang.Class.forName0(Native Method) >> at java.lang.Class.forName(Class.java:247) >> at >> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762) >> at >> org.apache.hadoop.io.compress.CompressionCodecFactory.getCodecClasses(CompressionCodecFactory.java:89) >> ... 14 more >> >> >> >
