On Fri, Oct 8, 2010 at 6:34 PM, Ted Yu <yuzhih...@gmail.com> wrote:
> Hi,
> I am using hive trunk with default setting along with cdh3b2.
> I encounter the following exception:
>
> Caused by: java.lang.IllegalArgumentException: Compression codec
> com.hadoop.compression.lzo.LzoCodec not found.
> at
> org.apache.hadoop.io.compress.CompressionCodecFactory.getCodecClasses(CompressionCodecFactory.java:96)
> at
> org.apache.hadoop.io.compress.CompressionCodecFactory.<init>(CompressionCodecFactory.java:134)
> at
> org.apache.hadoop.mapred.TextInputFormat.configure(TextInputFormat.java:41)
> ... 27 more
> Caused by: java.lang.ClassNotFoundException:
> com.hadoop.compression.lzo.LzoCodec
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>
> I found the following source files:
> ./build/hadoopcore/hadoop-0.17.2.1/src/java/org/apache/hadoop/io/compress/LzoCodec.java
> ./build/hadoopcore/hadoop-0.18.3/src/core/org/apache/hadoop/io/compress/LzoCodec.java
> ./build/hadoopcore/hadoop-0.19.0/src/core/org/apache/hadoop/io/compress/LzoCodec.java
>
> My question is where is the LzoCodec.java for hadoop 0.20.x ?
>
> Thanks
>
Ted,
LZO was removed from 0.20 due to licensing issues. There are several
articles about patching LZO support into hadoop.