snappy native lib was installed as part of hadoop (cdh5.1.0)
the location is in /usr/lib/hadoop/lib/
-rwxr-xr-x 1 hdfs hadoop 23904 Jul 12 14:11 libsnappy.so.1.1.3
lrwxrwxrwx 1 hdfs hadoop 18 Aug 11 20:56 libsnappy.so.1 ->
libsnappy.so.1.1.3
lrwxrwxrwx 1 hdfs hadoop 18 Aug 11 20:56 libsn
Can you tell us how you installed native snappy ?
See D.3.1.5 in:
http://hbase.apache.org/book.html#snappy.compression.installation
Cheers
On Sat, Sep 20, 2014 at 2:12 AM, Chen Song wrote:
> I have seen below exception from spark 1.1.0. Any insights on the snappy
> exception?
>
> 14/09/18 16:4
I have seen below exception from spark 1.1.0. Any insights on the snappy
exception?
14/09/18 16:45:11 ERROR executor.Executor: Exception in task 763.1 in stage
6.0 (TID 17035)
java.io.IOException: PARSING_ERROR(2)
at org.xerial.snappy.SnappyNative.throw_error(SnappyNative.java:78)
