hi Akhil,
I just use property key LD_LIBRARY_PATH in conf/spark-env.xml instead of
SPARK_LIBRARY_PATH which points to the path of native, it works.
thanks.
On Tue, Sep 8, 2015 at 6:14 PM, Akhil Das
wrote:
> Looks like you are having different versions of snappy library. Here's a
> similar disc
Looks like you are having different versions of snappy library. Here's a
similar discussion if you haven't seen it already
http://stackoverflow.com/questions/22150417/hadoop-mapreduce-java-lang-unsatisfiedlinkerror-org-apache-hadoop-util-nativec
Thanks
Best Regards
On Mon, Sep 7, 2015 at 7:41 AM,
hi all,
I met problem that can't read the file with snappy encoding from HDFS in
Spark1.4.1,
I have configured the SPARK_LIBRARY_PATH property in conf/spark-env.sh to
the native path of Hadoop and restarted the spark cluster
SPARK_LIBRARY_PATH=$SPARK_LIBRARY_PATH:/opt/app/install/cloudera/parcel
