Hi all,
When running spark I get the following warning: [WARN]
org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library
for your platform... using builtin-java classes where applicable
Now I know that in general it is possible to ignore this warning, however, it
means that utilities that catch "WARN" in the log keep flagging this.
I saw many answers to handling this (e.g.
http://stackoverflow.com/questions/30369380/hadoop-unable-to-load-native-hadoop-library-for-your-platform-error-on-docker,
http://stackoverflow.com/questions/19943766/hadoop-unable-to-load-native-hadoop-library-for-your-platform-warning,
http://stackoverflow.com/questions/40015416/spark-unable-to-load-native-hadoop-library-for-your-platform),
however, I am unable to solve this on my local machine.
Specifically, I can't find any such solution for windows (i.e. when running
developer local builds) or on a centos 7 machine with no HDFS (basically it is
a single node machine which uses spark standalone for testing).
Any help would be appreciated.
Thanks,
Assaf.
