RE: [WARN] org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

2017-05-17 Thread Mendelson, Assaf
@spark.apache.org Subject: Re: [WARN] org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable On 10 May 2017, at 13:40, Mendelson, Assaf mailto:assaf.mendel...@rsa.com>> wrote: Hi all, When running spark I get the fol

Re: [WARN] org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

2017-05-16 Thread Steve Loughran
On 10 May 2017, at 13:40, Mendelson, Assaf mailto:assaf.mendel...@rsa.com>> wrote: Hi all, When running spark I get the following warning: [WARN] org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicab

[WARN] org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

2017-05-10 Thread Mendelson, Assaf
Hi all, When running spark I get the following warning: [WARN] org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Now I know that in general it is possible to ignore this warning, however, it means that

Re: "Unable to load native-hadoop library for your platform" while running Spark jobs

2017-01-20 Thread Steve Loughran
l, I'm the getting the following WARNING while running Spark jobs in standalone mode: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Please note that I have configured the native path and the other ENV variables as follows: export JAV

Re: "Unable to load native-hadoop library for your platform" while running Spark jobs

2017-01-19 Thread Md. Rezaul Karim
rations. This is something you can > easily have read more about online. > > On Thu, Jan 19, 2017 at 10:57 AM Md. Rezaul Karim < > rezaul.ka...@insight-centre.org> wrote: > >> Hi All, >> >> I'm the getting the following WARNING while running Spark job

Re: "Unable to load native-hadoop library for your platform" while running Spark jobs

2017-01-19 Thread Sean Owen
at 10:57 AM Md. Rezaul Karim < rezaul.ka...@insight-centre.org> wrote: > Hi All, > > I'm the getting the following WARNING while running Spark jobs in > standalone mode: > Unable to load native-hadoop library for your platform... using > builtin-java classes where appli

"Unable to load native-hadoop library for your platform" while running Spark jobs

2017-01-19 Thread Md. Rezaul Karim
Hi All, I'm the getting the following WARNING while running Spark jobs in standalone mode: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Please note that I have configured the native path and the other ENV variables as follows: e

Unable to load native-hadoop library for your platform - already loaded in another classloader

2015-11-18 Thread Deenar Toraskar
b:/usr/lib 15/11/18 17:47:23 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 15/11/18 17:47:24 WARN DomainSocketFactory: The short-circuit local reads feature cannot be used because libhadoop cannot be loaded. SQL contex

Re: Unable to load native-hadoop library for your platform

2015-08-05 Thread Steve Loughran
> On 4 Aug 2015, at 12:26, Sean Owen wrote: > > Oh good point, does the Windows integration need native libs for > POSIX-y file system access? I know there are some binaries shipped for > this purpose but wasn't sure if that's part of what's covered in the > native libs message. On unix its a w

Re: Unable to load native-hadoop library for your platform

2015-08-04 Thread Sean Owen
Oh good point, does the Windows integration need native libs for POSIX-y file system access? I know there are some binaries shipped for this purpose but wasn't sure if that's part of what's covered in the native libs message. On Tue, Aug 4, 2015 at 6:01 PM, Steve Loughran wrote: > Think it may be

Re: Unable to load native-hadoop library for your platform

2015-08-04 Thread Steve Loughran
below hadoop library >>>> error. >>>> I am using below spark version. >>>> >>>> >>>>org.apache.spark >>>>spark-core_2.10 >>>>1.4.1 >>>> >>>> >

Re: Unable to load native-hadoop library for your platform

2015-08-04 Thread Deepesh Maheshwari
park locally on windows it gives below hadoop library > >> > error. > >> > I am using below spark version. > >> > > >> > > >> > org.apache.spark > >> > spark-core_2.10 > >> > 1.4.

Re: Unable to load native-hadoop library for your platform

2015-08-04 Thread Sean Owen
> wrote: >> > Hi, >> > >> > When i run the spark locally on windows it gives below hadoop library >> > error. >> > I am using below spark version. >> > >> > >> > org.apache.spark >> > spark-cor

Re: Unable to load native-hadoop library for your platform

2015-08-04 Thread Deepesh Maheshwari
es below hadoop library > error. > > I am using below spark version. > > > > > > org.apache.spark > > spark-core_2.10 > > 1.4.1 > > > > > > > > 2015-08-04 12:22:23,463 WARN > (org.ap

Re: Unable to load native-hadoop library for your platform

2015-08-04 Thread Sean Owen
ndows it gives below hadoop library error. > I am using below spark version. > > > org.apache.spark > spark-core_2.10 > 1.4.1 > > > > 2015-08-04 12:22:23,463 WARN (org.apache.hadoop.util.NativeCodeLoader:62) - > Unable

Unable to load native-hadoop library for your platform

2015-08-04 Thread Deepesh Maheshwari
native-hadoop library for your platform... using builtin-java classes where applicable Tried to find it on internet but not able to find exact root cause. Please let me know what is it, why it is giving warning and how can i resolve it. Thanks, Deepesh