Thanks! will take a look at this later today. HTH!
> On Jul 3, 2014, at 11:09 AM, Kostiantyn Kudriavtsev
> wrote:
>
> Hi Denny,
>
> just created https://issues.apache.org/jira/browse/SPARK-2356
>
>> On Jul 3, 2014, at 7:06 PM, Denny Lee wrote:
>>
>> Hi Konstantin,
>>
>> Could you please
Hi Denny,
just created https://issues.apache.org/jira/browse/SPARK-2356
On Jul 3, 2014, at 7:06 PM, Denny Lee wrote:
> Hi Konstantin,
>
> Could you please create a jira item at:
> https://issues.apache.org/jira/browse/SPARK/ so this issue can be tracked?
>
> Thanks,
> Denny
>
>
> On July 2
Hi Konstantin,
Could you please create a jira item at:
https://issues.apache.org/jira/browse/SPARK/ so this issue can be tracked?
Thanks,
Denny
On July 2, 2014 at 11:45:24 PM, Konstantin Kudryavtsev
(kudryavtsev.konstan...@gmail.com) wrote:
It sounds really strange...
I guess it is a bug, c
It sounds really strange...
I guess it is a bug, critical bug and must be fixed... at least some flag
must be add (unable.hadoop)
I found the next workaround :
1) download compiled winutils.exe from
http://social.msdn.microsoft.com/Forums/windowsazure/en-US/28a57efb-082b-424b-8d9e-731b1fe135de/pl
You don't actually need it per se - its just that some of the Spark
libraries are referencing Hadoop libraries even if they ultimately do not
call them. When I was doing some early builds of Spark on Windows, I
admittedly had Hadoop on Windows running as well and had not run into this
particular is
No, I don’t
why do I need to have HDP installed? I don’t use Hadoop at all and I’d like to
read data from local filesystem
On Jul 2, 2014, at 9:10 PM, Denny Lee wrote:
> By any chance do you have HDP 2.1 installed? you may need to install the
> utils and update the env variables per
> http:/
By any chance do you have HDP 2.1 installed? you may need to install the utils
and update the env variables per
http://stackoverflow.com/questions/18630019/running-apache-hadoop-2-1-0-on-windows
> On Jul 2, 2014, at 10:20 AM, Konstantin Kudryavtsev
> wrote:
>
> Hi Andrew,
>
> it's windows 7
Hi Andrew,
it's windows 7 and I doesn't set up any env variables here
The full stack trace:
14/07/02 19:59:31 WARN NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
14/07/02 19:59:31 ERROR Shell: Failed to locate the winutils
Hi Konstatin,
We use hadoop as a library in a few places in Spark. I wonder why the path
includes "null" though.
Could you provide the full stack trace?
Andrew
2014-07-02 9:38 GMT-07:00 Konstantin Kudryavtsev <
kudryavtsev.konstan...@gmail.com>:
> Hi all,
>
> I'm trying to run some transforma
Hi all,
I'm trying to run some transformation on *Spark*, it works fine on cluster
(YARN, linux machines). However, when I'm trying to run it on local machine
(*Windows 7*) under unit test, I got errors:
java.io.IOException: Could not locate executable null\bin\winutils.exe
in the Hadoop binaries
10 matches
Mail list logo
