I am probably the wrong person to ask as I never use Hadoop on Windows. But
from looking at the code just now it is clearly trying to accommodate
Windows shell commands. Yes I would not be surprised if it still needs
Cygwin.
A slightly broader point is that ideally it doesnt matter whether Hadoop
Hi Sean
RE: Windows and hadoop 2.4.x
HortonWorks - all the hype aside - only supports Windows Server 2008/2012.
So this general concept of "supporting Windows" is bunk.
Given that - and since the vast majority of Windows users do not happen to
have Windows Server on their laptop - do you have an
Thanks Sean,
1) Yes, I am trying to run locally without Hadoop.
2) I also see the error in the provided link while launching spark-shell but
post launch I am able to execute same code I have in the sample application.
Read any local file and perform some reduction operation. But not through
submit
I imagine the issue is ultimately combination of Windows and (stock?)
Apache Hadoop. I know that in the past, operations like 'chmod' didn't
work on Windows since it assumed the existence of POSIX binaries. That
should be long since patched up for 2.4.x but there may be a gotcha
here that others ca
