Thanks Vanzin, spark-submit.cmd works
Thanks
Proust
From: Marcelo Vanzin
To: Proust GZ Feng/China/IBM@IBMCN
Cc: Sean Owen , user
Date: 07/29/2015 10:35 AM
Subject:Re: NO Cygwin Support in bin/spark-class in Spark 1.4.0
Can you run the windows batch files (e.g. spark
park.launcher.SparkSubmitCommandBuilder.buildCommand(SparkSubmitCommandBuilder.java:117)
> at org.apache.spark.launcher.Main.main(Main.java:74)
>
> Thanks
> Proust
>
>
>
>
> From: Sean Owen
> To: Proust GZ Feng/China/IBM@IBMCN
> Cc:user
> Date:07
Naik
To: Sean Owen
Cc: Steve Loughran , Proust GZ
Feng/China/IBM@IBMCN, "user@spark.apache.org"
Date: 07/29/2015 05:05 AM
Subject: Re: NO Cygwin Support in bin/spark-class in Spark 1.4.0
I agree with Sean - using virtual box on windows and using linux vm is a
lot eas
.4.0-hadoop2.3.0.jar
> org.apache.spark.launcher.Main
> Error: Could not find or load main class org.apache.spark.launcher.Main
>
> Thanks
> Proust
>
>
>
> From:Sean Owen
> To: Proust GZ Feng/China/IBM@IBMCN
> Cc:user
> Date:07/28/2015 02:20 PM
> Su
I agree with Sean - using virtual box on windows and using linux vm is a lot
easier than trying to circumvent the cygwin oddities. a lot of functionality
might not work in cygwin and you will end up trying to do back patches. Unless
there is a compelling reason - cygwin support seems not require
That's for the Windows interpreter rather than bash-running Cygwin. I
don't know it's worth doing a lot of legwork for Cygwin, but, if it's
really just a few lines of classpath translation in one script, seems
reasonable.
On Tue, Jul 28, 2015 at 9:13 PM, Steve Loughran wrote:
>
> there's a spark-
there's a spark-submit.cmd file for windows. Does that work?
On 27 Jul 2015, at 21:19, Proust GZ Feng
mailto:pf...@cn.ibm.com>> wrote:
Hi, Spark Users
Looks like Spark 1.4.0 cannot work with Cygwin due to the removing of Cygwin
support in bin/spark-class
The changeset is
https://github.com/
uld not find or load main class org.apache.spark.launcher.Main
>
> Thanks
> Proust
>
>
>
> From:Sean Owen
> To: Proust GZ Feng/China/IBM@IBMCN
> Cc: user
> Date:07/28/2015 02:20 PM
> Subject:Re: NO Cygwin Support in bin/spark
ncher.Main
Thanks
Proust
From: Sean Owen
To: Proust GZ Feng/China/IBM@IBMCN
Cc: user
Date: 07/28/2015 02:20 PM
Subject: Re: NO Cygwin Support in bin/spark-class in Spark 1.4.0
It wasn't removed, but rewritten. Cygwin is just a distribution of
POSIX-related utilities s
It wasn't removed, but rewritten. Cygwin is just a distribution of
POSIX-related utilities so you should be able to use the normal .sh
scripts. In any event, you didn't say what the problem is?
On Tue, Jul 28, 2015 at 5:19 AM, Proust GZ Feng wrote:
> Hi, Spark Users
>
> Looks like Spark 1.4.0 can
10 matches
Mail list logo
