Okay I think I've isolated this a bit more. Let's discuss over on the JIRA:
https://issues.apache.org/jira/browse/SPARK-2075
On Sun, Jun 8, 2014 at 1:16 PM, Paul Brown wrote:
>
> Hi, Patrick --
>
> Java 7 on the development machines:
>
> » java -version
> 1 ↵
> java version "1.7.0_51"
> Java(TM)
Hi, Patrick --
Java 7 on the development machines:
» java -version
1 ↵
java version "1.7.0_51"
Java(TM) SE Runtime Environment (build 1.7.0_51-b13)
Java HotSpot(TM) 64-Bit Server VM (build 24.51-b03, mixed mode)
And on the deployed boxes:
$ java -version
I suspect Patrick is right about the cause. The Maven artifact that
was released does contain this class (phew)
http://search.maven.org/#artifactdetails%7Corg.apache.spark%7Cspark-core_2.10%7C1.0.0%7Cjar
As to the hadoop1 / hadoop2 artifact question -- agree that is often
done. Here the working t
Also I should add - thanks for taking time to help narrow this down!
On Sun, Jun 8, 2014 at 1:02 PM, Patrick Wendell wrote:
> Paul,
>
> Could you give the version of Java that you are building with and the
> version of Java you are running with? Are they the same?
>
> Just off the cuff, I wonder
Paul,
Could you give the version of Java that you are building with and the
version of Java you are running with? Are they the same?
Just off the cuff, I wonder if this is related to:
https://issues.apache.org/jira/browse/SPARK-1520
If it is, it could appear that certain functions are not in the
Moving over to the dev list, as this isn't a user-scope issue.
I just ran into this issue with the missing saveAsTestFile, and here's a
little additional information:
- Code ported from 0.9.1 up to 1.0.0; works with local[n] in both cases.
- Driver built as an uberjar via Maven.
- Deployed to sma
I'm experiencing the same error while upgrading from 0.9.1 to 1.0.0.
Im using google compute engine and cloud storage. but saveAsTextFile is
returning errors while saving in the cloud or saving local. When i start a
job in the cluster i do get an error but after this error it keeps on
running fine
I have the same problem (Spark 0.9.1-> 1.0.0 and throws error) and I do call
saveAsTextFile. Recompiled for 1.0.0.
org.apache.spark.SparkException: Job aborted due to stage failure: Task
0.0:10 failed 4 times, most recent failure: Exception failure in TID 1616 on
host r3s1n03.bigdata.emea.nsn-net
No, it's a Scala application. Unfortunately after I came across problems
with running using mesos coarse mode and this issue I decided to do the
downgrade to Spark 0.9.1
and purged logs.But I as far as I can remember I tried to run my app using
Spark standalone mode there was also the same ClassNot
Actually, what the stack trace is showing is the result of an exception
being thrown by the DAGScheduler's event processing actor. What happens is
that the Supervisor tries to shut down Spark when an exception is thrown by
that actor. As part of the shutdown procedure, the DAGScheduler tries to
c
On Tue, Jun 3, 2014 at 8:46 PM, Marek Wiewiorka
wrote:
> Hi All,
> I've been experiencing a very strange error after upgrade from Spark 0.9
> to 1.0 - it seems that saveAsTestFile function is throwing
> java.lang.UnsupportedOperationException that I have never seen before.
>
In the stack trace y
yes, I have - I compiled both Spark and my soft from sources - actually the
whole processing is executing fine - just saving results is failing.
2014-06-03 21:01 GMT+02:00 Gerard Maas :
> Have you tried re-compiling your job against the 1.0 release?
>
>
> On Tue, Jun 3, 2014 at 8:46 PM, Marek W
Have you tried re-compiling your job against the 1.0 release?
On Tue, Jun 3, 2014 at 8:46 PM, Marek Wiewiorka
wrote:
> Hi All,
> I've been experiencing a very strange error after upgrade from Spark 0.9
> to 1.0 - it seems that saveAsTestFile function is throwing
> java.lang.UnsupportedOperation
Hi All,
I've been experiencing a very strange error after upgrade from Spark 0.9 to
1.0 - it seems that saveAsTestFile function is throwing
java.lang.UnsupportedOperationException that I have never seen before.
Any hints appreciated.
scheduler.TaskSetManager: Loss was due to java.lang.ClassNotFoun
14 matches
Mail list logo
