ah yah that would not work.
On Mon, Feb 1, 2016 at 2:31 PM, Shixiong(Ryan) Zhu
wrote:
> I guess he used client model and the local Spark version is 1.5.2 but the
> standalone Spark version is 1.5.1. In other words, he used a 1.5.2 driver
> to talk with 1.5.1 executors.
>
> On Mon, Feb 1, 2016 at
I guess he used client model and the local Spark version is 1.5.2 but the
standalone Spark version is 1.5.1. In other words, he used a 1.5.2 driver
to talk with 1.5.1 executors.
On Mon, Feb 1, 2016 at 2:08 PM, Holden Karau wrote:
> So I'm a little confused to exactly how this might have happened
So I'm a little confused to exactly how this might have happened - but one
quick guess is that maybe you've built an assembly jar with Spark core, can
you mark it is a provided and or post your build file?
On Fri, Jan 29, 2016 at 7:35 AM, Ted Yu wrote:
> I logged SPARK-13084
>
> For the moment,
I logged SPARK-13084
For the moment, please consider running with 1.5.2 on all the nodes.
On Fri, Jan 29, 2016 at 5:29 AM, Jason Plurad wrote:
> I agree with you, Ted, if RDD had a serial version UID this might not be
> an issue. So that could be a JIRA to submit to help avoid version
> mismatc
I agree with you, Ted, if RDD had a serial version UID this might not be an
issue. So that could be a JIRA to submit to help avoid version mismatches
in future Spark versions, but that doesn't help my current situation
between 1.5.1 and 1.5.2.
Any other ideas? Thanks.
On Thu, Jan 28, 2016 at 5:06
I am not Scala expert.
RDD extends Serializable but doesn't have @SerialVersionUID() annotation.
This may explain what you described.
One approach is to add @SerialVersionUID so that RDD's have stable serial
version UID.
Cheers
On Thu, Jan 28, 2016 at 1:38 PM, Jason Plurad wrote:
> I've searc
Yes, I removed my Spark dir and scp’ed the master’s build to all cluster
machines suspecting that problem.
My app (Apache Mahout) had Spark 1.0.1 in the POM but changing it to 1.0.2 (the
Spark version installed) gave another error. I guess I’ll have to install Spark
1.0.1 or get Mahout to updat
