hursday, July 03, 2014 3:31 PM
> To: dev@spark.apache.org
> Subject: Re: Pass parameters to RDD functions
>
> Declare this class with "extends Serializable", meaning
> java.io.Serializable?
>
> On Thu, Jul 3, 2014 at 12:24 PM, Ulanov, Alexander <
> alexander.ula...@h
?)
Alexander
-Original Message-
From: Sean Owen [mailto:so...@cloudera.com]
Sent: Thursday, July 03, 2014 3:31 PM
To: dev@spark.apache.org
Subject: Re: Pass parameters to RDD functions
Declare this class with "extends Serializable", meaning java.io.Serializable?
On Thu, Jul 3, 201
Declare this class with "extends Serializable", meaning java.io.Serializable?
On Thu, Jul 3, 2014 at 12:24 PM, Ulanov, Alexander
wrote:
> Hi,
>
> I wonder how I can pass parameters to RDD functions with closures. If I do it
> in a following way, Spark crashes with No
Hi,
I wonder how I can pass parameters to RDD functions with closures. If I do it
in a following way, Spark crashes with NotSerializableException:
class TextToWordVector(csvData:RDD[Array[String]]) {
val n = 1
lazy val x = csvData.map{ stringArr => stringArr(n)}.collect()
}
Exception:
