RE: Feature Generation On Spark

2015-07-18 Thread Mohammed Guller
rishikesh thakur [mailto:rishikeshtha...@hotmail.com] Sent: Friday, July 17, 2015 12:33 AM To: Mohammed Guller Subject: Re: Feature Generation On Spark Thanks I did look at the example. I am using Spark 1.2. The modules mentioned there are not in 1.2 I guess. The import is

RE: Feature Generation On Spark

2015-07-09 Thread Mohammed Guller
Take a look at the examples here: https://spark.apache.org/docs/latest/ml-guide.html Mohammed From: rishikesh thakur [mailto:rishikeshtha...@hotmail.com] Sent: Saturday, July 4, 2015 10:49 PM To: ayan guha; Michal Čizmazia Cc: user Subject: RE: Feature Generation On Spark I have one document

RE: Feature Generation On Spark

2015-07-04 Thread rishikesh thakur
I have one document per file and each file is to be converted to a feature vector. Pretty much like standard feature construction for document classification. ThanksRishi Date: Sun, 5 Jul 2015 01:44:04 +1000 Subject: Re: Feature Generation On Spark From: guha.a...@gmail.com To: mici

RE: Feature Generation On Spark

2015-07-04 Thread rishikesh thakur
09:37:52 -0400 > Subject: Re: Feature Generation On Spark > From: mici...@gmail.com > To: rishikeshtha...@hotmail.com > CC: user@spark.apache.org > > Spark Context has a method wholeTextFiles. Is that what you need? > > On 4 July 2015 at 07:04, rishikesh wrote: > &g

Re: Feature Generation On Spark

2015-07-04 Thread ayan guha
s to be merged. But I am not > able > > to figure out how to do that. > > > > Thanks > > Rishi > > > > > > > > -- > > View this message in context: > http://apache-

Re: Feature Generation On Spark

2015-07-04 Thread Michal Čizmazia
o one executor or multiple. If the > file is split then the feature vectors needs to be merged. But I am not able > to figure out how to do that. > > Thanks > Rishi > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/

Feature Generation On Spark

2015-07-04 Thread rishikesh
-- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Feature-Generation-On-Spark-tp23617.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user