Re: pyspark MLlib examples don't work with Spark 1.0.0

2014-05-31 Thread Patrick Wendell
I've removed my docs from my site to avoid confusion... somehow that link propogated all over the place! On Sat, May 31, 2014 at 1:58 AM, Xiangrui Meng wrote: > The documentation you looked at is not official, though it is from > @pwendell's website. It was for the Spark SQL release. Please find

Re: pyspark MLlib examples don't work with Spark 1.0.0

2014-05-31 Thread Xiangrui Meng
The documentation you looked at is not official, though it is from @pwendell's website. It was for the Spark SQL release. Please find the official documentation here: http://spark.apache.org/docs/latest/mllib-linear-methods.html#linear-support-vector-machine-svm It contains a working example show

Re: pyspark MLlib examples don't work with Spark 1.0.0

2014-05-30 Thread jamborta
thanks for the reply. I am definitely running 1.0.0, I set it up manually. To answer my question, I found out from the examples that it would need a new data type called LabeledPoint instead of numpy array. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/py

Re: pyspark MLlib examples don't work with Spark 1.0.0

2014-05-29 Thread Xiangrui Meng
You are using ec2. Did you specify the spark version when you ran spark-ec2 script or update /root/spark after the cluster was created? It is very likely that you are running 0.9 on ec2. -Xiangrui On Thu, May 29, 2014 at 5:22 PM, jamborta wrote: > Hi all, > > I wanted to try spark 1.0.0, because