Re: K-Means And Class Tags

2015-01-08 Thread devl.development
Thanks for the suggestion, can anyone offer any advice on the ClassCast Exception going from Java to Scala? Why does going from JavaRDD.rdd() and then a collect() result in this exception? -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/K-Means-And-Cla

LinearRegressionWithSGD accuracy

2015-01-15 Thread devl.development
>From what I gather, you use LinearRegressionWithSGD to predict y or the response variable given a feature vector x. In a simple example I used a perfectly linear dataset such that x=y y,x 1,1 2,2 ... 1,1 Using the out-of-box example from the website (with and without scaling): val dat

Introduction to Spark Blog

2014-10-09 Thread devl.development
Hi Spark community Having spent some time getting up to speed with the various Spark components in the core package, I've written a blog to help other newcomers and contributors. By no means am I a Spark expert so would be grateful for any advice, comments or edit suggestions. Thanks very much