Re: extremely slow k-means version

2014-04-19 Thread ticup
in context: http://apache-spark-user-list.1001560.n3.nabble.com/extremely-slow-k-means-version-tp4489p4493.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: extremely slow k-means version

2014-04-19 Thread Matei Zaharia
The *fast algorithm*: more or less the same operations (in 2 steps instead > of 1) in 2.2 seconds > > 14/04/19 12:52:29 INFO scheduler.DAGScheduler: Stage 3 (reduceByKey at > k-means.scala:84) finished in 2.090 s > > 14/04/19 12:52:29 INFO scheduler.DAGScheduler: Stage 2 (collectAsMap at > k-means.scala:86) finished in 0.117 s > > > Thanks in advance, > Tim. > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/extremely-slow-k-means-version-tp4489.html > Sent from the Apache Spark User List mailing list archive at Nabble.com.

extremely slow k-means version

2014-04-19 Thread ticup
at k-means.scala:84) finished in 2.090 s 14/04/19 12:52:29 INFO scheduler.DAGScheduler: Stage 2 (collectAsMap at k-means.scala:86) finished in 0.117 s Thanks in advance, Tim. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/extremely-slow-k-means-v