Re: KMeans Input Format

2014-08-09 Thread AlexanderRiggers
58:34 INFO scheduler.TaskSetManager: Serialized task 0.0:1 as 2215 bytes in 1 ms -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/KMeans-Input-Format-tp11654p11834.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --

Re: KMeans Input Format

2014-08-08 Thread Sean Owen
) > .setEpsilon(1e-4) > .setRuns(1) > .run(train) > > // Evaluate clustering by computing Within Set Sum of Squared Errors > val WSSSE = model.computeCost(train) > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabbl

Re: KMeans Input Format

2014-08-08 Thread AlexanderRiggers
) // Evaluate clustering by computing Within Set Sum of Squared Errors val WSSSE = model.computeCost(train) -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/KMeans-Input-Format-tp11654p11788.html Sent from the Apache Spark User List mailing list archive at Nabb

Re: KMeans Input Format

2014-08-07 Thread Xiangrui Meng
Besides durin's suggestion, please also confirm driver and executor memory in the WebUI, since they are small according to the log: 14/08/07 19:59:10 INFO MemoryStore: Block broadcast_0 stored as values to memory (estimated size 34.6 KB, free 303.3 MB) -Xiangrui -

Re: KMeans Input Format

2014-08-07 Thread durin
cache() with val train = parsedData.repartition(20).cache() Best regards, Simon -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/KMeans-Input-Format-tp11654p11719.html Sent from the Apache Spark User List mailing list archive at Nabbl

Re: KMeans Input Format

2014-08-07 Thread AlexanderRiggers
adPoolExecutor.java:895) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) at java.lang.Thread.run(Thread.java:695) 14/08/07 20:00:41 ERROR TaskSetManager: Task 0.0:0 failed 1 times; aborting job Chairs-MacBook-Pro:spark-1.0.0 admin$ -- View this messag

Re: KMeans Input Format

2014-08-07 Thread Sean Owen
with the flag --driver-memory 2g or more if > you have more RAM available and try again? > > Thanks, > Burak > > - Original Message - > From: "AlexanderRiggers" > To: u...@spark.incubator.apache.org > Sent: Thursday, August 7, 2014 7:37:40 AM >

Re: KMeans Input Format

2014-08-07 Thread Burak Yavuz
ed token `(' Chairs-MacBook-Pro:spark-1.0.0 admin$ println("Within Set Sum of Squared Errors = " + WSSSE) What am I missing? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/KMeans-Input-Format-tp1

KMeans Input Format

2014-08-07 Thread AlexanderRiggers
27; Chairs-MacBook-Pro:spark-1.0.0 admin$ println("Within Set Sum of Squared Errors = " + WSSSE) What am I missing? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/KMeans-Input-Format-tp11654.html