Re: RDD[Vector] Immutability issue

2015-12-28 Thread salexln
Hi Yu, thanks for the reply. I only run it in my machine (in order to debug the algorithm) . What other conditions did you have it mind? My whole code is here: https://github.com/salexln/FinalProject_FCM Best, Alex -- View this message in context: http://apache-spark-developers-list.1001551.

Re: RDD[Vector] Immutability issue

2015-12-28 Thread Yu Ishikawa
Hi salexln, Did you reproduce the same issue under any different condition? I can't reproduce this issue, since I don't know the details of the algorithm. Please let me know more detailed condition or the repository? Thanks, Yu - -- Yu Ishikawa -- View this message in context: http://apac

RDD[Vector] Immutability issue

2015-12-28 Thread salexln
Hi guys, I know the RDDs are immutable and therefore their value cannot be changed but I see the following behaviour: I wrote an implementation for FuzzyCMeans algorithm and now I'm testing it, so i run the following example: import org.apache.spark.mllib.clustering.FuzzyCMeans import org.apache.s

Re: Catalyst Class Cast Exception

2015-12-28 Thread sara mustafa
Not yet, but I will try it. Thank you. -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Catalyst-Class-Cast-Exception-tp15822p15826.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com. --

Re: Catalyst Class Cast Exception

2015-12-28 Thread Michael Armbrust
Looks like a bug. Have you tried Spark 1.6 RC4? http://people.apache.org/~pwendell/spark-releases/spark-1.6.0-rc4-bin/ On Mon, Dec 28, 2015 at 12:17 PM, sara mustafa wrote: > spark 1.5.2 > > > > -- > View this message in context: > http://apache-spark-developers-list.1001551.n3.nabble.com/Cata

Re: Catalyst Class Cast Exception

2015-12-28 Thread sara mustafa
spark 1.5.2 -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Catalyst-Class-Cast-Exception-tp15822p15824.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com. ---

Re: Catalyst Class Cast Exception

2015-12-28 Thread Michael Armbrust
Which version of spark? On Mon, Dec 28, 2015 at 12:04 PM, sara mustafa wrote: > Hi, > > I am trying to run a sql query from TPC-H query samples using DataFrame, > but > it throw this exception > > java.lang.ClassCastException: > org.apache.spark.sql.catalyst.expressions.GenericInternalRow cannot

Catalyst Class Cast Exception

2015-12-28 Thread sara mustafa
Hi, I am trying to run a sql query from TPC-H query samples using DataFrame, but it throw this exception java.lang.ClassCastException: org.apache.spark.sql.catalyst.expressions.GenericInternalRow cannot be cast to org.apache.spark.sql.catalyst.expressions.UnsafeRow at org.apache.spark.sql