Re: Proper saving/loading of MatrixFactorizationModel

2016-10-25 Thread eliasah
I know that this haven't been accepted yet but any news on it ? How can we cache the product and user factor ? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Proper-saving-loading-of-MatrixFactorizationModel-tp23952p27959.html Sent from the Apache Spark Use

Re: Proper saving/loading of MatrixFactorizationModel

2015-07-27 Thread Xiangrui Meng
The partitioner is not saved with the RDD. So when you load the model back, we lose the partitioner information. You can call repartition on the user/product factors and then create a new MatrixFactorizationModel object using the repartitioned RDDs. It would be useful to create a utility method for