Re: Exception in saving MatrixFactorizationModel

2015-09-06 Thread Madawa Soysa
Hi, I'll try partitioning. I have another question, after creating the MatrixFactorizationModel through spark, can it be serialized as a Java object without any problem? On 6 September 2015 at 22:39, Ranjana Rajendran wrote: > It looks like you hit https://issues.apache.org/jira/browse/SPARK-7

Re: Exception in saving MatrixFactorizationModel

2015-09-06 Thread Ranjana Rajendran
It looks like you hit https://issues.apache.org/jira/browse/SPARK-7837 . As I understand this occurs if there is skew in unpartitioned data. Can you try partitioning model before saving it ? On Sat, Sep 5, 2015 at 11:16 PM, Madawa Soysa wrote: > outPath is correct. In the path, there are two di

Re: Exception in saving MatrixFactorizationModel

2015-09-05 Thread Madawa Soysa
outPath is correct. In the path, there are two directories data and metadata. In the data directory, following data structure is there. |-data |user |_temporary | 0 |_temporary But nothing is written inside the folders. I'm using spark 1.4.1. On 6 Septembe

Re: Exception in saving MatrixFactorizationModel

2015-09-05 Thread Yanbo Liang
Please check the "outPath" and verify whether the saving succeed. Which version did you use? You may hit this issue which is resolved at version 1.5. 2015-09-05 21:47 GMT+08:00 Madawa Soysa : > Hi All, > > I'm getting an error when trying to save