Re: Exception in saving MatrixFactorizationModel

2015-09-05 Thread Madawa Soysa
outPath is correct. In the path, there are two directories data and metadata. In the data directory, following data structure is there. |-data |user |_temporary | 0 |_temporary But nothing is written inside the folders. I'm using spark 1.4.1. On 6 Septembe

Re: Exception in saving MatrixFactorizationModel

2015-09-05 Thread Yanbo Liang
Please check the "outPath" and verify whether the saving succeed. Which version did you use? You may hit this issue which is resolved at version 1.5. 2015-09-05 21:47 GMT+08:00 Madawa Soysa : > Hi All, > > I'm getting an error when trying to save

Re: (Spark SQL) partition-scoped UDF

2015-09-05 Thread Eron Wright
The transformer is a classification model produced by the NeuralNetClassification estimator of dl4j-spark-ml. Source code here. The neural net operates most efficiently when many examples are classified in batch. I imagine overriding `transform` rather than `predictRaw`. Does anyone know o

Exception in saving MatrixFactorizationModel

2015-09-05 Thread Madawa Soysa
Hi All, I'm getting an error when trying to save a ALS MatrixFactorizationModel. I'm using following method to save the model. *model.save(sc, outPath)* I'm getting the following exception when saving the model. I have attached the full stack trace. Any help would be appreciated to resolve this

Re: [VOTE] Release Apache Spark 1.5.0 (RC3)

2015-09-05 Thread Reynold Xin
Thanks, Krishna, for the report. We should fix your problem using the Python UDFs in 1.6 too. I'm going to close this vote now. Thanks everybody for voting. This vote passes with 8 +1 votes (3 binding) and no 0 or -1 votes. +1: Reynold Xin* Tom Graves* Burak Yavuz Michael Armbrust* Davies Liu For