Re: Question about mllib.recommendation.ALS

2017-06-08 Thread Sahib Aulakh [Search] ­
Many thanks. Will try it. On Thu, Jun 8, 2017 at 8:41 AM Nick Pentreath wrote: > Spark 2.2 will support the recommend-all methods in ML. > > Also, both ML and MLLIB performance has been greatly improved for the > recommend-all methods. > > Perhaps you could check out the current RC of Spark 2.2 o

Re: Question about mllib.recommendation.ALS

2017-06-08 Thread Nick Pentreath
Spark 2.2 will support the recommend-all methods in ML. Also, both ML and MLLIB performance has been greatly improved for the recommend-all methods. Perhaps you could check out the current RC of Spark 2.2 or master branch to try it out? N On Thu, 8 Jun 2017 at 17:18, Sahib Aulakh [Search] ­ < s

Re: Question about mllib.recommendation.ALS

2017-06-08 Thread Sahib Aulakh [Search] ­
Many thanks for your response. I already figured out the details with some help from another forum. 1. I was trying to predict ratings for all users and all products. This is inefficient and now I am trying to reduce the number of required predictions. 2. There is a nice example burie

Re: Question about mllib.recommendation.ALS

2017-06-07 Thread Ryan
1. could you give job, stage & task status from Spark UI? I found it extremely useful for performance tuning. 2. use modele.transform for predictions. Usually we have a pipeline for preparing training data, and use the same pipeline to transform data you want to predict could give us the predictio