Hi all,
I've heard in a number of presentations Spark's ALS implementation was
going to be moved over to a GraphX version. For example, this
presentation on GraphX
<https://databricks-training.s3.amazonaws.com/slides/graphx@sparksummit_2014-07.pdf>(slide
#23) at the Spark Summit mentioned a 40 LOC version using the Pregel
API. Looking at the ALS source on master
<https://github.com/apache/spark/blob/master/mllib/src/main/scala/org/apache/spark/ml/recommendation/ALS.scala>
it looks like the original implementation is still being used and no use
of GraphX can be seen. Other algorithms mentioned in the GraphX
presentation can be found in the repo
<https://github.com/apache/spark/tree/master/graphx/src/main/scala/org/apache/spark/graphx/lib>
already but I don't see ALS. Could someone link me to the GraphX version
for comparison purposes? Also, could someone comment on why the the
newer version isn't in use yet (i.e. are there tradeoffs with using the
GraphX version that makes it less desirable)?
Thanks,
Ben
- GraphX implementation of ALS? Ben Mabey
-