Re: Upgrade to Spark 1.2.1 using Guava

2015-02-28 Thread Erlend Hamnaberg
rlend hah, we were trying to merge your PR and ran into this—small > world. You actually compile the JavaSerializer source in your project? > > @Marcelo do you mean by modifying spark.executor.extraClassPath on all > workers, that didn’t seem to work? > > On Feb 27, 2015, at 1:2

Re: Upgrade to Spark 1.2.1 using Guava

2015-02-27 Thread Erlend Hamnaberg
Hi. I have had a simliar issue. I had to pull the JavaSerializer source into my own project, just so I got the classloading of this class under control. This must be a class loader issue with spark. -E On Fri, Feb 27, 2015 at 8:52 PM, Pat Ferrel wrote: > I understand that I need to supply Gua

Efficient way of scoring all items and users in an ALS model

2015-02-23 Thread Erlend Hamnaberg
Hi. We are using the ALS model, and would like to get all users and items scored. currently we have these methods. https://gist.github.com/hamnis/e396854f4654bd46ebe0 We want to be able to distribute the calculations to the slaves so we dont have to do this on the master. Is there an efficient