RDD MLLib Deprecation Question

2017-05-30 Thread John Compitello
Hey all, I see on the MLLib website that there are plans to deprecate the RDD based API for MLLib once the new ML API reaches feature parity with RDD based one. Are there currently plans to reimplement all the distributed linear algebra / matrices operations as part of this new API, or are the

Spark Conf Problem with CacheLoader

2017-04-24 Thread John Compitello
Hey all, I’ve been working on contributing to Spark a little bit in past few weeks, but I’ve suddenly encountered a problem I’m having some trouble with. Specifically, however I’ve built Spark on my laptop, I am unable to create a SparkConf. I’ve done it in the past, but somehow it’s now broke

Re: :40: error: value join is not a member of Unit

2017-04-19 Thread John Compitello
This is not a mailing list to ask for help with your code not working. This mailing list is for Spark Developers. This question would be a better fit for StackOverflow, or for the user mailing list u...@spark.apache.org . Best, John > On Apr 19, 2017, at 1:43 P

Pull Request Made, Ignored So Far

2017-03-31 Thread John Compitello
Hi all, I’m a new Spark contributor who put in a pull request a few days ago: https://github.com/apache/spark/pull/17459 It’s a relatively small, isolated change that should be pretty simple to review. It has been a big help in the main project I’m