ideas for MLlib development

seful contribution. Thanks for your interest and I look forward to your comments. Robert Dodier - To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org

Re: ideas for MLlib development

a very high level, the API for this framework would specify methods to compute conditional distributions, marginalizing as necessary via MCMC. Other operations could include computing the expected value of a variable or function. All this is very reminiscent of BUGS, of course.

sbt test error -- "Could not reserve enough space"

ly simple) but it seems to do a lot more work than just running that one test, and I still get the out-of-memory errors. Aside from getting a machine with more memory (which is not out of the question), are there any stretegies for coping with out-of-memory errors in Maven and/or sbt? Thanks in adva

Re: SPARK_MASTER_IP actually expects a DNS name, not IP address

ged to disallow --ip without propagating that backwards into any scripts that call it? Hope this helps in some way. Robert Dodier -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/SPARK-MASTER-IP-actually-expects-a-DNS-n

Re: SPARK_MASTER_IP actually expects a DNS name, not IP address

Nicholas, FWIW the --ip option seems to have been deprecated in commit d90d2af1, but that was a pretty big commit, lots of other stuff changed, and there isn't any hint in the log message as to the reason for changing --ip. best, Robert D

slightly more informative error message in MLUtils.loadLibSVMFile

would want to print something else, all that matters is to give some context so that the user can find the problem more quickly. Hope this helps in some way. Robert Dodier PS. diff --git a/mllib/src/main/scala/org/apache/spark/mllib/util/MLUtils.scala b/mllib/src/main/scala/org/apache/spark/

Re: Problem in running MLlib SVM

very large range of outputs -- something like -6*10^6 to -400, with a mean of about -3. If you look into it, let us know what you find, I would be interested to hear about it. best, Robert Dodier -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Pr

Dependency on TestingUtils in a Spark package

ject which was doing something similar. Thanks in advance for any light you can shed on this problem. Robert Dodier - To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org

Re: Dependency on TestingUtils in a Spark package

nd it seems like it would be a good idea to have a uniform testing environment between the PR and the Spark package. best, Robert Dodier - To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional command