+1
Compiled for CentOS 6.5, deployed in our 4 node cluster (Hadoop 2.2, YARN)
Smoke Tests (sparkPi,spark-shell, web UI) successful
Cheers
On Thu, Jun 26, 2014 at 7:06 PM, Patrick Wendell wrote:
> Please vote on releasing the following candidate as Apache Spark version
> 1.0.1!
>
> The tag to
Hi Xiaokai,
My bad. I didn't notice this before I created another PR for Poisson
regression. The mails were buried in junk by the corp mail master. Also, thanks
for considering my comments and advice in your PR.
Adding my two cents here:
* PoissonRegressionModel and GammaRegressionModel have t
(Forgot to mention, that UI bug is not in Spark 1.0.0, so it is technically
a regression)
2014-06-27 15:42 GMT-07:00 Andrew Or :
> There is an issue with the SparkUI: the storage page continues to display
> RDDs that are dropped from memory. This is fixed in
> https://github.com/apache/spark/com
One question, then, is what to use to debug Spark if Intellij can only be used
for code browsing for the sake of unresolved symbols as mentioned by Ron?
More specifically, if one builds from command line, but would like to debug a
running Spark from a IDE, Intellij, e.g., what could he do?
Anot
There is an issue with the SparkUI: the storage page continues to display
RDDs that are dropped from memory. This is fixed in
https://github.com/apache/spark/commit/21e0f77b6321590ed86223a60cdb8ae08ea4057f
but is not part of this RC.
2014-06-27 11:18 GMT-07:00 Matei Zaharia :
> +1
>
> Tested it
Thanks David...Let me try it...I am keen to see the results first and later
will look into runtime optimizations...
Deb
On Fri, Jun 27, 2014 at 3:12 PM, David Hall wrote:
> I have no ideas on benchmarks, but breeze has a CG solver:
>
> https://github.com/scalanlp/breeze/tree/master/math/src
I have no ideas on benchmarks, but breeze has a CG solver:
https://github.com/scalanlp/breeze/tree/master/math/src/main/scala/breeze/optimize/linear/ConjugateGradient.scala
https://github.com/scalanlp/breeze/blob/e2adad3b885736baf890b306806a56abc77a3ed3/math/src/test/scala/breeze/optimize/linear/C
Hi,
I am looking for an efficient linear CG to be put inside the Quadratic
Minimization algorithms we added for Spark mllib.
With a good linear CG, we should be able to solve kernel SVMs with this
solver in mllib...
I use direct solves right now using cholesky decomposition which has higher
comp
+1
Tested it out on Mac OS X and Windows, looked through docs.
Matei
On Jun 26, 2014, at 7:06 PM, Patrick Wendell wrote:
> Please vote on releasing the following candidate as Apache Spark version
> 1.0.1!
>
> The tag to be voted on is v1.0.1-rc1 (commit 7feeda3):
> https://git-wip-us.apache.
Thanks Reynold for advice.
Ron
-Original Message-
From: Reynold Xin [mailto:r...@databricks.com]
Sent: Thursday, June 26, 2014 8:57 PM
To: dev@spark.apache.org
Subject: Re: IntelliJ IDEA cannot compile TreeNode.scala
IntelliJ parser/analyzer/compiler behaves differently from Scala compi
Hi,
In my experiments with Jellyfish I did not see any substantial RMSE loss
over DSGD for Netflix dataset...
So we decided to stick with ALS and implemented a family of Quadratic
Minimization solvers that stays in the ALS realm but can solve interesting
constraints(positivity, bounds, L1, equali
Hi all,
Just found this thread -- is there an update on including DSGD in Spark? We
have a project that entails topic modeling on a document-term matrix using
matrix factorization, and were wondering if we should use ALS or attempt
writing our own matrix factorization implementation on top of Spar
12 matches
Mail list logo
