Also, huge thanks to Cheng Lian, who tracked down and fixed the final issue
that was causing the Maven master build’s Spark SQL tests to fail!
On September 13, 2014 at 11:08:00 PM, Patrick Wendell (pwend...@gmail.com)
wrote:
Hey All,
Wanted to send a quick update about test infrastructure. Wi
Hey All,
Wanted to send a quick update about test infrastructure. With the
number of contributors we have and the rate of development,
maintaining a well-oiled test infra is really important.
Every time a flaky test fails a legitimate pull request, it wastes
developer time and effort.
1. Master
Hi All:
We know some memory of spark are used for computing (e.g.,
spark.shuffle.memoryFraction) and some are used for caching RDD for future
use (e.g., spark.storage.memoryFraction).
Is there any existing workload which can utilize both of them during the
running left cycle? I want to do some pe
Hi Yanbo,
We made the change here
https://github.com/apache/spark/commit/5d25c0b74f6397d78164b96afb8b8cbb1b15cfbd
Those apis to set the parameters are very difficult to maintain, so we
decide not to provide them. In next release, Spark 1.2, we will have a
better api design for parameter setting.
I also found
https://github.com/apache/spark/commit/8f6e2e9df41e7de22b1d1cbd524e20881f861dd0
had resolve this issue but it seems that right code snippet not occurs in
master or 1.1 release.
2014-09-13 17:12 GMT+08:00 Yanbo Liang :
> Hi All,
>
> I found that LogisticRegressionWithLBFGS interface i
Hi All,
I found that LogisticRegressionWithLBFGS interface is not consistent
with LogisticRegressionWithSGD in master and 1.1 release.
https://github.com/apache/spark/blob/master/mllib/src/main/scala/org/apache/spark/mllib/classification/LogisticRegression.scala#L199
In the above code snippet, u
