i've seen a few more builds fail w/timeouts and it appears that we're
definitely NOT hitting any rate limiting.
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/22005/console
[jenkins@amp-jenkins-slave-01 ~]$ curl -i -H "Authorization: token
" https://api.github.com | grep Rate
ok, i did some testing and found out what's happening.
https://issues.apache.org/jira/browse/SPARK-4021
here's the TL;DR:
jenkins ignores what JDKs are installed via the web interface when there's
more than one defined, and falls back to whatever is default on the slave
the test is run on. in th
Hi Xiangrui,
Thanks for the reply. AVF is not so difficult to implement in parallel. It
just calculate the frequency of each attribute and calculate the overall
'score' of the datapoint. Low score points are considered outlier. One
advantage of it is that it does not calculate distance, so in that
i'm currently in a meeting and will be starting to do some tests in ~1 hour
or so.
On Tue, Oct 21, 2014 at 11:07 AM, Nan Zhu wrote:
> I agree with Sean
>
> I just compiled spark core successfully with 7u71 in Mac OS X
>
> On Tue, Oct 21, 2014 at 1:11 PM, Josh Rosen wrote:
>
>> Ah, that makes se
I agree with Sean
I just compiled spark core successfully with 7u71 in Mac OS X
On Tue, Oct 21, 2014 at 1:11 PM, Josh Rosen wrote:
> Ah, that makes sense. I had forgotten that there was a JIRA for this:
>
> https://issues.apache.org/jira/browse/SPARK-4021
>
> On October 21, 2014 at 10:08:58 AM
Josh - the errors that broke our build indicated that JDK5 was being
used. Somehow the upgrade caused our build to use a much older Java
version. See the JIRA for more details.
On Tue, Oct 21, 2014 at 10:05 AM, Josh Rosen wrote:
> I find it concerning that there's a JDK version that breaks out bu
Ah, that makes sense. I had forgotten that there was a JIRA for this:
https://issues.apache.org/jira/browse/SPARK-4021
On October 21, 2014 at 10:08:58 AM, Patrick Wendell (pwend...@gmail.com) wrote:
Josh - the errors that broke our build indicated that JDK5 was being
used. Somehow the upgra
Given the nature of the error, I would be really, really shocked if
Java 7u71 were actually being used in the failing build, so no I do
not thing the problem has to do with 7u71 per se.
As I'd expect I see no changes to javac in this update from 7u65, and
no chatter about crazy javac regressions.
I find it concerning that there’s a JDK version that breaks out build, since
we’re supposed to support Java 7. Is 7u71 an upgrade or downgrade from the JDK
that we used before? Is there an easy way to fix our build so that it compiles
with 7u71’s stricter settings?
I’m not sure why the “New”
Hi Ashutosh,
The process you described is correct, with details documented in
https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark
. There is no outlier detection algorithm in MLlib. Before you start
coding, please open an JIRA and let's discuss which algorithms are
appropriate
Hi,
I am new to Apache Spark (any open source project). I want to contribute to
it. I found that MLlib has no algorithm for outlier detection yet. By
literature review I found the algorithm Attribute Value Frequency (AVF) is
promising. Here is the link DOI: 10.1109/ICTAI.2007.125
By following th
weird…..two buildings (one triggered by New, one triggered by Old) were
executed in the same node, amp-jenkins-slave-01, one compiles, one not…
Best,
--
Nan Zhu
On Tuesday, October 21, 2014 at 9:39 AM, Nan Zhu wrote:
> seems that all PRs built by NewSparkPRBuilder suffers from 7u71, while
seems that all PRs built by NewSparkPRBuilder suffers from 7u71, while
SparkPRBuilder is working fine
Best,
--
Nan Zhu
On Tuesday, October 21, 2014 at 9:22 AM, Cheng Lian wrote:
> It's a new pull request builder written by Josh, integrated into our
> state-of-the-art PR dashboard :)
>
It's a new pull request builder written by Josh, integrated into our
state-of-the-art PR dashboard :)
On 10/21/14 9:33 PM, Nan Zhu wrote:
just curious…what is this “NewSparkPullRequestBuilder”?
Best,
--
Nan Zhu
On Tuesday, October 21, 2014 at 8:30 AM, Cheng Lian wrote:
Hm, seems that 7u71 c
just curious…what is this “NewSparkPullRequestBuilder”?
Best,
--
Nan Zhu
On Tuesday, October 21, 2014 at 8:30 AM, Cheng Lian wrote:
>
> Hm, seems that 7u71 comes back again. Observed similar Kinesis compilation
> error just now:
> https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPu
Hm, seems that 7u71 comes back again. Observed similar Kinesis
compilation error just now:
https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/410/consoleFull
Checked Jenkins slave nodes, saw /usr/java/latest points to jdk1.7.0_71.
However, /usr/bin/javac -version says:
This one can be resolved, I think, with a bit of help from someone who
understands SBT + plugin config:
https://issues.apache.org/jira/browse/SPARK-3359
Just a matter of figuring out how to set a property on the plugin.
This would make Java 8 javadoc work much more nicely. Minor but
useful!
17 matches
Mail list logo
