Re: Apache Spark and Swift object store

2014-06-14 Thread Matthew Farrellee
On 06/08/2014 04:01 AM, Gil Vernik wrote: Hello everyone, I would like to initiate discussion about integration Apache Spark and Openstack Swift. (https://issues.apache.org/jira/browse/SPARK-938 was created while ago) I created a patch (https://github.com/apache/spark/pull/1010) that provides i

Re: Handling stale PRs

2014-08-26 Thread Matthew Farrellee
On 08/26/2014 04:57 AM, Sean Owen wrote: On Tue, Aug 26, 2014 at 7:02 AM, Patrick Wendell wrote: Most other ASF projects I know just ignore these patches. I'd prefer if we Agree, this drives me crazy. It kills part of JIRA's usefulness. Spark is blessed/cursed with incredible inbound load, bu

Re: [VOTE] Release Apache Spark 1.1.0 (RC4)

2014-09-03 Thread Matthew Farrellee
+1 built from sha w/ make-distribution.sh tested basic examples (0 data) w/ local on fedora 20 (openjdk 1.7, python 2.7.5) tested detection and log processing (25GB data) w/ mesos (0.19.0) & nfs on rhel 7 (openjdk 1.7, python 2.7.5) On 09/03/2014 03:24 AM, Patrick Wendell wrote: Please vote

Re: spark-ec2 depends on stuff in the Mesos repo

2014-09-03 Thread Matthew Farrellee
that's not a bad idea. it would also break the circular dep in versions that results in spark X's ec2 script installing spark X-1 by default. best, matt On 09/03/2014 01:17 PM, Shivaram Venkataraman wrote: The spark-ec2 repository isn't a part of Mesos. Back in the days, Spark used to be hos

Re: spark-ec2 depends on stuff in the Mesos repo

2014-09-03 Thread Matthew Farrellee
ks to many Spark versions and you can configure which one should be used. Shivaram On Wed, Sep 3, 2014 at 10:22 AM, Matthew Farrellee mailto:m...@redhat.com>> wrote: that's not a bad idea. it would also break the circular dep in versions that results in spark X's ec2 script

Re: Ask something about spark

2014-09-03 Thread Matthew Farrellee
reynold, would you folks be willing to put some creative commons license information on the site and its content? best, matt On 09/02/2014 06:32 PM, Reynold Xin wrote: I think in general that is fine. It would be great if your slides come with proper attribution. On Tue, Sep 2, 2014 at 3

Re: Ask something about spark

2014-09-03 Thread Matthew Farrellee
from legal to chime in. On Wed, Sep 3, 2014 at 11:15 AM, Matthew Farrellee mailto:m...@redhat.com>> wrote: reynold, would you folks be willing to put some creative commons license information on the site and its content? best, matt On 09/02/2014 06:32 PM, Reynol

Re: yet another jenkins restart early thursday morning -- 730am PDT (and a brief update on our new jenkins infra)

2014-09-11 Thread Matthew Farrellee
shane, is there anything we should do for pull requests that failed, but for unrelated issues? best, matt On 09/11/2014 11:29 AM, shane knapp wrote: ...and the restart is done. On Thu, Sep 11, 2014 at 7:38 AM, shane knapp wrote: jenkins is now in quiet mode, and a restart is happening

Re: yet another jenkins restart early thursday morning -- 730am PDT (and a brief update on our new jenkins infra)

2014-09-11 Thread Matthew Farrellee
.berkeley.edu/jenkins/job/Spark-Master-Maven-with-YARN/557/, which i just started a rebuild on) On Thu, Sep 11, 2014 at 9:15 AM, Matthew Farrellee mailto:m...@redhat.com>> wrote: shane, is there anything we should do for pull requests that failed, but for unrelated issues?