Re: spark on kubernetes

Hi Reynold, So if that's OK with you, can I go ahead and create JIRA for this. As it seems this feature is missing currently and can benefit not just for kubernetes users but in general Spark standalone mode users too. - Gurvinder On 05/22/2016 12:49 PM, Gurvinder Singh wrote: > On 05/22/2016 10:

Re: [VOTE] Removing module maintainer process

+1 (binding) On Mon, 23 May 2016 at 04:19, Matei Zaharia wrote: > Correction, let's run this for 72 hours, so until 9 PM EST May 25th. > > > On May 22, 2016, at 8:34 PM, Matei Zaharia > wrote: > > > > It looks like the discussion thread on this has only had positive > replies, so I'm going to ca

Re: Using Travis for JDK7/8 compilation and lint-java.

Thank you for feedback. Sure, correctly, that's the reason why the current SparkPullRequestBuilder do not run `lint-java`. :-) In addition, that's the same reason why contributors are reluctant to run `lint-java` and causes breaking on JDK7 builds. Such a tedious and time-consuming job should be

Re: Using Travis for JDK7/8 compilation and lint-java.

Without Zinc, 'mvn -DskipTests clean install' takes ~30 minutes. Maybe not everyone is willing to wait that long. On Sun, May 22, 2016 at 1:30 PM, Dongjoon Hyun wrote: > Oh, Sure. My bad! > > - For Oracle JDK7, mvn -DskipTests install and run `dev/lint-java`. > - For Oracle JDK8, mvn -DskipTest

Re: [VOTE] Removing module maintainer process

Correction, let's run this for 72 hours, so until 9 PM EST May 25th. > On May 22, 2016, at 8:34 PM, Matei Zaharia wrote: > > It looks like the discussion thread on this has only had positive replies, so > I'm going to call a VOTE. The proposal is to remove the maintainer process in > https://c

Re: [VOTE] Removing module maintainer process

+1 (binding) On Sun, May 22, 2016 at 7:34 PM, Matei Zaharia wrote: > It looks like the discussion thread on this has only had positive replies, > so I'm going to call a VOTE. The proposal is to remove the maintainer > process in > https://cwiki.apache.org/confluence/display/SPARK/Committers#Comm

Re: [VOTE] Removing module maintainer process

On Sunday, May 22, 2016, Matei Zaharia wrote: > It looks like the discussion thread on this has only had positive replies, > so I'm going to call a VOTE. The proposal is to remove the maintainer > process in > https://cwiki.apache.org/confluence/display/SPARK/Committers#Committers-ReviewProcessan

[VOTE] Removing module maintainer process

It looks like the discussion thread on this has only had positive replies, so I'm going to call a VOTE. The proposal is to remove the maintainer process in https://cwiki.apache.org/confluence/display/SPARK/Committers#Committers-ReviewProcessandMaintainers

Re: Using Travis for JDK7/8 compilation and lint-java.

Oh, Sure. My bad! - For Oracle JDK7, mvn -DskipTests install and run `dev/lint-java`. - For Oracle JDK8, mvn -DskipTests install and run `dev/lint-java`. Thank you, Ted. Dongjoon. On Sun, May 22, 2016 at 1:29 PM, Ted Yu wrote: > The following line was repeated twice: > > - For Oracle JDK7, mv

Re: Using Travis for JDK7/8 compilation and lint-java.

The following line was repeated twice: - For Oracle JDK7, mvn -DskipTests install and run `dev/lint-java`. Did you intend to cover JDK 8 ? Cheers On Sun, May 22, 2016 at 1:25 PM, Dongjoon Hyun wrote: > Hi, All. > > I want to propose the followings. > > - Turn on Travis CI for Apache Spark PR

Using Travis for JDK7/8 compilation and lint-java.

Hi, All. I want to propose the followings. - Turn on Travis CI for Apache Spark PR queue. - Recommend this for contributors, too Currently, Spark provides Travis CI configuration file to help contributors check Scala/Java style conformance and JDK7/8 compilation easily during their preparing pul

Re:

No permission is required. Just send your PR:) > On May 22, 2016, at 20:04, 成强 > wrote: > > spark-15429

[no subject]

I would like to contribute to spark. I am working on spark-15429. Please give permission to contribute.

Re: spark on kubernetes

On 05/22/2016 10:23 AM, Sun Rui wrote: > If it is possible to rewrite URL in outbound responses in Knox or other > reverse proxy, would that solve your issue? Any process which can keep track of workers and application drivers IP addresses and route traffic to those will work. Considering Spark Ma

Re: spark on kubernetes

If it is possible to rewrite URL in outbound responses in Knox or other reverse proxy, would that solve your issue? > On May 22, 2016, at 14:55, Gurvinder Singh wrote: > > On 05/22/2016 08:32 AM, Reynold Xin wrote: >> Kubernetes itself already has facilities for http proxy, doesn't it? >> > Yea