On 05/22/2016 08:32 AM, Reynold Xin wrote:
> Kubernetes itself already has facilities for http proxy, doesn't it?
>
Yeah kubernetes has ingress controller which can act the L7 load
balancer and router traffic to Spark UI in this case. But I am referring
to link present in UI to worker and applicat
On 05/22/2016 08:30 AM, Sun Rui wrote:
> I think “reverse proxy” is beneficial to monitoring a cluster in a
> secure way. This feature is not only desired for Spark on standalone,
> but also Spark on YARN, and also projects other than spark.
I think to secure the Spark you can use any reverse prox
Kubernetes itself already has facilities for http proxy, doesn't it?
On Sat, May 21, 2016 at 9:30 AM, Gurvinder Singh wrote:
> Hi,
>
> I am currently working on deploying Spark on kuberentes (K8s) and it is
> working fine. I am running Spark with standalone mode and checkpointing
> the state to
I think “reverse proxy” is beneficial to monitoring a cluster in a secure way.
This feature is not only desired for Spark on standalone, but also Spark on
YARN, and also projects other than spark.
Maybe Apache Knox can help you. Not sure how Knox can integrate with Spark.
> On May 22, 2016, at
This vote passes with 14 +1s (5 binding*) and no 0 or -1! Thanks to
everyone who voted. I'll start work on publishing the release.
+1:
Reynold Xin*
Sean Owen*
Ovidiu-Cristian MARCU
Krishna Sankar
Michael Armbrust*
Yin Huai
Joseph Bradley*
Xiangrui Meng*
Herman van Hövell tot Westerflier
Vishnu P
Hi,
I am currently working on deploying Spark on kuberentes (K8s) and it is
working fine. I am running Spark with standalone mode and checkpointing
the state to shared system. So if master fails K8s starts it and from
checkpoint it recover the earlier state and things just works fine. I
have an is
> On 19 May 2016, at 16:34, Matei Zaharia wrote:
>
> Hi folks,
>
> Around 1.5 years ago, Spark added a maintainer process for reviewing API and
> architectural changes
> (https://cwiki.apache.org/confluence/display/SPARK/Committers#Committers-ReviewProcessandMaintainers)
> to make sure these
