On 05/26/2016 02:38 AM, Matei Zaharia wrote:
> Just wondering, what is the main use case for the Docker images -- to
> develop apps locally or to deploy a cluster?
I use docker images for both development and deploying on production
cluster. As it makes sure I have the correct version of Java and
OK created this issue https://issues.apache.org/jira/browse/SPARK-15487
please comment on this and also let me know if anyone want to
collaborate on implementing it. Its my first contribution to Spark so
will be exciting.
- Gurvinder
On 05/23/2016 07:55 PM, Gurvinder Singh wrote:
> On 05/23/2
Chen (tnac...@gmail.com
> <mailto:tnac...@gmail.com>) wrote:
>
>> This will also simplify Mesos users as well, DCOS has to work around
>> this with our own proxying.
>>
>> Tim
>>
>> On Sun, May 22, 2016 at 11:53 PM, Gurvinder Singh
>> wrote:
>
Hi Reynold,
So if that's OK with you, can I go ahead and create JIRA for this. As it
seems this feature is missing currently and can benefit not just for
kubernetes users but in general Spark standalone mode users too.
- Gurvinder
On 05/22/2016 12:49 PM, Gurvinder Singh wrote:
> On 05/22
ynamic nature
of application drivers and to some extent workers too.
- Gurvinder
>> On May 22, 2016, at 14:55, Gurvinder Singh
>> wrote:
>>
>> On 05/22/2016 08:32 AM, Reynold Xin wrote:
>>> Kubernetes itself already has facilities for http proxy, doesn't it?
&
worker and application UI. Replied in the
detail to Sun Rui's mail where I gave example of possible scenario.
- Gurvinder
>
> On Sat, May 21, 2016 at 9:30 AM, Gurvinder Singh
> mailto:gurvinder.si...@uninett.no>> wrote:
>
> Hi,
>
> I am currently working on de
in having such a
feature and get together to add it then :)
- Gurvinder
>
> Maybe Apache Knox can help you. Not sure how Knox can integrate with Spark.
>> On May 22, 2016, at 00:30, Gurvinder Singh > <mailto:gurvinder.si...@uninett.no>
Hi,
I am currently working on deploying Spark on kuberentes (K8s) and it is
working fine. I am running Spark with standalone mode and checkpointing
the state to shared system. So if master fails K8s starts it and from
checkpoint it recover the earlier state and things just works fine. I
have an is
I wonder if anyone got any feedback on it. I can look into implement it
but would like to know if such a functionality can be merged into master
back. If yes then please let me know and point me to the direction to
get started.
Regards,
Gurvinder
On 03/04/2016 09:25 AM, Gurvinder Singh wrote
?
Thanks,
Gurvinder
Forwarded Message
Subject: spark master ui to proxy app and worker ui
Date: Thu, 3 Mar 2016 20:12:07 +0100
From: Gurvinder Singh
To: user
Hi,
I am wondering if it is possible for the spark standalone master UI to
proxy app/driver UI and worker UI. The
14 at 9:20 AM, Timothy Chen
> mailto:tnac...@gmail.com>> wrote:
>
> Ok I created SPARK-3817 to track this, will try to
> repro it as well.
>
> Tim
&
Chen wrote:
> (Hit enter too soon...)
>
> What is your setup and steps to repro this?
>
> Tim
>
> On Mon, Oct 6, 2014 at 12:30 AM, Timothy Chen wrote:
>> Hi Gurvinder,
>>
>> I tried fine grain mode before and didn't get into that problem.
>>
>
On 10/06/2014 08:19 AM, Fairiz Azizi wrote:
> The Spark online docs indicate that Spark is compatible with Mesos 0.18.1
>
> I've gotten it to work just fine on 0.18.1 and 0.18.2
>
> Has anyone tried Spark on a newer version of Mesos, i.e. Mesos v0.20.0?
>
> -Fi
>
Yeah we are using Spark 1.1.0 w
On 09/03/2014 04:23 PM, Nicholas Chammas wrote:
> On Wed, Sep 3, 2014 at 3:24 AM, Patrick Wendell wrote:
>
>> == What default changes should I be aware of? ==
>> 1. The default value of "spark.io.compression.codec" is now "snappy"
>> --> Old behavior can be restored by switching to "lzf"
>>
>> 2.
14 matches
Mail list logo
