Ok that's reasonable -- it's certainly more of an enhancement than a
critical bug-fix. I would like to get this in for 1.1.0 though, so let's
talk through the right way to do that on the PR.
In the meantime the best alternative is running with lax firewall settings,
which can be somewhat mitigate
Hi Andrew,
The port stuff is great to have, but they are pretty big changes to the
core that are introducing new features and are not exactly fixing important
bugs. For this reason, it probably can't block a release (I'm not even sure
if it should go into a maintenance release where we fix critica
Thanks for helping shepherd the voting on 1.0.1 Patrick.
I'd like to call attention to
https://issues.apache.org/jira/browse/SPARK-2157 and
https://github.com/apache/spark/pull/1107 -- "Ability to write tight
firewall rules for Spark"
I'm currently unable to run Spark on some projects because our
This isn't exactly about Spark itself, more about how an application on
YARN/Mesos can communicate with another one.
How about your application launch program just takes in a parameter (or env
variable or command line argument) for the IP address of your client
application, and just send updates?
Hey All,
We're going to move onto another rc because of this vote.
Unfortunately with the summit activities I haven't been able to usher
in the necessary patches and cut the RC. I will do so as soon as
possible and we can commence official voting.
- Patrick
On Sun, Jun 29, 2014 at 4:56 PM, Reyno
Hi Spark dev community:
I have several questions regarding Application and Spark communication
1) Application Level Progress Monitoring
Currently, our application using in YARN_CLUSTER model running Spark Jobs.
This works well so far, but we would like to monitoring the application
level progres
We should make sure we include the following two patches:
https://github.com/apache/spark/pull/1264
https://github.com/apache/spark/pull/1263
On Fri, Jun 27, 2014 at 8:39 PM, Krishna Sankar wrote:
> +1
> Compiled for CentOS 6.5, deployed in our 4 node cluster (Hadoop 2.2, YARN)
> Smoke Test
