For #1, a brief search landed the following:
core/src/main/scala/org/apache/spark/SparkConf.scala:
DeprecatedConfig("spark.rpc", "2.0", "Not used any more.")
core/src/main/scala/org/apache/spark/SparkConf.scala:
"spark.rpc.numRetries" -> Seq(
core/src/main/scala/org/apache/spark/SparkConf.scala:
Thanks Steve!
1. spark-submit submitting the YARN app for launch? That you get it if you
turn hadoop IPC encruption on, by settingo hadoop.rpc.protection=privacy
across the cluster.
> That's what I meant: Is there something similar for stand alone or Mesos?
2. communications between spark driver
> On 1 Feb 2016, at 20:48, eugene miretsky wrote:
>
> Spark supports client authentication via shared secret or kerberos (on YARN).
> However, the job itself is sent unencrypted over the network. Is there a way
> to encrypt the jobs the client submits to cluster?
define submission?
1. sp