Florian Müller created SPARK-59408:
--------------------------------------
Summary: Propagate spark.ssl.rpc.* passwords to executors on YARN
Key: SPARK-59408
URL: https://issues.apache.org/jira/browse/SPARK-59408
Project: Spark
Issue Type: Bug
Components: YARN
Affects Versions: 4.3.0
Reporter: Florian Müller
spark.ssl.rpc.enabled=true does not work on YARN for the same reason described
in SPARK-58776: SparkConf.isExecutorStartupConf withholds the spark.ssl.*
password keys from the executor startup conf, expecting them on the separate
_SPARK_SSL_RPC_* environment channel that SSLOptions.parse reads back.
ExecutorRunnable.prepareEnvironment never writes those variables, so executors
start with no keystore password and die building their RpcEnv, and the
application aborts on max executor failures.
SPARK-58776 addresses this for Kubernetes only.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
