[
https://issues.apache.org/jira/browse/SPARK-50073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-50073.
----------------------------------
Resolution: Invalid
Resolving as Invalid — this is a usage/how-to question rather than a specific
Spark defect or actionable change. Usage questions are best directed to
[email protected] (https://spark.apache.org/community.html) or Stack
Overflow (tag apache-spark). Findings from triage: Verified against master
HEAD. This is a usage question (JIRA type "Question", 0 comments) whose premise
is factually wrong. The reporter claims the Master classpath is hardcoded to
$SPARK_HOME/jars and "not customizable" (citing bin/spark-class line 71), but
line 71's LAUNCH_CLASSPATH is only the bootstrap classpath for
org.apache.spark.launcher.Main (build_command() in bin/spark-class), not the
Master process classpath. The Master daemon's real classpath is assembled by
SparkClassCommandBuilder.java: the Master case (lines 53-58) sets
extraClassPath = getenv("SPARK_DAEMON_CLASSPATH") and buil
Please reopen with a concrete reproducer or a specific proposed change if this
is actually a bug or an actionable improvement.
> Intended way of using log4j plugin JARs
> ---------------------------------------
>
> Key: SPARK-50073
> URL: https://issues.apache.org/jira/browse/SPARK-50073
> Project: Spark
> Issue Type: Question
> Components: Documentation
> Affects Versions: 3.5.3
> Reporter: Nikita Sokolov
> Priority: Minor
>
> I want to use a log4j plugin, which would append the logs of Master JVM using
> classes from some 3rd party JARs:
> [https://logging.apache.org/log4j/2.x/manual/plugins.html|https://logging.apache.org/log4j/2.x/manual/plugins.html#plugin-discovery]
> The Spark configuration documentation says that I should configure the log4j
> via conf/log4j2.properties.
> [https://spark.apache.org/docs/latest/configuration.html#configuring-logging]
> This would require me to add my JARs on the class-path of Master, but it is
> not customizable and always is $SPARK_HOME/jars:
> [https://github.com/apache/spark/blob/master/bin/spark-class#L71]
> Is it intended to add such JARs to the $SPARK_HOME/jars?
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
