Josh Rosen created SPARK-51378:
----------------------------------
Summary: JsonProtocol's accumulableExcludeList should also be
applied in TaskEndReason and ExecutorMetricsUpdate events
Key: SPARK-51378
URL: https://issues.apache.org/jira/browse/SPARK-51378
Project: Spark
Issue Type: Improvement
Components: Spark Core, Web UI
Affects Versions: 4.0.0
Reporter: Josh Rosen
Assignee: Josh Rosen
JsonProtocol.accumulableExcludeList (originally added in SPARK-20084) currently
only applies to Stage and Task events. But we also log accumulables in certain
TaskEnd reasons, plus in ExecutorMetricsUpdate.
For consistency, I think we should uniformly apply this exclusion to all of
these events.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
