[
https://issues.apache.org/jira/browse/SPARK-21321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jong Yoon Lee updated SPARK-21321:
----------------------------------
Description:
on shutdown spark can be very verbose and spit out errors that cause the user
to be confused.
If possible we should not print those out and just ignore them.
This happens more with dynamic allocaiton on.
I am suggesting to change the log level when the shutdown is happening and the
RPC connections are closed(RpcEnvStoppedException).
was:
on shutdown spark can be very verbose and spit out errors that cause the user
to be confused.
If possible we should not print those out and just ignore them.
This happens more with dynamic allocaiton on.
> Spark very verbose on shutdown confusing users
> ----------------------------------------------
>
> Key: SPARK-21321
> URL: https://issues.apache.org/jira/browse/SPARK-21321
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 2.1.1
> Reporter: Jong Yoon Lee
> Priority: Minor
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> on shutdown spark can be very verbose and spit out errors that cause the user
> to be confused.
> If possible we should not print those out and just ignore them.
> This happens more with dynamic allocaiton on.
> I am suggesting to change the log level when the shutdown is happening and
> the RPC connections are closed(RpcEnvStoppedException).
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
