[
https://issues.apache.org/jira/browse/SPARK-22426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16235461#comment-16235461
]
Sean Owen commented on SPARK-22426:
-----------------------------------
If the node has failed, YARN already can't or won't launch anything on that
NodeManager. Are you saying something slightly different?
> Spark AM launching containers on node where External spark shuffle service
> failed to initialize
> -----------------------------------------------------------------------------------------------
>
> Key: SPARK-22426
> URL: https://issues.apache.org/jira/browse/SPARK-22426
> Project: Spark
> Issue Type: Bug
> Components: Shuffle, YARN
> Affects Versions: 1.6.3
> Reporter: Prabhu Joseph
> Priority: Major
>
> When Spark External Shuffle Service on a NodeManager fails, the remote
> executors will fail while fetching the data from the executors launched on
> this Node. Spark ApplicationMaster should not launch containers on this Node
> or not use external shuffle service.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
