Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/2840#issuecomment-60980751
> Maybe this is future work, but would we not want to decrease it
(essentially cancel pending requests over what we have) when the pending task
queue drains?
Yeah, we might want to do that simply because the RM keeps around all
pending requests. On the other hand, an argument against this is that it
requires adding a new message between the driver and the AM, and keeping track
of which pending executors belong to which episode of backlog.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
