Github user tnachen commented on the pull request:
https://github.com/apache/spark/pull/10319#issuecomment-171567791
@drcrallen about waiting suggestions, the best way from the scheduler side
is waiting until all tasks are terminated when you like to shutdown. I'm
thinking that if this stop is at the very end of the shutdown call, another way
is to use a shutdownLock with wait on a timeout here and then just call notify
on the TaskStatus update when the map is empty. If the wait exits before it's
empty then we know the timeout has hit first. I think we just want to make sure
nothing in the scheduler is calling stop by itself, so we don't deadlock.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
