Github user JoshRosen commented on the pull request:
https://github.com/apache/spark/pull/2944#issuecomment-60877993
I've rewritten this patch so that thread dumps are triggered on-demand
using a new driver -> executor RPC channel. There are a few hacks involved in
setting this up, mostly to work around some limitations of our current executor
registration mechanisms without resorting to heavy refactoring. Please take a
look and let me know what you think.
I'm going to leave a couple of comments on the diff to help explain the
hackier parts of these changes.
Also, we still might want to enable compression of the stacktrace RPCs, but
I'll leave that to a separate PR (this would be a good starter JIRA task, BTW).
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
