GitHub user sarutak opened a pull request:
https://github.com/apache/spark/pull/9437
[SPARK-11480][CORE][WEBUI] Wrong callsite is displayed when using
AsyncRDDActions#takeAsync
When we call AsyncRDDActions#takeAsync, actually another
DAGScheduler#runJob is called from another thread so we cannot get proper
callsite infomation.
Following screenshots are before this patch applied and after.
Before:
<img width="1268" alt="2015-11-04 1 26 40"
src="https://cloud.githubusercontent.com/assets/4736016/10914069/0ffc1306-8294-11e5-8e89-c4fadf58dd12.png">
<img width="1258" alt="2015-11-04 1 26 52"
src="https://cloud.githubusercontent.com/assets/4736016/10914070/0ffe84ce-8294-11e5-8b2a-69d36276bedb.png">
After:
<img width="1268" alt="2015-11-04 0 48 07"
src="https://cloud.githubusercontent.com/assets/4736016/10914080/1d8cfb7a-8294-11e5-9e09-ede25c2563e8.png">
<img width="1269" alt="2015-11-04 0 48 26"
src="https://cloud.githubusercontent.com/assets/4736016/10914081/1d934e3a-8294-11e5-8b5e-e3dc37aaced3.png">
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/sarutak/spark SPARK-11480
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/9437.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #9437
----
commit cb38f14548c750fd927036d8f1d84d0d95177fed
Author: Kousuke Saruta <[email protected]>
Date: 2015-11-03T15:50:11Z
Fixed callsite issue when we use AsyncRDDActions#takeAsync
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]