GitHub user JoshRosen opened a pull request:
https://github.com/apache/spark/pull/10776
[SPARK-10985][WIP][CORE] Avoid passing evicted blocks throughout
BlockManager
This WIP patch refactors portions of the BlockManager and CacheManager in
order to avoid having to pass `evictedBlocks` lists throughout the code.
This is WIP pending a test update and some changes to ensure that the
TaskMetrics updatedBlocks is appropriately updated by the BlockManager code.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/JoshRosen/spark SPARK-10985
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/10776.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #10776
----
commit 848320fc6b0209da42cd6b20aa379e5fa593cdbd
Author: Josh Rosen <[email protected]>
Date: 2016-01-15T03:45:44Z
Delete all of the evictedBlocks stuff; will re-add status updates / task
metrics later.
commit deef93188e7e332dceac6d1cd772da6e2fc39443
Author: Josh Rosen <[email protected]>
Date: 2016-01-15T20:36:47Z
Merge remote-tracking branch 'origin/master' into SPARK-10985
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
