Chandni Singh created SPARK-33665:
-------------------------------------
Summary: Enable ShuffleBlockPusher to stop pushing blocks for a
particular shuffle partition
Key: SPARK-33665
URL: https://issues.apache.org/jira/browse/SPARK-33665
Project: Spark
Issue Type: Sub-task
Components: Shuffle
Affects Versions: 3.1.0
Reporter: Chandni Singh
{{ShuffleBlockPusher}}, which was introduced in SPARK-32917 stops pushing
shuffle blocks for the entire shuffle when it receives "TOO Late" exception.
However, with the change [https://github.com/apache/spark/pull/30433], there is
also a need to stop pushing shuffle blocks for a particular reduce partition.
Refer https://github.com/apache/spark/pull/30433#discussion_r533694433
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
