EnricoMi commented on PR #51199:
URL: https://github.com/apache/spark/pull/51199#issuecomment-3438562319
> As @EnricoMi mentioned, the feature `Cleanup shuffles from fallback
storage` exists already. I believe the PR title is too broad because it claims
it is a new feature which is not true. I'd recommend to revise the PR title
precisely.
>
> > Currently, the shuffle data are only removed from the fallback storage
on Spark context shutdown.
Sure, what about
Cleanup individual shuffles from fallback storage on RemoveShuffle event
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
