> On Oct 28, 2020, at 11:57 PM, Chris Lambertus <c...@apache.org> wrote:
>
> Infra would LOVE a smarter way to clean the cache. We have to use a heavy
> hammer because there are 300+ projects that want a piece of it, and who don’t
> clean up.. We are not build engineers, so we rely on the community to advise
> us in dealing with the challenges we face. I would be very happy to work with
> you on tooling to improve the cleanup if it improves the experience for all
> projects.
I'll work on YETUS-1063 so that things make more sense. But in short,
Yetus' "docker-cleanup --sentinel" will purge container images if they are
older than a week, then kill stuck containers after 24 hours. That order
prevents running jobs from getting into trouble. But it also means that in
some cases it doesn't look very clean until two or three days later. But
that's ok: it is important to remember that an empty cache is a useless cache.
Those values came from experiences with Hadoop and HBase, but we can certainly
add some way to tune them. Oh, and unlike the docker tools, it pretty much
ignores labels. It does _not_ do anything with volumes, probably something we
need to add.