> On Oct 29, 2020, at 8:37 AM, Allen Wittenauer
> <a...@effectivemachines.com.INVALID> wrote:
>
>
>
>> On Oct 28, 2020, at 11:57 PM, Chris Lambertus <c...@apache.org> wrote:
>>
>> Infra would LOVE a smarter way to clean the cache. We have to use a heavy
>> hammer because there are 300+ projects that want a piece of it, and who
>> don’t clean up.. We are not build engineers, so we rely on the community to
>> advise us in dealing with the challenges we face. I would be very happy to
>> work with you on tooling to improve the cleanup if it improves the
>> experience for all projects.
>
> I'll work on YETUS-1063 so that things make more sense. But in short,
> Yetus' "docker-cleanup --sentinel" will purge container images if they are
> older than a week, then kill stuck containers after 24 hours. That order
> prevents running jobs from getting into trouble. But it also means that in
> some cases it doesn't look very clean until two or three days later. But
> that's ok: it is important to remember that an empty cache is a useless
> cache. Those values came from experiences with Hadoop and HBase, but we can
> certainly add some way to tune them. Oh, and unlike the docker tools, it
> pretty much ignores labels. It does _not_ do anything with volumes, probably
> something we need to add.
Docs updated!
Relevant pages:
-
http://yetus.apache.org/documentation/in-progress/precommit/docker-cleanup/
- http://yetus.apache.org/documentation/in-progress/precommit/docker/
Let me know if something doesn't make sense.
Thanks!
