INADA Naoki <songofaca...@gmail.com> added the comment: >> This is only useful if the parent process has a lot of memory that's never >> used by the child processes right? Otherwise, you would lose via refcounting >> COWs. > > What we saw in prod is that memory fragmentation caused by gc is the main > reason of shared memory shrink. > > The memory fragmentation is figured out by doing a full collection before > fork and keep it disabled, it'll make a bunch of copy-on-write in child > process.
GC doesn't cause "memory fragmentation". GC touches (writes) GC header and refcount. It cause sharing memory shrink. Maybe, you're wrongly understanding "memory fragmentation". > This can't solve the copy-on-write caused by ref count, but we're thinking > about freezing the ref count on those permanent objects too. It may increase cost of refcount operation, because it makes all INCREF and DECREF bigger. Note that this is only helps application using gc.freeze(). This shouldn't slow down all other applications. > So this is useful if you did some warm-up work in parent process. I don't understand this statement. > Also it could speedup gc if you have large amount of permanent objects. Yes, this helps not only "prefork" application, but also all long running applications having large baseline data. ---------- _______________________________________ Python tracker <rep...@bugs.python.org> <https://bugs.python.org/issue31558> _______________________________________ _______________________________________________ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
