[issue46657] Add mimalloc memory allocator

Change by h-vetinari : -- nosy: +h-vetinari ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.pyth

[issue46657] Add mimalloc memory allocator

Christian Heimes added the comment: ICC 2021 has full support for stdatomic.h and compiles mimalloc just fine: $ CC="icc" ./configure -C --with-pydebug $ make $ ./python Python 3.11.0a5+ (main, Feb 9 2022, 15:57:40) [GCC Intel(R) C++ gcc 7.5 mode] on linux Type "help", "copyright", "credits"

[issue46657] Add mimalloc memory allocator

Christian Heimes added the comment: I re-ran the benchmark of d6f5f010b586: | Benchmark | 2022-02-08_11-54-master-69e10976b2e7 | 2022-02-08_11-57-master-d6f5f010b586 | |-|::|::| | pic

[issue46657] Add mimalloc memory allocator

Christian Heimes added the comment: New benchmark: | Benchmark | 2022-02-08_11-54-master-69e10976b2e7 | 2022-02-08_11-57-master-d6f5f010b586 | |-|::|::| | mako| 8.

[issue46657] Add mimalloc memory allocator

Neil Schemenauer added the comment: My preference would be for --with-mimalloc=yes in an upcoming release. For platforms without the required stdatomic.h stuff, they can manually specify --with-mimalloc=no. That will make them aware that a future release of Python might no longer build (if

[issue46657] Add mimalloc memory allocator

Christian Heimes added the comment: References: - C11 stdatomic.h https://en.cppreference.com/w/c/atomic - mimalloc-atomic.h https://github.com/microsoft/mimalloc/blob/master/include/mimalloc-atomic.h - MSVC Interlocked Variable Access https://docs.microsoft.com/de-de/windows/win32/sync/inte

[issue46657] Add mimalloc memory allocator

Christian Heimes added the comment: ICC might be a problem. Apparently some version have an incomplete stdatomic.h, see bpo-37415. -- ___ Python tracker ___ _

[issue46657] Add mimalloc memory allocator

Change by Erlend E. Aasland : -- nosy: +erlendaasland ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: https:/

[issue46657] Add mimalloc memory allocator

Christian Heimes added the comment: We have an autoconf check for stdatomic.h. The test even verifies that a program with atomic_load_explicit() compiles and links. How do we want to use mimalloc in the future? Is it going to stay optional in 3.12? Then the default setting for --with-mimallo

[issue46657] Add mimalloc memory allocator

Neil Schemenauer added the comment: Thanks, I'm indeed interested. Most credit goes to Christian for advancing this. For the missing stdatomic.h, would it be appropriate to have an autoconfig check for it? Can just disable mimalloc if it doesn't exist. --

[issue46657] Add mimalloc memory allocator

Christian Heimes added the comment: Buildbots "PPC64 Fedora PR" and all RHEL 7 build bots provided by David Edelsohn are failing because compiler is missing support for stdatomic.h. -- ___ Python tracker __

[issue46657] Add mimalloc memory allocator

Christian Heimes added the comment: New features: - vendored mimalloc 2.0.3 + two patches from mimalloc dev branch. Mimalloc is embedded in obmalloc.o. Symbols are either hidden or names are mangled to have a _Py_ prefix. - ./configure --with[out]-mimalloc (default: yes), fails if atomics ar

[issue46657] Add mimalloc memory allocator

Dong-hee Na added the comment: I add Neil to the nosy list since he is one of the kick-off members with this amazing works :) -- ___ Python tracker ___ __

[issue46657] Add mimalloc memory allocator

Change by Dong-hee Na : -- nosy: +corona10, nascheme ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: https://

[issue46657] Add mimalloc memory allocator

Change by Christian Heimes : -- keywords: +patch pull_requests: +29337 stage: -> patch review pull_request: https://github.com/python/cpython/pull/31164 ___ Python tracker ___

[issue46657] Add mimalloc memory allocator

New submission from Christian Heimes : >From https://github.com/microsoft/mimalloc > mimalloc (pronounced "me-malloc") is a general purpose allocator with > excellent performance characteristics. Initially developed by Daan Leijen for > the run-time systems of the Koka and Lean languages. mi