[issue40512] [subinterpreters] Meta issue: per-interpreter GIL

Change by Jon Parise : -- nosy: +jon ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/

[issue40512] [subinterpreters] Meta issue: per-interpreter GIL

Change by Nathan Jensen : -- nosy: +ndjensen ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.pyt

[issue40512] [subinterpreters] Meta issue: per-interpreter GIL

Change by Mark Shannon : -- nosy: +Mark.Shannon nosy_count: 9.0 -> 10.0 pull_requests: +27492 stage: -> patch review pull_request: https://github.com/python/cpython/pull/29228 ___ Python tracker

[issue40512] [subinterpreters] Meta issue: per-interpreter GIL

Petr Viktorin added the comment: PyStructSequence_NewType exists, and is the same as the proposed PyStructSequence_FromModuleAndDesc except it doesn't take the module (which isn't necessary: PyStructSequence_Desc has no way to define functionality that would need the module state).

[issue40512] [subinterpreters] Meta issue: per-interpreter GIL

hai shi added the comment: bpo-45113: [subinterpreters][C API] Add a new function to create PyStructSequence from Heap. -- versions: +Python 3.11 -Python 3.10 ___ Python tracker

[issue40512] [subinterpreters] Meta issue: per-interpreter GIL

STINNER Victor added the comment: Hai Shi: > IMO, I suggest to create a new function, PyStructSequence_FromModuleAndDesc() Please create a new issue. If possible, I would prefer to have a sub-issue for that, to keep this issue as a tracking issue for all issues related to subinterpreters. -

[issue40512] [subinterpreters] Meta issue: per-interpreter GIL

hai shi added the comment: > PyStructSequence_InitType2() is not compatible with subinterpreters: it uses > static types. Moreover, it allocates tp_members memory which is not released > when the type is destroyed. But I'm not sure that the type is ever destroyed, > since this API is designe

[issue40512] [subinterpreters] Meta issue: per-interpreter GIL

STINNER Victor added the comment: PyStructSequence_InitType2() is not compatible with subinterpreters: it uses static types. Moreover, it allocates tp_members memory which is not released when the type is destroyed. But I'm not sure that the type is ever destroyed, since this API is designed

[issue40512] [subinterpreters] Meta issue: per-interpreter GIL

STINNER Victor added the comment: > * Add a lock to pymalloc, or disable pymalloc when subinterpreters are used: > https://github.com/ericsnowcurrently/multi-core-python/issues/30 See bpo-43313: "feature: support pymalloc for subinterpreters. each subinterpreter has pymalloc_state". ---

[issue40512] [subinterpreters] Meta issue: per-interpreter GIL

Change by Nicholas Sim : -- nosy: +nw0 ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.or

[issue40512] [subinterpreters] Meta issue: per-interpreter GIL

Change by Alex Garel : -- nosy: +alex-garel ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.pyth

[issue40512] [subinterpreters] Meta issue: per-interpreter GIL

STINNER Victor added the comment: FYI I wrote an article about this issue: "Isolate Python Subinterpreters" https://vstinner.github.io/isolate-subinterpreters.html -- ___ Python tracker _

[issue40512] [subinterpreters] Meta issue: per-interpreter GIL

STINNER Victor added the comment: > * resolve_slotdups() uses a static variable Attached resolve_slotdups.patch works around the issue by removing the cache. -- keywords: +patch Added file: https://bugs.python.org/file49700/resolve_slotdups.patch _

[issue40512] [subinterpreters] Meta issue: per-interpreter GIL

STINNER Victor added the comment: I played with ./configure --with-experimental-isolated-subinterpreters. I tried to run "pip list" in parallel in multiple interpreters. I hit multiple issues: * non-atomic reference count of Python objects shared by multiple interpreters, objects shared via

[issue40512] [subinterpreters] Meta issue: per-interpreter GIL

STINNER Victor added the comment: > Type method cache is shared. I created bpo-42745: "[subinterpreters] Make the type attribute lookup cache per-interpreter". -- ___ Python tracker ___

[issue40512] [subinterpreters] Meta issue: per-interpreter GIL

STINNER Victor added the comment: See also bpo-15751: "Make the PyGILState API compatible with subinterpreters". -- ___ Python tracker ___

[issue40512] [subinterpreters] Meta issue: per-interpreter GIL

STINNER Victor added the comment: FYI I'm also using https://pythondev.readthedocs.io/subinterpreters.html to track the progress on isolating subinterpreters. -- ___ Python tracker _

[issue40512] [subinterpreters] Meta issue: per-interpreter GIL

Change by Erlend Egeberg Aasland : -- nosy: +erlendaasland ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: ht

[issue40512] [subinterpreters] Meta issue: per-interpreter GIL

STINNER Victor added the comment: > * _PyLong_Zero and _PyLong_One singletons are shared Removed by bpo-42161 (commit c310185c081110741fae914c06c7aaf673ad3d0d). -- ___ Python tracker ___

[issue40512] [subinterpreters] Meta issue: per-interpreter GIL

STINNER Victor added the comment: > Update of the EXPERIMENTAL_ISOLATED_SUBINTERPRETERS status. Also: * _PyLong_Zero and _PyLong_One singletons are shared * Py_None, Py_True and Py_False singletons are shared: bpo-39511 and PR 18301 * Static types like PyUnicode_Type and PyLong_Type are share

[issue40512] [subinterpreters] Meta issue: per-interpreter GIL

STINNER Victor added the comment: Update of the EXPERIMENTAL_ISOLATED_SUBINTERPRETERS status. I made many free lists and singletons per interpreter in bpo-40521. TODO: * _PyUnicode_FromId() and interned strings are still shared: typeobject.c requires a workaround for that. * GC is disabled

[issue40512] [subinterpreters] Meta issue: per-interpreter GIL

STINNER Victor added the comment: Currently, the import lock is shared by all interpreters. It would also help for performance to make it per-interpreter to parallelize imports. -- versions: +Python 3.10 -Python 3.9 ___ Python tracker

[issue40512] [subinterpreters] Meta issue: per-interpreter GIL

STINNER Victor added the comment: I created a new "Subinterpreters" component in the bug tracker. It may help to better track all issues related to subinterpreters. -- ___ Python tracker ___

[issue40512] [subinterpreters] Meta issue: per-interpreter GIL

STINNER Victor added the comment: I marked bpo-36877 "[subinterpreters][meta] Move fields from _PyRuntimeState to PyInterpreterState" as a duplicate of this issue. -- ___ Python tracker

[issue40512] [subinterpreters] Meta issue: per-interpreter GIL

Change by STINNER Victor : -- components: +Subinterpreters -Interpreter Core title: Meta issue: per-interpreter GIL -> [subinterpreters] Meta issue: per-interpreter GIL ___ Python tracker ___