[issue8242] Support surrogates in import ; install Python in a non-ASCII directory

Changes by STINNER Victor : -- dependencies: +bz2: support surrogates in filename, and bytes/bytearray filename ___ Python tracker ___

[issue8242] Support surrogates in import ; install Python in a non-ASCII directory

Changes by STINNER Victor : -- dependencies: +subprocess: surrogates of the error message (Python implementation on non-Windows) ___ Python tracker ___ __

[issue8242] Support surrogates in import ; install Python in a non-ASCII directory

Changes by STINNER Victor : -- dependencies: +utf8, backslashreplace and surrogates ___ Python tracker ___ ___ Python-bugs-list mailing

[issue8242] Support surrogates in import ; install Python in a non-ASCII directory

Martin v. Löwis added the comment: I haven't reviewed the patch in detail yet, but it seems to me that it fixes independent issues. -1000 on that. One problem, one bug report in the tracker, one commit. If this issue is about the import machinery not working anymore if there is a non-ASCII c

[issue8242] Support surrogates in import ; install Python in a non-ASCII directory

STINNER Victor added the comment: $ diffstat ~/surrogates-7.patch Doc/library/tarfile.rst | 15 +-- Include/moduleobject.h |1 Lib/platform.py | 12 +- Lib/subprocess.py |2 Lib/tarfile.py | 14 -- Lib/test/regrtest.py|5 - L

[issue8242] Support surrogates in import ; install Python in a non-ASCII directory

Changes by STINNER Victor : Removed file: http://bugs.python.org/file16919/surrogates-6.patch ___ Python tracker ___ ___ Python-bugs-list maili

[issue8242] Support surrogates in import ; install Python in a non-ASCII directory

STINNER Victor added the comment: Updated patch: - Some parts have been applied in other issues - Remove assert(PyBytes_Check(x)): support PyByteArray type - use PyErr_Format() instead of sprintf+PyErr_SetString in tokenizer.c - don't convert message to byte and then back to unicode in err_i

[issue8242] Support surrogates in import ; install Python in a non-ASCII directory

STINNER Victor added the comment: I commited the platform.py patch as r80166 (trunk) and r80167 (py3k), but quickly reverted it because the patch on trunk broke Python bootstrap. The patch might be applied, but only on py3k and with more tests (ensure that it doesn't break bootstrap on any OS

[issue8242] Support surrogates in import ; install Python in a non-ASCII directory

Changes by STINNER Victor : -- dependencies: +tarfile: use surrogates for undecode fields ___ Python tracker ___ ___ Python-bugs-list m

[issue8242] Support surrogates in import ; install Python in a non-ASCII directory

Changes by STINNER Victor : -- dependencies: +pickle is unable to encode unicode surrogates ___ Python tracker ___ ___ Python-bugs-list

[issue8242] Support surrogates in import ; install Python in a non-ASCII directory

Changes by STINNER Victor : -- dependencies: +os.system() doesn't support surrogates nor bytes ___ Python tracker ___ ___ Python-bugs-l

[issue8242] Support surrogates in import ; install Python in a non-ASCII directory

Changes by STINNER Victor : Removed file: http://bugs.python.org/file16897/surrogates-5.patch ___ Python tracker ___ ___ Python-bugs-list maili

[issue8242] Support surrogates in import ; install Python in a non-ASCII directory

Changes by STINNER Victor : -- dependencies: +ctypes.dlopen() doesn't support surrogates ___ Python tracker ___ ___ Python-bugs-list ma

[issue8242] Support surrogates in import ; install Python in a non-ASCII directory

Changes by STINNER Victor : -- dependencies: +subprocess: support undecodable current working directory on POSIX OS ___ Python tracker ___ ___

[issue8242] Support surrogates in import ; install Python in a non-ASCII directory

STINNER Victor added the comment: New version of the patch: all tests pass except of 3 (test_ftplib, test_pep3120, test_traceback). -- Added file: http://bugs.python.org/file16919/surrogates-6.patch ___ Python tracker

[issue8242] Support surrogates in import ; install Python in a non-ASCII directory

Changes by STINNER Victor : -- dependencies: +os.execvpe() doesn't support surrogates in env ___ Python tracker ___ ___ Python-bugs-lis

[issue8242] Support surrogates in import ; install Python in a non-ASCII directory

Changes by STINNER Victor : -- dependencies: +test_xmlrpc fails with non-ascii path ___ Python tracker ___ ___ Python-bugs-list mailing

[issue8242] Support surrogates in import ; install Python in a non-ASCII directory

Changes by STINNER Victor : Removed file: http://bugs.python.org/file16671/surrogates_bootstrap-4.patch ___ Python tracker ___ ___ Python-bugs-

[issue8242] Support surrogates in import ; install Python in a non-ASCII directory

STINNER Victor added the comment: New patch fixing more issues about undecodable filenames. Lib/test/test_subprocess.py |4 - Lib/unittest/runner.py |4 + Modules/_posixsubprocess.c | 21 -- Modules/getpath.c | 90 +++-

[issue8242] Support surrogates in import ; install Python in a non-ASCII directory

Changes by Antoine Pitrou : -- nosy: +loewis ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.

[issue8242] Support surrogates in import ; install Python in a non-ASCII directory

STINNER Victor added the comment: > Initialize Py_FileSystemDefaultEncoding earlier in Py_InitializeEx(), > because its value is required to encode unicode using surrogates to bytes Oh, it doesn't work: get_codeset() returns NULL, because the codec register is empty when get_codeset() is calle

[issue8242] Support surrogates in import ; install Python in a non-ASCII directory

STINNER Victor added the comment: If I understood correctly, my patch is also required to import a module having a non-ASCII full path if the file system encoding is ASCII. -- ___ Python tracker __

[issue8242] Support surrogates in import ; install Python in a non-ASCII directory

New submission from STINNER Victor : If the fullpath to the python3 binary contains a non-ASCII character and the file system encoding is ASCII, Python fails with: --- Could not find platform independent libraries Could not find platform dependent libraries Consider setting $PYTHONHOME to [:]