[issue14624] Faster utf-16 decoder

Serhiy Storchaka added the comment: Thank you, Antoine. Now only issue14625 waits for review. > changeset: 77012:3430d7329a3b > +* UTF-8 and UTF-16 decoding is now 2x to 4x faster. In fact now UTF-16 decoding faster for a maximum of +25% compared to Python 3.2 on my computers (and sometimes

[issue14624] Faster utf-16 decoder

Antoine Pitrou added the comment: Thank you Serhiy! Now committed. -- resolution: -> fixed stage: -> committed/rejected status: open -> closed ___ Python tracker ___ _

[issue14624] Faster utf-16 decoder

Roundup Robot added the comment: New changeset cdcc816dea85 by Antoine Pitrou in branch 'default': Issue #14624: UTF-16 decoding is now 3x to 4x faster on various inputs. http://hg.python.org/cpython/rev/cdcc816dea85 -- ___ Python tracker

[issue14624] Faster utf-16 decoder

Serhiy Storchaka added the comment: Here are two new patch. Checking for characters out-of-range moved, making the code simpler. Theoretically it is a bit slow down decoding of short UCS1 strings (up to 1 and 3 chars on 32- and 64-bit), but practically there is no difference. The second patch is

[issue14624] Faster utf-16 decoder

Serhiy Storchaka added the comment: The patch updated with a little clarified code and added comments. -- Added file: http://bugs.python.org/file25590/decode_utf16_4.patch ___ Python tracker __

[issue14624] Faster utf-16 decoder

Antoine Pitrou added the comment: New performance figures under 64 bit Linux, Intel Core i5-2500K @ 3.30GHz: vanilla 3.3 patched utf-16le 'A'*1 1411 (+290%) 5504 utf-16le 'A'*+'\x80' 1368 (+263%) 4970

[issue14624] Faster utf-16 decoder

Changes by Serhiy Storchaka : -- components: +Unicode nosy: +ezio.melotti ___ Python tracker ___ ___ Python-bugs-list mailing list Uns

[issue14624] Faster utf-16 decoder

Serhiy Storchaka added the comment: The patch updated to stylistic conformity of the UTF-8 decoder. The decoding of the UCS2 non-surrogate characters a little speed up (+15%). -- Added file: http://bugs.python.org/file25536/decode_utf16_3.patch ___

[issue14624] Faster utf-16 decoder

Serhiy Storchaka added the comment: Here is updated patch, taking into account that unicode_widen is already optimized. -- Added file: http://bugs.python.org/file25443/decode_utf16_2.patch ___ Python tracker _

[issue14624] Faster utf-16 decoder

Roundup Robot added the comment: New changeset 830eeff4fe8f by Victor Stinner in branch 'default': Issue #14624, #14687: Optimize unicode_widen() http://hg.python.org/cpython/rev/830eeff4fe8f -- nosy: +python-dev ___ Python tracker

[issue14624] Faster utf-16 decoder

Antoine Pitrou added the comment: 64 bit Linux, Intel Core i5-2500K @ 3.30GHz: vanilla 3.3 patched utf-16le 'A'*1 1384 (+278%) 5233 utf-16le 'A'*+'\x80' 1303 (+259%) 4684 utf-16le 'A'*+'\u010

[issue14624] Faster utf-16 decoder

Serhiy Storchaka added the comment: Here are the results of benchmarking (numbers in MB/s). On 32-bit Linux, AMD Athlon 64 X2 4600+ @ 2.4GHz: Py2.7Py3.2Py3.3 patch utf-16le 'A'*1 504 (+282%) 1905 (+1%

[issue14624] Faster utf-16 decoder

Changes by Andrew Svetlov : -- nosy: +asvetlov ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.pyth

[issue14624] Faster utf-16 decoder

Changes by Arfrever Frehtes Taifersar Arahesis : -- nosy: +Arfrever ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscri

[issue14624] Faster utf-16 decoder

Martin v. Löwis added the comment: Serhiy: can you please submit a contributor form? -- nosy: +loewis ___ Python tracker ___ ___ Pyth

[issue14624] Faster utf-16 decoder

Serhiy Storchaka added the comment: See also issue #14579 for utf-16 decoder bugs. -- ___ Python tracker ___ ___ Python-bugs-list mai

[issue14624] Faster utf-16 decoder

STINNER Victor added the comment: See also #14625 for UTF-32 decoder. -- ___ Python tracker ___ ___ Python-bugs-list mailing list Uns

[issue14624] Faster utf-16 decoder

Changes by STINNER Victor : -- nosy: +haypo ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.

[issue14624] Faster utf-16 decoder

Changes by STINNER Victor : -- nosy: +pitrou ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python

[issue14624] Faster utf-16 decoder

New submission from Serhiy Storchaka : I propose a patch, which accelerates the utf-16 decoder. With PEP 393 utf-16 decoder slowed down a few times (3-4x), this patch returns the performance at the level of Python 3.2 and even higher (+10-30% over 3.2). In addition, it fixes a few bugs in the