[issue20574] Implement incremental decoder for cp65001

Changes by STINNER Victor : -- resolution: -> fixed status: open -> closed ___ Python tracker ___ ___ Python-bugs-list mailing list U

[issue20574] Implement incremental decoder for cp65001

STINNER Victor added the comment: I removed the test because there were two classes tesing the same codec and that tests were failing. I need to refactor tests, and so I reopen the issue. http://buildbot.python.org/all/builders/x86%20XP-4%203.x/builds/10291/steps/test/logs/stdio ==

[issue20574] Implement incremental decoder for cp65001

Roundup Robot added the comment: New changeset f6794a0fb2b3 by Victor Stinner in branch 'default': Issue #20574: Remove duplicated test failing on Windows XP http://hg.python.org/cpython/rev/f6794a0fb2b3 -- ___ Python tracker

[issue20574] Implement incremental decoder for cp65001

STINNER Victor added the comment: I don't feel the need to backport the new feature, so I'm closing the issue. -- resolution: -> fixed status: open -> closed ___ Python tracker

[issue20574] Implement incremental decoder for cp65001

STINNER Victor added the comment: > Could you please also add test_partial for CP65001 (if this will make sense)? I added CP65001Test which inherit from UTF8Test and so runs all UTF-8 tests on cp65001 codec. I'm surprised that the test pass. -- ___

[issue20574] Implement incremental decoder for cp65001

Roundup Robot added the comment: New changeset 85b87789f048 by Victor Stinner in branch 'default': Issue #20574: Add more tests for cp65001 http://hg.python.org/cpython/rev/85b87789f048 -- ___ Python tracker __

[issue20574] Implement incremental decoder for cp65001

Roundup Robot added the comment: New changeset 08f9b881f78c by Victor Stinner in branch 'default': Issue #20574: Implement incremental decoder for cp65001 code http://hg.python.org/cpython/rev/08f9b881f78c -- nosy: +python-dev ___ Python tracker

[issue20574] Implement incremental decoder for cp65001

STINNER Victor added the comment: It might be faster, or (more likely) has zero impact on performances. -- ___ Python tracker ___ ___

[issue20574] Implement incremental decoder for cp65001

Serhiy Storchaka added the comment: Nice. Could you please also add test_partial for CP65001 (if this will make sense)? What is performance regression of this patch? I considered this issue as a bug. And if performance regression is not too big, I think it can be applied to 3.3+. Otherwise a

[issue20574] Implement incremental decoder for cp65001

New submission from STINNER Victor: (Follow up of issue #20538 and #20571.) Attached patch implements incremental decoders for multibyte code pages (on Windows), especially for CP_UTF8 aka "cp65001" in Python. Code pages 932, 936, 949, 950 and 1361 already have an incremental decoder since: -