[issue8478] tokenize.untokenize first token missing failure case

Change by Berker Peksag : -- resolution: -> fixed stage: patch review -> resolved status: open -> closed ___ Python tracker ___ ___

[issue8478] tokenize.untokenize first token missing failure case

Roundup Robot added the comment: New changeset 8d6dd02a973f by Terry Jan Reedy in branch '3.3': Issue #20750, Enable roundtrip tests for new 5-tuple untokenize. The http://hg.python.org/cpython/rev/8d6dd02a973f -- ___ Python tracker

[issue8478] tokenize.untokenize first token missing failure case

Roundup Robot added the comment: New changeset c2517a37c13a by Terry Jan Reedy in branch '2.7': Issue #8478: Untokenizer.compat now processes first token from iterator input. http://hg.python.org/cpython/rev/c2517a37c13a New changeset b6d6ca792b64 by Terry Jan Reedy in branch '3.3': Issue #8478:

[issue8478] tokenize.untokenize first token missing failure case

Roundup Robot added the comment: New changeset c896d292080a by Terry Jan Reedy in branch '2.7': Untokenize: An logically incorrect assert tested user input validity. http://hg.python.org/cpython/rev/c896d292080a New changeset 51e5a89afb3b by Terry Jan Reedy in branch '3.3': Untokenize: An logica

[issue8478] tokenize.untokenize first token missing failure case

Changes by Terry J. Reedy : -- assignee: -> terry.reedy nosy: +terry.reedy stage: -> patch review versions: +Python 2.7, Python 3.3, Python 3.4 -Python 2.6 ___ Python tracker __

[issue8478] tokenize.untokenize first token missing failure case

Changes by Georg Brandl : -- assignee: georg.brandl -> ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: http://m

[issue8478] tokenize.untokenize first token missing failure case

Thomas Kluyver added the comment: #16224 appears to be a duplicate. There seem to be several quite major issues with untokenize - see also #12691 - with patches made to fix them. Is there anything I can do to help push these forwards? -- ___ Python

[issue8478] tokenize.untokenize first token missing failure case

Changes by Thomas Kluyver : -- nosy: +takluyver ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.pyth

[issue8478] tokenize.untokenize first token missing failure case

Changes by Eric Snow : -- nosy: +eric.snow ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.or

[issue8478] tokenize.untokenize first token missing failure case

Changes by Arfrever Frehtes Taifersar Arahesis : -- nosy: +Arfrever ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscrib

[issue8478] tokenize.untokenize first token missing failure case

Georg Brandl added the comment: Attaching patch. Actually both versions of untokenize() were broken; the version used for "full input" (5-tuples) had a flipped inequality sign in an assert. Other changes in the patch: * Docs fixed to describe both modes * Tests fixed to exercise both modes

[issue8478] tokenize.untokenize first token missing failure case

Changes by Georg Brandl : -- assignee: -> georg.brandl nosy: +georg.brandl ___ Python tracker ___ ___ Python-bugs-list mailing list Un

[issue8478] tokenize.untokenize first token missing failure case

Changes by rb : -- type: -> behavior ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mai

[issue8478] tokenize.untokenize first token missing failure case

New submission from rb : When altering tokens and thus not providing token location information, tokenize.untokenize sometimes misses out the first token. Failure case below. Expected output: 'import foo ,bar\n' Actual output: 'foo ,bar\n' $ python Python 2.6.4 (r264:75706, Dec 7 2009, 18:43: