[issue9974] tokenizer.untokenize not invariant with line continuations

[nick caruso]

nick caruso  added the comment:

--
import StringIO
import tokenize

tokens = []
def fnord(*a):
tokens.append(a)

tokenize.tokenize(StringIO.StringIO("a = 1").readline, fnord)

tokenize.untokenize(tokens)
--

Generates the same assertion failure, for what it's worth.  No line 
continuation needed.

This does not happen in 2.5 on my machine.

--
nosy: +nick.caruso

___
Python tracker 
<http://bugs.python.org/issue9974>
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue9974] tokenizer.untokenize not invariant with line continuations

[nick caruso]

nick caruso  added the comment:

Additionally, substituting "a=1\n" for "a=1" results in no assertion and 
successful "untokenizing" to "a = 1\n"

--

___
Python tracker 
<http://bugs.python.org/issue9974>
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com