[issue9974] tokenizer.untokenize not invariant with line continuations

nick caruso added the comment: Additionally, substituting "a=1\n" for "a=1" results in no assertion and successful "untokenizing" to "a = 1\n" -- ___ Python tr

[issue9974] tokenizer.untokenize not invariant with line continuations

nick caruso added the comment: -- import StringIO import tokenize tokens = [] def fnord(*a): tokens.append(a) tokenize.tokenize(StringIO.StringIO("a = 1").readline, fnord) tokenize.untokenize(tokens) -- Generates the same