Luke Kenneth Casson Leighton <l...@lkcl.net> added the comment:
wtf??? neither can i!!!!
import io
import tokenize
text = r'''\
(
r"\(")
(
"\(")
'''
string_io = io.StringIO(text)
tokens = list(
tokenize.generate_tokens(string_io.readline)
)
print (tokens)
works perfectly.
ok ahhhh i bet you it's something to do with how
string_io.readline works, or something to do with
the format of the text. give me a sec to triage it.
----------
_______________________________________
Python tracker <rep...@bugs.python.org>
<https://bugs.python.org/issue34428>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe:
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
