Serhiy Storchaka added the comment: > If there is not now, it would be nice if there were just one python-coded > function in Lib/tokenize.py that could be imported and used by the other > python code.
Agree. But look how many tokenize issues are opened around. Thank you for your report Paul. I left PEP 263 not fixed yet. Perhaps it needs rewording (especially in the light of other issues, such as #18960 and #18961). ---------- _______________________________________ Python tracker <rep...@bugs.python.org> <http://bugs.python.org/issue18873> _______________________________________ _______________________________________________ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com