Terry J. Reedy <tjre...@udel.edu> added the comment: I have not used tokenize, but if it is *not* intended to exactly reproduce the internal tokenizer behavior, the claim that it is should be amended.
---------- nosy: +terry.reedy _______________________________________ Python tracker <rep...@bugs.python.org> <http://bugs.python.org/issue12675> _______________________________________ _______________________________________________ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com