[issue20956] tokenize module claims tokenize.tokenize returns namedtuple, but it doesn't

2014-03-17 Thread Curtis Maloney
Curtis Maloney added the comment: Corrected title. And, yeah, figured it wouldn't be added as a new feature, hence reporting this as a Documentation bug. -- title: tokenize module claims generate_tokens returns namedtuple, but it doesn't -> tokenize module claims toke

[issue20956] tokenize module claims generate_tokens returns namedtuple, but it doesn't

2014-03-17 Thread Curtis Maloney
New submission from Curtis Maloney: Although 3.x does yield a named-tuple, 2.x does not, despite the documentation: The exact type can be determined by checking the token string field on the named tuple returned from tokenize.tokenize() for the character sequence that identifies a