On Wed, 11 Dec 2013 15:07:35 -0800, Dan Stromberg wrote: > $ chardet mpaa-ratings-reasons.list > mpaa-ratings-reasons.list: windows-1255 (confidence: 0.97) > > I'm aware that chardet is playing guessing games, though one would hope > it would guess well most of the time, and give a reasonable confidence > rating.
What reason do you have for thinking that Windows-1255 isn't a reasonable guess? If the bulk of the text is Latin-1 except perhaps for one or two Hebrew characters (or what chardet thinks are Hebrew characters), it may actually be a reasonable guess. If it is a poor guess, perhaps you ought to report it to the chardet maintainers as a good example of a poor guess. By the way, this forum is a text-only newsgroup and so-called "Rich Text" (actually HTML) posts are frowned upon because most people don't appreciate having to read gunk like this: > <div dir="ltr"><br><div class="gmail_extra"><div > class="gmail_quote"> ... <br> > <blockquote class="gmail_quote" style="margin:0px 0px 0px > 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div > class="im"> ... <br></div></div></div></div> If you can, would you please turn off rich text posting when you post here please? Thank you. -- Steven -- https://mail.python.org/mailman/listinfo/python-list