reassign 83579 python-beautifulsoup 3.0.4-1 thanks I believe this is actually a bug in BeautifulSoup (or maybe in one of the libraries used by BeautifulSoup). If I'm mistaken, please reassign the bug back to webcheck.
As far as I can tell BeautifulSoup is called correctly with the correct encoding. Requesting this URL: http://en.wikipedia.org/wiki/News_aggregator results in the following response header: Content-Type: text/html; charset=utf-8 webcheck calls BeautifulSoup as follows (parsers/html/beautifulsoup.py line 44-45): soup = BeautifulSoup.BeautifulSoup(content, fromEncoding=str(link.encoding)) where content is the received content and link.encoding in this case is 'utf-8'. Unless I misunderstand BeautifulSoup documentation the fromEncoding prarameter should be used by BeautifulSoup to detect the encoding. For some reason 'ascii' ends up in sgmllib (which is wrong). The URL: http://www.belief-eela.org/ Has this header: Content-Type: text/html; charset=UTF-8 which results in the same situation (except the encoding is upper case). Anyway the SVN version of webcheck has been "fixed" to catch errors while parsing the page log them and otherwise ignore the page. -- -- arthur - [EMAIL PROTECTED] - http://people.debian.org/~adejong --
signature.asc
Description: This is a digitally signed message part
