Bug#253424: webcheck: stops with error while creating the report

[Francesco Potorti`]

Package: webcheck
Version: 1.0-9
Severity: normal

I call webcheck like this:

webcheck -o /home/www/reports/fly \
 -x galileo/ -x software/codes.html -x potorti.it \
 http://fly.isti.cnr.it/ fly.cnuce.cnr.it localhost

the log displays that it runs all the way until it starts creating the
site map:

$ tail /var/log/mirror/webcheck.fly.out
adding url: http://softwarelibero.it/gnudoc/
title: Traduttori italiani dei testi del progetto GNU
adding url: http://www.anybrowser.org/campaign/
title: Viewable with Any Browser: Campaign
adding url: http://softwarelibero.it/progetti/eucd/
title: Associazione Software Libero : Campagna sull'EUCD
adding url: http://petition.eurolinux.org
done.
Generating reports...
sitemap

and it also emits an error, after which it stops:
$ cat /var/log/mirror/webcheck.fly.err
Traceback (most recent call last):
  File "/usr/bin/webcheck", line 156, in ?
nav_bar(plugins)
  File "/usr/lib/python2.3/site-packages/webcheck/plugins/rptlib.py", line 177, 
in nav_bar
report.generate()
  File "/usr/lib/python2.3/site-packages/webcheck/plugins/sitemap.py", line 78, 
in generate
L = explore(webcheck.Link.base, {})
  File "/usr/lib/python2.3/site-packages/webcheck/plugins/sitemap.py", line 64, 
in explore
L = L + explore(child, explored)
  File "/usr/lib/python2.3/site-packages/webcheck/plugins/sitemap.py", line 62, 
in explore
child = webcheck.Link.linkList[i]
KeyError: 'http://fly.isti.cnr.it/didattica/lopriore/lopriore.html'

-- System Information:
Debian Release: testing/unstable
  APT prefers testing
  APT policy: (990, 'testing')
Architecture: i386 (i686)
Kernel: Linux 2.4.26
Locale: LANG=C, [EMAIL PROTECTED] (ignored: LC_ALL set to C)

Versions of packages webcheck depends on:
ii  python2.3.3-7An interactive high-level object-o

-- no debconf information

===File /etc/webcheck/config.py=
"""

 Webcheck Configuration file
 Edit this file to your choosing.  This is just a regular Python module, so
 if you want to do something fancy with it, go right ahead. Just make sure
 that all variables are defined and have an appropriate value .

"""
BASE_URLS_ONLY=0
EXCLUDED_URLS = []
YANKED_URLS = []
AVOID_EXTERNAL_LINKS = 0
SCHEMES = ['http','ftp','file']
PROXIES = None
HEADERS = None
HOSTS = []
OUTPUT_DIR = '/home/www/reports/webcheck'
ANCHOR_BAD_LINKS = 1
WAIT_BETWEEN_REQUESTS = 0
REDIRECT_DEPTH = 5
WARN_OLD_VERSION = 0
DEBUG_LEVEL = 1
PLUGINS = ['sitemap',
   'badlinks',
   'images',
   'whatsold',
   'whatsnew',
   'slow',
   'notitles',
   'external',
   'notchkd']
   
STYLESHEET = 'file:///usr/share/webcheck/webcheck.css'
NAVBAR_FILENAME= 'navbar.html'
NAVBAR_WIDTH = '150'
NAVBAR_PADDING = 4
NAVBAR_SPACING = 0
MAIN_FILENAME  = 'index.html'
OVERWRITE_FILES= 1
LOGO_HREF="webcheck.png"
REPORT_SITEMAP_LEVEL = 5 # How many levels deep to display the site map
REPORT_IMAGES_COLS=5
REPORT_IMAGES_WIDTH=100
REPORT_IMAGES_HEIGHT=100
REPORT_WHATSOLD_URL_AGE = 700
REPORT_WHATSNEW_URL_AGE = 7
REPORT_SLOW_URL_SIZE = 76

Bug#136506: Powerful weightloss now available for you.

[Gwen Stanford]

Hello, I have a special_offer for you...
WANT TO LOSE WEIGHT?
The most powerful weightloss is now available
without prescription. All natural Adipren720
100% Money Back Guarantée!
- Lose up to 19% Total Body Weight.
- Up to 300% more Weight Loss while dieting.
- Loss of 20-35% abdominal Fat.
- Reduction of 40-70% overall Fat under skin.
- Increase metabolic rate by 76.9% without Exercise.
- Boost your Confidence level and Self Esteem.
- Burns calorized fat.
- Suppresses appetite for sugar.
Get the facts about all-natural Adipren720 



 system information 
vary expected additional suggesting be locale-affected limited source 
documents proprietary Alternate interoperate under architecture collections
preferred 
Locale] sends Different session-like number Localization] languages requirements

platform Fallback Distinguishing We For covered generic them 
Results: widely acceptable Some updated typify various target