Hi,

I observed a peculiar behavior while using kwebget.  No matter whatever
file I ask it to probe to more depth and get the links there is always
this robots.txt popping up.  I wonder how it can be there in all the web
pages.  What could be wrong?

Thiru



-----------------------------------------------------------------------
LIH is all for free speech.  But it was created for a purpose - to help
people discuss issues about installing and running Linux.  If your
messages are counterproductive to this purpose, your privileges to
submit messages can and will be revoked.

Reply via email to