Re: rogue Chinese crawler

2001-11-26 Thread Christoph Moench-Tegeder
## Howland, Curtis ([EMAIL PROTECTED]): > Is there a "drop from..." command as well? I much prefer simply > black-holing packets rather than giving back to the perp "I'm here, but > I know about you" data by "deny". Or is that what the Apache "deny" > does? Apache's "Deny from" gives an error 403

Re: rogue Chinese crawler

2001-11-26 Thread Christoph Moench-Tegeder
## Howland, Curtis ([EMAIL PROTECTED]): > Is there a "drop from..." command as well? I much prefer simply > black-holing packets rather than giving back to the perp "I'm here, but > I know about you" data by "deny". Or is that what the Apache "deny" > does? Apache's "Deny from" gives an error 40

Re: rogue Chinese crawler

2001-11-25 Thread Martin WHEELER
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 OK, I've now been 24 hours without a hit, so I'm presuming I've got rid of all the crawlers. Thanks for all the help and advice from both lists. Resume: - - the openfind.com(.tw) 'bots don't respect the norobots conventions, so your robots.txt is us

RE: rogue Chinese crawler

2001-11-25 Thread Howland, Curtis
From: Christoph Moench-Tegeder [mailto:[EMAIL PROTECTED] Sent: Saturday, November 24, 2001 03:36 To: debian-security@lists.debian.org Subject: Re: rogue Chinese crawler ## Martin WHEELER ([EMAIL PROTECTED]): > Is anyone else having problems with the robot from > openfind.com.tw That one ha

Re: rogue Chinese crawler

2001-11-25 Thread Martin WHEELER
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 OK, I've now been 24 hours without a hit, so I'm presuming I've got rid of all the crawlers. Thanks for all the help and advice from both lists. Resume: - - the openfind.com(.tw) 'bots don't respect the norobots conventions, so your robots.txt is u

RE: rogue Chinese crawler

2001-11-25 Thread Howland, Curtis
From: Christoph Moench-Tegeder [mailto:[EMAIL PROTECTED]] Sent: Saturday, November 24, 2001 03:36 To: [EMAIL PROTECTED] Subject: Re: rogue Chinese crawler ## Martin WHEELER ([EMAIL PROTECTED]): > Is anyone else having problems with the robot from > openfind.com.tw That one has not been se

Re: rogue Chinese crawler

2001-11-24 Thread Christoph Moench-Tegeder
## Martin WHEELER ([EMAIL PROTECTED]): > Is anyone else having problems with the robot from > openfind.com.tw That one has not been seen here. > Anyone know of a sure-fire robot killer under woody? Apache himself (assuming your webserver runs apache, other servers should have something si

Re: rogue Chinese crawler

2001-11-24 Thread Hubert Chan
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > "Martin" == Martin WHEELER <[EMAIL PROTECTED]> writes: Martin> Is anyone else having problems with the robot from Martin> openfind.com.tw Martin> -- an intrusive, irritating, hard-to-get-rid-of crawler that Martin> completely paralyses my syst

rogue Chinese crawler

2001-11-24 Thread Martin WHEELER
Is anyone else having problems with the robot from openfind.com.tw -- an intrusive, irritating, hard-to-get-rid-of crawler that completely paralyses my system *every day*? Despite what I put in any robots.txt, this one disregards all rules and just jams up my system, downloading every damn

Re: rogue Chinese crawler

2001-11-24 Thread Tim Haynes
Martin WHEELER <[EMAIL PROTECTED]> writes: > Is anyone else having problems with the robot from > openfind.com.tw > -- an intrusive, irritating, hard-to-get-rid-of crawler that completely > paralyses my system *every day*? Nope. How does it paralyse you, anyway? > Despite what I put in any

Re: rogue Chinese crawler

2001-11-23 Thread Chris Wagner
The best way would be to block it at your router with an access list. Blocking it at the box is ok too but that takes a little bit of your resources. And you have to do it on each box on your network you want protected. The router block will protect your entire network in one fell swoop and cost

Re: rogue Chinese crawler

2001-11-23 Thread Christoph Moench-Tegeder
## Martin WHEELER ([EMAIL PROTECTED]): > Is anyone else having problems with the robot from > openfind.com.tw That one has not been seen here. > Anyone know of a sure-fire robot killer under woody? Apache himself (assuming your webserver runs apache, other servers should have something sim

Re: rogue Chinese crawler

2001-11-23 Thread Hubert Chan
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > "Martin" == Martin WHEELER <[EMAIL PROTECTED]> writes: Martin> Is anyone else having problems with the robot from Martin> openfind.com.tw Martin> -- an intrusive, irritating, hard-to-get-rid-of crawler that Martin> completely paralyses my syste

Re: rogue Chinese crawler

2001-11-23 Thread Christoph Ulrich Scholler
On Fri, Nov 23, 2001 at 05:32:04PM + or thereabouts, Martin WHEELER wrote: > Is anyone else having problems with the robot from > > openfind.com.tw > ... > Anyone know of a sure-fire robot killer under woody? as a first recourse you could instruct your firewall to deny all access from op

Re: rogue Chinese crawler

2001-11-23 Thread Tim Haynes
Martin WHEELER <[EMAIL PROTECTED]> writes: > Is anyone else having problems with the robot from > openfind.com.tw > -- an intrusive, irritating, hard-to-get-rid-of crawler that completely > paralyses my system *every day*? Nope. How does it paralyse you, anyway? > Despite what I put in any

rogue Chinese crawler

2001-11-23 Thread Martin WHEELER
Is anyone else having problems with the robot from openfind.com.tw -- an intrusive, irritating, hard-to-get-rid-of crawler that completely paralyses my system *every day*? Despite what I put in any robots.txt, this one disregards all rules and just jams up my system, downloading every damn'