On Wednesday 26 February 2020 08:27:33 Greg Wooledge wrote: > On Wed, Feb 26, 2020 at 03:57:51AM -0500, Gene Heskett wrote: > > over the last 90 days or so, we seem to have been plauged with a new > > breed of bots scanning our web pages, and they are not just indexing > > our web pages I don't mind that, but they are ignoring our > > robots.txt > > I can believe this. But it's better if you SHOW us the actual logfile > entries (not all of them, obviously -- just a reasonable sample). > > If the bots have a recognizable user-agent, you can just configure > your web server to block queries from that user-agent. Then you don't > have to deal with iptables, nftables, or whatever they're calling > it this year.
I've had this in place now long enough the good examples like all the russian sembot's have probably all logrotated into /dev/null. This just showed up this morning, but no clue what it might be. Blocked it anyway. 46th rule. coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:06:58 -0500] "-" 408 0 "-" "-" coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:06:58 -0500] "-" 408 0 "-" "-" coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:07:58 -0500] "-" 408 0 "-" "-" coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:07:58 -0500] "-" 408 0 "-" "-" coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:08:58 -0500] "-" 408 0 "-" "-" coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:08:58 -0500] "-" 408 0 "-" "-" coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:09:58 -0500] "-" 408 0 "-" "-" coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:09:58 -0500] "-" 408 0 "-" "-" coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:10:58 -0500] "-" 408 0 "-" "-" coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:10:58 -0500] "-" 408 0 "-" "-" coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:11:58 -0500] "-" 408 0 "-" "-" coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:11:59 -0500] "-" 408 0 "-" "-" coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:12:58 -0500] "-" 408 0 "-" "-" coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:12:58 -0500] "-" 408 0 "-" "-" coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:13:59 -0500] "-" 408 0 "-" "-" coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:13:59 -0500] "-" 408 0 "-" "-" coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:14:59 -0500] "-" 408 0 "-" "-" coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:14:59 -0500] "-" 408 0 "-" "-" coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:15:59 -0500] "-" 408 0 "-" "-" coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:15:59 -0500] "-" 408 0 "-" "-" coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:51:43 -0500] "-" 408 0 "-" "-" coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:19:51:43 -0500] "-" 408 0 "-" "-" coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:20:29:32 -0500] "-" 408 0 "-" "-" coyote.coyote.den:80 91.160.218.196 - - [25/Feb/2020:20:29:32 -0500] "-" 408 0 "-" "-" No clue, butt dial? PROXAD.net someplace in France. Cheers, Gene Heskett -- "There are four boxes to be used in defense of liberty: soap, ballot, jury, and ammo. Please use in that order." -Ed Howdershelt (Author) If we desire respect for the law, we must first make the law respectable. - Louis D. Brandeis Genes Web page <http://geneslinuxbox.net:6309/gene>
