When it crawls the site, if you get always a hit on a specific page, you could capture more info than you would get in the log. Sometimes the "browser" field has the name of the bot in it.

You want to pursue this off-list?

Gerry

On 1/2/06, Scott Grayban <[EMAIL PROTECTED]> wrote:
Looks like only bots. I have a few hits of robots.txt getting hit first then
it crawls the site but thats but I have more hits to the robots.txt without a
crawl.

It almost feels virus like but I have no windows computer here in my network.

Scott

On Mon 2 January 2006 13:28, Gerry Danen wrote:
> Does it happen with real visitors also, or just bots?
>
> On 1/2/06, Scott Grayban <[EMAIL PROTECTED] > wrote:
> >
> > The missing IP/Host of course. I have never seen this before and I
> > know it didn't come from anything I do here. This just started to happen.
> >
> > Scott
> >
> > On Mon 2 January 2006 12:59, Gerry Danen wrote:
> > > Scott, what's the mystery, the missing IP or the GET robots.txt?
> >
> >
>

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: [EMAIL PROTECTED]
   "   from the digest: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]




--
Gerry
http://portal.danen.org/

Reply via email to