Scott Purcell wrote: > I really would like to find out how my (and if my site) is being > indexed. I am using Tomcat 5.5 and I am running a ecommerce site. I have > had nothing but trouble getting seen in search engines, so I would like > to be able to somehow trace what pages robots are indexing.
AFAIK there is no *absolutely* reliable way to find out wether a specific request is made by a robot or not. But this is a more theoretical restriction since most robots send a HTTP User-Agent header that identifies them. This means the first step is to make sure that the User-Agent string is logged. Then you might want to take a look at this link http://www.robotstxt.org/wc/active.html which has been posted here by Tim Lucia just a few days ago. Regards mks --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
