Hi, sorry, but this did not work. As now when I type the http://domain.com/robots.txt the page returned is from within my cms application and not from the default
I am using the python framework itools (http://www.hforge.org) and this has in its URI a semi-column i.e. http://www.hforge.org/;view Can I call my robots.txt file anything? Cheers Norman On Thu, Jan 22, 2009 at 6:40 PM, Bob Ionescu <bobsie...@googlemail.com> wrote: > 2009/1/22 Norman Khine <nor...@khine.net>: >> Is there a way I can put a robots.txt file to reside outside of the >> rewrite, so that if a the bots look for http://domain.com/robots.txt >> the rewrite does not push it to the >> localhost:12080/companies/robots.txt > > Just exclude the specific path: > > RewriteCond $1 !=robots.txt > RewriteRule ^/(.*) http://localhost:12080/companies/$1 [P] > > Bob > > --------------------------------------------------------------------- > The official User-To-User support forum of the Apache HTTP Server Project. > See <URL:http://httpd.apache.org/userslist.html> for more info. > To unsubscribe, e-mail: users-unsubscr...@httpd.apache.org > " from the digest: users-digest-unsubscr...@httpd.apache.org > For additional commands, e-mail: users-h...@httpd.apache.org > > --------------------------------------------------------------------- The official User-To-User support forum of the Apache HTTP Server Project. See <URL:http://httpd.apache.org/userslist.html> for more info. To unsubscribe, e-mail: users-unsubscr...@httpd.apache.org " from the digest: users-digest-unsubscr...@httpd.apache.org For additional commands, e-mail: users-h...@httpd.apache.org
