On 06/03/2018 01:47 PM, Kornel Benko wrote:
>
> Am Sonntag, 3. Juni 2018 19:29:08 CEST schrieb Jean-Marc Lasgouttes
> :
>
> > Le 03/06/2018 à 18:57, Richard Kimberly Heck a écrit :
>
> > > The server has been all but dead today. I found that the trac database
>
> > > was being scanned from crawl.so
Am Sonntag, 3. Juni 2018 19:29:08 CEST schrieb Jean-Marc Lasgouttes
:
> Le 03/06/2018 à 18:57, Richard Kimberly Heck a écrit :
> > The server has been all but dead today. I found that the trac database
> > was being scanned from crawl.sogou.com, which was apparently ignoring
> > our robots.txt fil
Le 03/06/2018 à 18:57, Richard Kimberly Heck a écrit :
The server has been all but dead today. I found that the trac database
was being scanned from crawl.sogou.com, which was apparently ignoring
our robots.txt file. I've added
Order allow,deny
Allow from all
Deny from crawl.sogou.com
