Both, yes. (Why bother with Bing and the others?)
Roland's reply was what I was looking for I think.

-----Original Message-----
From: Paul Uszak [mailto:paul.us...@gmail.com] 
Sent: Wednesday, 17 February 2016 11:31 PM
To: user@jspwiki.apache.org
Subject: Re: robots.txt files and JSPWiki

Can you clarify, do you mean:-

Only allow GoogleBot?
Only crawl JSPWiki?
Both?







On 17 February 2016 at 01:39, Jason Morris <jason.mor...@sydney.edu.au>
wrote:

> Hi All,
>
> What would be the proper config of robots.txt to allow only Google to 
> crawl a JSPWiki installation and nothing else?
>
> Cheers,
> Jason
>
> Jason C. Morris | PhD Candidate
> Department of Environmental Sciences | Faculty of Agriculture and 
> Environment THE UNIVERSITY OF SYDNEY, NSW, 2006
> phone: +61 02 8627 1152
>
>

Reply via email to