-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 09/19/2012 01:36 AM, grarpamp wrote:
> They use it to indicate that they don't want their site to be > crawled. Tor2Web isn't crawling anything, thus they have no need or > obligation to fetch and consider anyone's robots in the first > place. Hidden services available through onion.to do get crawled by Google occasionally, though. I've stumbled across a few by accident. > And if a site is so concerned about someone else publishing a > link, however obtained, then they should name it something innocent > and password protect it or use better operational security to begin > with. A fair point. - -- The Doctor [412/724/301/703] [ZS] Developer, Project Byzantium: http://project-byzantium.org/ PGP: 0x807B17C1 / 7960 1CDC 85C9 0B63 8D9F DD89 3BD8 FF2B 807B 17C1 WWW: https://drwho.virtadpt.net/ Livin' la vida alpha test. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.19 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAlBaGJYACgkQO9j/K4B7F8GNjQCcCKEUjzj8Q9Ec0qRyY96GVBoS YtAAoL4xdFEaey3CQXzzgEPZceQNGNnl =+pn/ -----END PGP SIGNATURE----- _______________________________________________ tor-talk mailing list tor-talk@lists.torproject.org https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-talk
