Branch: refs/heads/disallow-historical-pages
  Home:   https://github.com/jenkins-infra/jenkins-infra
  Commit: 8cfa44a36c9de43fdca360ec0cd6baed55f50d12
      
https://github.com/jenkins-infra/jenkins-infra/commit/8cfa44a36c9de43fdca360ec0cd6baed55f50d12
  Author: Oleg Nenashev <[email protected]>
  Date:   2020-11-21 (Sat, 21 Nov 2020)

  Changed paths:
    M dist/profile/files/confluence/robots.txt

  Log Message:
  -----------
  [INFRA-2825] - Wiki: Prevent search indexing of pages listed by pageId + 
disable indexing of page details and search results

This change prevents indexing of direct page view links like 
https://wiki.jenkins.io/pages/viewpage.action?pageId=97091655 (extension 
points). After we started adding redirects in vshost.conf, these pages started 
appearing in search instead. Adding robots.txt should help to prevent that

Inspired by https://gist.github.com/childnode/d15cd5e906a93fc1e11dcbdd55233b75 
and https://wiki.scn.sap.com/robots.txt . Anyone is welcome to setup full 
rules, just trying to improve the redirect experience.


-- 
You received this message because you are subscribed to the Google Groups 
"Jenkins Commits" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To view this discussion on the web visit 
https://groups.google.com/d/msgid/jenkinsci-commits/jenkins-infra/jenkins-infra/push/refs/heads/disallow-historical-pages/000000-8cfa44%40github.com.

Reply via email to