Infrastructure/ansible
1
0
Fork 0
Code Issues Pull requests 6 Projects Releases Packages Wiki Activity Actions

Just disallow /updates. Not much point in bodhi updates being in search engines.

Browse source
This commit is contained in:
Kevin Fenzi 2015-04-23 15:01:16 +00:00
parent 88cc733244
commit 4f2d7f0362
1 changed files with 1 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
roles/httpd/website/files/robots/robots.txt.admin.fedoraproject.org
View file

@ -2,6 +2,7 @@ User-agent: *
Disallow: /voting Disallow: /voting
Disallow: /mirrormanager Disallow: /mirrormanager
Disallow: /pkgdb/packages/name Disallow: /pkgdb/packages/name
Disallow: /updates
# Temp block http://www.80legs.com/webcrawler.html # Temp block http://www.80legs.com/webcrawler.html
User-agent: 008 User-agent: 008