Infrastructure/ansible
3
0
Fork 0
Code Issues Pull requests 6 Projects Releases Packages Wiki Activity Actions

Working on the proxies-websites.yml playbook.

Browse source
This commit is contained in:
Ralph Bean 2014-12-07 23:39:44 +00:00
parent ee9fbbecaa
commit 00269dc0a8
14 changed files with 139 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

2
roles/httpd/website/files/robots/robots.txt Normal file
View file

@ -0,0 +1,2 @@
User-agent: *
Crawl-delay: 10

8
roles/httpd/website/files/robots/robots.txt.admin.fedoraproject.org Normal file
View file

@ -0,0 +1,8 @@
User-agent: *
Disallow: /voting
Disallow: /mirrormanager
Disallow: /pkgdb/packages/name
# Temp block http://www.80legs.com/webcrawler.html
User-agent: 008
Disallow: /

2
roles/httpd/website/files/robots/robots.txt.fedoraproject.org Normal file
View file

@ -0,0 +1,2 @@
User-agent: *
Disallow: /wikiold

4
roles/httpd/website/files/robots/robots.txt.lockbox01 Normal file
View file

@ -0,0 +1,4 @@
User-agent: *
Crawl-delay: 10
Allow: /infra/docs/
Disallow: /infra

4
roles/httpd/website/files/robots/robots.txt.translate.fedoraproject.org Normal file
View file

@ -0,0 +1,4 @@
User-agent: *
Crawl-delay: 10
Disallow: /*download_zip/$
Disallow: /*download_targz/$