ansible/roles/httpd/website/files/robots
Patrick Uiterwijk 25f71933ab Robots have no use in fedoracommunity as its just an aggregator
Signed-off-by: Patrick Uiterwijk <puiterwijk@redhat.com>
2015-09-16 11:50:59 +00:00
..
robots.txt Drop crawl-delay down to 1 2015-01-29 00:00:21 +00:00
robots.txt.admin.fedoraproject.org Just disallow /updates. Not much point in bodhi updates being in search engines. 2015-04-23 15:01:16 +00:00
robots.txt.apps.fedoraproject.org Robots have no use in fedoracommunity as its just an aggregator 2015-09-16 11:50:59 +00:00
robots.txt.fedoraproject.org Working on the proxies-websites.yml playbook. 2014-12-07 23:39:51 +00:00
robots.txt.lockbox01 Drop crawl-delay down to 1 2015-01-29 00:00:21 +00:00
robots.txt.translate.fedoraproject.org Working on the proxies-websites.yml playbook. 2014-12-07 23:39:51 +00:00