infrastructure/ansible
1
0
Fork 0
Code Pull requests 7 Activity Actions

Disallow robots from expensive queries on koschei

Browse source
This commit is contained in:
Michael Simacek 2017-02-24 16:02:34 +01:00
parent d929e0fc91
commit adade90a2c
1 changed files with 2 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

2
roles/httpd/website/files/robots/robots.txt.apps.fedoraproject.org
View file

@ -1,4 +1,6 @@
User-agent: *
Disallow: /packages/
Disallow: /datagrepper/
Disallow: /koschei/user/
Disallow: /koschei/affected-by/
Crawl-delay: 1