Infrastructure/ansible
3
0
Fork 0
Code Issues Pull requests 6 Projects Releases Packages Wiki Activity Actions

Indexing /datagrepper is useless

Browse source 
Signed-off-by: Patrick Uiterwijk <puiterwijk@redhat.com>
This commit is contained in:
Patrick Uiterwijk 2016-02-11 13:19:22 +00:00
parent 8946a6b284
commit ac83211407
1 changed files with 1 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
roles/httpd/website/files/robots/robots.txt.apps.fedoraproject.org
View file

@ -1,3 +1,4 @@
User-agent: *
Disallow: /packages/
Disallow: /datagrepper/
Crawl-delay: 1